We’ve recently started to see programs get stuck on init:
15:03:28 [00002b68fd0d76e0] write(20, “cuda-EvtHandlr”, 14) = 14
15:03:28 [00002b68fd0d9798] close(20) = 0
15:03:28 [00002b68fd0d6f0d] futex(0x1c73998, FUTEX_WAKE_PRIVATE, 1) = 1
15:03:28 [00002b68fddfe4a7] ioctl(3, _IOC(_IOC_READ|_IOC_WRITE, 0x46, 0x2a, 0x20), 0x7ffe20cdc9a0) = 0
15:03:28 [00002b68fddfe4a7] ioctl(4, _IOC(0, 0, 0x19, 0)
^ for the above that’s with the 515.65.01 driver and running a super-basic program built using CUDA Version 11.7 and (not) starting on a GTX1080TI. By super-basic program I mean:
#include <stdio.h>
global void cuda_hello(){
printf(“Hello World from GPU!\n”);
}
int main() {
cuda_hello<<<1,1>>>();
return 0;
}
Has anyone else seen this? nvidia-smi still works fine and can pull responses from the GPU.