OS: CentOS Linux 7 (Core) Driver Version: 470.82.01 GPUs: 2 Telsa T4 While I am typing nvidia-smi in my terminal, there is an error Unable to determine the device handle for GPU 0000:02:00.0: Unknown Error. And this is the output of nvidia-debugdump --list. Found 2 NVIDIA devices Error: nvmlDev…

You’re getting a fatal pcie error on the root bus so the gpu is disconnected. Please try reseating the gpu in its slot, try a different slot, check for a bios upgrade, check/replace mainboard. [ 695.203791] pcieport 0000:00:02.0: AER: Uncorrected (Fatal) error received: id=0010 [ 695.203805] pcie…

[image] generix: check for a bios upgrade Thanks for the advice. What do you mean by “check for a bios upgrade”. I have googled a lot, it doesnot have so mant satisfied answers. Can you make it more specificly?

A system bios update from the manufacturer of the server/mainboard.

Dear sir, may I ask how you solved your problem eventually? I think I got exactly the same problem as you. After trying a lot of approaches mentioned in previous posts, I still got the same problem. Thank you very much.

Sorry for replying so late… I finished by changing a different slot.

Hi, I’ve now came across the same question, but the problem only broke up when all the gpu have been used(use part of the gpu won’t appear). Is it the same problem you’ve solved?

I had the same issue with one of the GPUs not being able to load due to some reason. After draining the specified incorrect GPU ID, the remainder of the system works perfectly. I believe the issue is caused by the connected monitor. I have four Tesla V100 GPUs, one of which is linked to the Monitor. …

$ sudo nvidia-smi drain -p 0000:1E:00.0 -m 1 Successfully set GPU 00000000:1E:00.0 drain state to: draining. $ sudo nvidia-smi drain -p 0000:1E:00.0 -m 0 Successfully set GPU 00000000:1E:00.0 drain state to: not draining. I can not enable it back. I don’t know what went wrong.

You should see the very detailed log of the bug report. Many different bugs may result the same output in your terminal. You can always find the real reason in the log report.

Unable to determine the device handle for GPU 0000:02:00.0: Unknown Error

Graphics / Linux Linux

generix March 14, 2024, 8:05am 17

Please monitor gpu temperatures.

Topic		Replies	Views
Unable to determine the device handle for GPU 0000:02:00.0: Unknown Error Linux ubuntu , nvidia-smi	7	4361	March 12, 2024
Unable to determine the device handle for GPU :GPU is lost Linux	10	32168	August 11, 2021
Unable to determine the GPU device handle Linux	1	298	July 26, 2024
Unable to determine the device handle for GPU 0000:21:00.0: GPU is lost. Reboot the system to recover this GPU Linux	4	1013	January 18, 2022
Unable to determine the device handle for GPU 0000:68:00.0: Unknown Error Linux	5	13888	July 27, 2021
UnaUnable to determine the device handle for GPU Linux	1	388	October 12, 2022
Unable to determine the device handle for GPU 0000:21:00.0: Unknown Error Linux ubuntu , driver	15	18282	February 4, 2025
Please! Unable to determine the device handle for GPU0000:04:00.0: Unknown Error Linux	0	109	November 15, 2024
Unable to determine the device handle for GPU0000:05:00.0: Unknown Error Linux	0	335	October 31, 2024
How to solve NVRM: GPU 0000:01:00.0: GPU has fallen off the bus completely? Linux tensorflow , ubuntu	3	10739	March 27, 2025

Unable to determine the device handle for GPU 0000:02:00.0: Unknown Error

Related topics