Under CentOS 7.1 system, eight GPU cards are checked with nvidia-smi command, one card is error, one card is lost, and when nvida-smi command is executed, carton is slow.

Hardware environment:supermicr server SYS-4028GR-TR ,NVIDIA Tesla V100 x8,Mellanox MCX4121A-ACAT x1.system:centos 7.1 x64 。Trouble: 1. The machine loses a graphics card when it is in normal operation, and uses nvidia-smi to check another card error. 2. In case 1, print slowly with nvidia-smi command, Carton。After the problem occurs, restarting the machine can solve the problem of Katon and graphics card error reporting.Please help to see what caused the problem. Thank you.


Start of NVIDIA bug report log file. Please include this file, along
with a detailed description of your problem, when reporting a graphics
driver bug via the NVIDIA Linux forum (see devtalk.nvidia.com)
or by sending email to ‘linux-bugs@nvidia.com’.

nvidia-bug-report.sh Version: 23796061

Date: Thu Jan 3 10:51:16 CST 2019
uname: Linux gha-data-hdp-dn-gpu48.gh.sankuai.com 3.10.0-229.el7.x86_64 #1 SMP Fri Mar 6 11:36:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux
command line flags:


*** /etc/issue
*** ls: -rw-r–r–. 1 root root 23 2015-04-01 06:27:02.000000000 +0800 /etc/issue
\S
Kernel \r on an \m


*** /etc/redhat-release
*** ls: lrwxrwxrwx. 1 root root 14 2017-06-12 15:04:20.490000000 +0800 /etc/redhat-release → centos-release
CentOS Linux release 7.1.1503 (Core)


*** /var/log/nvidia-installer.log does not exist


*** /var/lib/dkms/nvidia/410.72/3.10.0-229.el7.x86_64/x86_64/log/make.log
*** ls: -rw-r–r-- 1 root root 17880 2018-12-07 11:36:06.920023374 +0800 /var/lib/dkms/nvidia/410.72/3.10.0-229.el7.x86_64/x86_64/log/make.log
DKMS make.log for nvidia-410.72 for kernel 3.10.0-229.el7.x86_64 (x86_64)
Fri Dec 7 11:34:14 CST 2018
make[1]: Entering directory /usr/src/kernels/3.10.0-229.el7.x86_64' SYMLINK /var/lib/dkms/nvidia/410.72/build/nvidia-modeset/nv-modeset-kernel.o SYMLINK /var/lib/dkms/nvidia/410.72/build/nvidia/nv-kernel.o CONFTEST: INIT_WORK CONFTEST: remap_pfn_range CONFTEST: hash__remap_4k_pfn CONFTEST: follow_pfn CONFTEST: vmap CONFTEST: set_pages_uc CONFTEST: set_memory_uc CONFTEST: set_memory_array_uc CONFTEST: change_page_attr CONFTEST: pci_get_class CONFTEST: pci_choose_state CONFTEST: vm_insert_page CONFTEST: acpi_device_id CONFTEST: acquire_console_sem CONFTEST: console_lock CONFTEST: kmem_cache_create CONFTEST: on_each_cpu CONFTEST: smp_call_function CONFTEST: acpi_evaluate_integer CONFTEST: ioremap_cache CONFTEST: ioremap_wc CONFTEST: acpi_walk_namespace CONFTEST: pci_domain_nr CONFTEST: pci_dma_mapping_error CONFTEST: sg_alloc_table CONFTEST: sg_init_table CONFTEST: pci_get_domain_bus_and_slot CONFTEST: get_num_physpages CONFTEST: efi_enabled CONFTEST: proc_create_data CONFTEST: pde_data CONFTEST: proc_remove CONFTEST: pm_vt_switch_required CONFTEST: xen_ioemu_inject_msi CONFTEST: phys_to_dma CONFTEST: get_dma_ops CONFTEST: write_cr4 CONFTEST: of_get_property CONFTEST: of_find_node_by_phandle CONFTEST: of_node_to_nid CONFTEST: pnv_pci_get_npu_dev CONFTEST: of_get_ibm_chip_id CONFTEST: for_each_online_node CONFTEST: node_end_pfn CONFTEST: pci_bus_address CONFTEST: pci_stop_and_remove_bus_device CONFTEST: pci_remove_bus_device CONFTEST: request_threaded_irq CONFTEST: register_cpu_notifier CONFTEST: cpuhp_setup_state CONFTEST: dma_map_resource CONFTEST: backlight_device_register CONFTEST: register_acpi_notifier CONFTEST: timer_setup CONFTEST: pci_enable_msix_range CONFTEST: kmem_cache_create_usercopy CONFTEST: remap_page_range CONFTEST: address_space_init_once CONFTEST: kbasename CONFTEST: fatal_signal_pending CONFTEST: list_cut_position CONFTEST: vzalloc CONFTEST: wait_on_bit_lock_argument_count CONFTEST: bitmap_clear CONFTEST: usleep_range CONFTEST: radix_tree_empty CONFTEST: radix_tree_replace_slot CONFTEST: pnv_npu2_init_context CONFTEST: drm_dev_unref CONFTEST: drm_reinit_primary_mode_group CONFTEST: drm_atomic_set_mode_for_crtc CONFTEST: drm_atomic_clean_old_fb CONFTEST: get_user_pages_remote CONFTEST: get_user_pages CONFTEST: drm_gem_object_lookup CONFTEST: drm_atomic_state_free CONFTEST: drm_driver_has_gem_prime_res_obj CONFTEST: drm_atomic_helper_disable_all CONFTEST: drm_atomic_helper_set_config CONFTEST: drm_atomic_helper_connector_dpms CONFTEST: drm_connector_funcs_have_mode_in_name CONFTEST: is_export_symbol_gpl_of_node_to_nid CONFTEST: is_export_symbol_present_swiotlb_map_sg_attrs CONFTEST: i2c_adapter CONFTEST: pm_message_t CONFTEST: irq_handler_t CONFTEST: acpi_device_ops CONFTEST: acpi_op_remove CONFTEST: outer_flush_all CONFTEST: proc_dir_entry CONFTEST: scatterlist CONFTEST: sg_table CONFTEST: file_operations CONFTEST: vm_operations_struct CONFTEST: atomic_long_type CONFTEST: pci_save_state CONFTEST: file_inode CONFTEST: task_struct CONFTEST: kuid_t CONFTEST: dma_ops CONFTEST: dma_map_ops CONFTEST: noncoherent_swiotlb_dma_ops CONFTEST: vm_fault_present CONFTEST: vm_fault_has_address CONFTEST: backlight_properties_type CONFTEST: dev_pm_ops CONFTEST: fault_flags CONFTEST: atomic64_type CONFTEST: address_space CONFTEST: backing_dev_info CONFTEST: mm_context_t CONFTEST: vm_ops_fault_removed_vma_arg CONFTEST: drm_bus_present CONFTEST: drm_bus_has_bus_type CONFTEST: drm_bus_has_get_irq CONFTEST: drm_bus_has_get_name CONFTEST: drm_driver_has_legacy_dev_list CONFTEST: drm_driver_has_set_busid CONFTEST: drm_crtc_state_has_connectors_changed CONFTEST: drm_init_function_args CONFTEST: drm_mode_connector_list_update_has_merge_type_bits_arg CONFTEST: drm_helper_mode_fill_fb_struct CONFTEST: drm_master_drop_has_from_release_arg CONFTEST: drm_driver_unload_has_int_return_type CONFTEST: kref_has_refcount_of_type_refcount_t CONFTEST: drm_atomic_helper_crtc_destroy_state_has_crtc_arg CONFTEST: drm_crtc_helper_funcs_has_atomic_enable CONFTEST: drm_old_atomic_state_iterators_present CONFTEST: drm_mode_object_find_has_file_priv_arg CONFTEST: dma_buf_owner CONFTEST: dom0_kernel_present CONFTEST: nvidia_vgpu_kvm_build CONFTEST: nvidia_grid_build CONFTEST: drm_available CONFTEST: drm_atomic_available CONFTEST: drm_atomic_modeset_nonblocking_commit_available CONFTEST: is_export_symbol_gpl_refcount_inc CONFTEST: is_export_symbol_gpl_refcount_dec_and_test CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-drv.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-utils.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-crtc.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-encoder.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-connector.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-gem.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-fb.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-modeset.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-prime-fence.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-linux.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-helper.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nv-pci-table.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-gem-nvkms-memory.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm/nvidia-drm-gem-user-memory.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-modeset/nvidia-modeset-linux.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_turing.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_turing_mmu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_turing_host.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm_utils.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm_common.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm_linux.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/nvstatus.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/nvCpuUuid.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_tools.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_global.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_isr.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_procfs.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_va_space.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_va_space_mm.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_semaphore.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_mem.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_rm_mem.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_channel.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_lock.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_hal.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_tree.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_allocator.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_va_range.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_va_block.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_group.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_replayable_faults.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_non_replayable_faults.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_access_counters.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_events.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_module.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_mmu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pte_batch.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_tlb_batch.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_push.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pushbuffer.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_thread_context.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_tracker.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kepler.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kepler_ce.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kepler_host.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kepler_mmu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_maxwell.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_maxwell_host.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pascal.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pascal_ce.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pascal_host.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pascal_mmu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pascal_fault_buffer.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_volta_host.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_volta_mmu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_volta.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_volta_fault_buffer.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_volta_access_counter_buffer.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_policy.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_utils.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kvmalloc.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pmm_sysmem.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pmm_gpu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_migrate.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_populate_pageable.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_map_external.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_user_channel.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_hmm.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_heuristics.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_thrashing.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_prefetch.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_ats_ibm.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_ats_faults.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_test_rng.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_tree_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_allocator_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_gpu_semaphore_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_mem_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_rm_mem_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_page_tree_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_tracker_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_push_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_channel_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_ce_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_lock_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_utils_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_kvmalloc_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pmm_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_pmm_sysmem_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_events_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_perf_module_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_get_rm_ptes_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_fault_buffer_flush_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_mmu_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_peer_identity_mappings_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_va_block_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm/uvm8_range_group_tree_test.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-frontend.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-instance.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-acpi.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-chrdev.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-cray.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-dma.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-gvi.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-i2c.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-mempool.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-mmap.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-p2p.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-pat.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-procfs.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-usermap.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-vm.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-vtophys.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/os-interface.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/os-mlock.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/os-pci.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/os-registry.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/os-usermap.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-modeset-interface.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-pci-table.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-kthread-q.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-kthread-q-selftest.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-memdbg.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-ibmnpu.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-report-err.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-rsync.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv-msi.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nv_uvm_interface.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/nvlink_linux.o CC [M] /var/lib/dkms/nvidia/410.72/build/nvidia/linux_nvswitch.o ld -r -o /var/lib/dkms/nvidia/410.72/build/nvidia-modeset/nv-modeset-interface.o /var/lib/dkms/nvidia/410.72/build/nvidia-modeset/nvidia-modeset-linux.o LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia.o LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm.o LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-modeset.o LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm.o ld -r -o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-interface.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-frontend.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-instance.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-acpi.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-chrdev.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-cray.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-dma.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-gvi.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-i2c.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-mempool.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-mmap.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-p2p.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-pat.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-procfs.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-usermap.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-vm.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-vtophys.o /var/lib/dkms/nvidia/410.72/build/nvidia/os-interface.o /var/lib/dkms/nvidia/410.72/build/nvidia/os-mlock.o /var/lib/dkms/nvidia/410.72/build/nvidia/os-pci.o /var/lib/dkms/nvidia/410.72/build/nvidia/os-registry.o /var/lib/dkms/nvidia/410.72/build/nvidia/os-usermap.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-modeset-interface.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-pci-table.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-kthread-q.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-kthread-q-selftest.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-memdbg.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-ibmnpu.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-report-err.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-rsync.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv-msi.o /var/lib/dkms/nvidia/410.72/build/nvidia/nv_uvm_interface.o /var/lib/dkms/nvidia/410.72/build/nvidia/nvlink_linux.o /var/lib/dkms/nvidia/410.72/build/nvidia/linux_nvswitch.o Building modules, stage 2. MODPOST 4 modules CC /var/lib/dkms/nvidia/410.72/build/nvidia-drm.mod.o CC /var/lib/dkms/nvidia/410.72/build/nvidia-modeset.mod.o CC /var/lib/dkms/nvidia/410.72/build/nvidia-uvm.mod.o CC /var/lib/dkms/nvidia/410.72/build/nvidia.mod.o LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-drm.ko LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-modeset.ko LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia-uvm.ko LD [M] /var/lib/dkms/nvidia/410.72/build/nvidia.ko make[1]: Leaving directory /usr/src/kernels/3.10.0-229.el7.x86_64’


journalctl -b -0 _COMM=Xorg

– No entries –


journalctl -b -1 _COMM=Xorg


journalctl -b -2 _COMM=Xorg


journalctl -b -0 _COMM=Xorg.bin

– No entries –


journalctl -b -1 _COMM=Xorg.bin


journalctl -b -2 _COMM=Xorg.bin


journalctl -b -0 _COMM=X

– No entries –


journalctl -b -1 _COMM=X


journalctl -b -2 _COMM=X


*** /usr/share/nvidia/nvidia-application-profiles-410.72-rc
*** ls: -rw-r–r-- 1 root root 6980 2018-10-18 09:03:54.000000000 +0800 /usr/share/nvidia/nvidia-application-profiles-410.72-rc

Application profiles for the NVIDIA Linux graphics driver, version 410.72

Last modified: Wed Oct 17 20:03:54 CDT 2018

These profiles were provided by NVIDIA and should not be modified. If you

wish to change the defaults provided here, you can override them by creating

custom rules in /etc/nvidia/nvidia-application-profiles-rc (which will apply

system-wide) or, for a given user, $HOME/.nv/nvidia-application-profiles-rc

(which will apply to that particular user). See the "APPLICATION PROFILE

SEARCH PATH" section of the NVIDIA Linux Graphics Driver README for more

information.

{
“profiles” : [
{
“name” : “NonConformantBlitFramebufferScissor”,
“settings” : [ “GLConformantBlitFramebufferScissor”, false ]
},
{
“name” : “CL1C”,
“settings” : [ “0x528ab3”, 1 ]
},
{
“name” : “FA0”,
“settings” : [ “10572898”, 0 ]
},
{
“name” : “ExactGLESVersion”,
“settings” : [ “ForceRequestedESVersion”, 1 ]
},
{
“name” : “IgnoreGLSLExtensionRequirements”,
“settings” : [ “GLIgnoreGLSLExtReqs”, true ]
},
{
“name” : “No GSYNC/OSD”,
“settings” : [
{
“key” : “GLGSYNCAllowed”,
“value” : false
},
{
“key” : “GLShowGraphicsOSD”,
“value” : false
}
]
},
{
“name” : “UseThreadedOptimizations”,
“settings” : [ “GLThreadedOptimizations”, true ]
},
{
“name” : “NoThreadedOptimizations”,
“settings” : [ “GLThreadedOptimizations”, false ]
},
{
“name” : “NoAniso”,
“settings” : [ “GLLogMaxAniso”, 0 ]
},
{
“name” : “NamedVertexAttributesApplyDivisor”,
“settings” : [ “GL23cd0e”, 1 ]
},
{
“name” : “NonStrictDrawRangeElements”,
“settings” : [ “GLStrictDrawRangeElements”, false ]
},
{
“name” : “NoEnforceShaderInputOutputMatching”,
“settings” : [ “GLShaderPortabilityWarnings”, false ]
}
],
“rules” : [
{
“pattern” : {
“feature” : “dso”,
“matches” : “libcogl.so”
},
“profile” : “NonConformantBlitFramebufferScissor”
},
{
“pattern” : {
“feature” : “dso”,
“matches” : “libMaya.so”
},
“profile” : “CL1C”
},
{
“pattern” : {
“feature” : “dso”,
“matches” : “libMaya.so”
},
“profile” : “NamedVertexAttributesApplyDivisor”
},
{ “pattern” : “SkullGirls.x86_64-pc-linux-gnu”, “profile” : “NoAniso” },
{ “pattern” : “SkullGirls.i686-pc-linux-gnu”, “profile” : “NoAniso” },
{ “pattern” : “Indivisible_Linux.i686-pc-linux-gnu”, “profile” : “NoAniso” },
{ “pattern” : “xsi”, “profile” : “CL1C” },
{ “pattern” : “HoudiniFX”, “profile” : “CL1C” },
{ “pattern” : “katana”, “profile” : “CL1C” },
{ “pattern” : “Autodesk Mudbox 2014 64-bit”, “profile” : “CL1C” },
{ “pattern” : “octane”, “profile” : “CL1C” },
{ “pattern” : “Fusion64_6.4”, “profile” : “CL1C” },
{ “pattern” : “Nuke7.0”, “profile” : “CL1C” },
{ “pattern” : “vray.exe”, “profile” : “CL1C” },
{ “pattern” : “vray.bin”, “profile” : “CL1C” },
{ “pattern” : “kwin_gles”, “profile” : “FA0” },
{ “pattern” : “kwin_gles”, “profile” : “ExactGLESVersion” },
{
“pattern” : [
{ “feature” : “procname”, “matches” : “heaven_x86”},
{ “op” : “not”, “sub” : { “feature” : “findfile”, “matches” : “browser_x86” } }
],
“profile” : “IgnoreGLSLExtensionRequirements”
},
{
“pattern” : [
{ “feature” : “procname”, “matches” : “heaven_x64”},
{ “op” : “not”, “sub” : { “feature” : “findfile”, “matches” : “browser_x64” } }
],
“profile” : “IgnoreGLSLExtensionRequirements”
},
{ “pattern” : { “feature” : “procname”, “matches” : “cinnamon” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “compiz” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “compton” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “enlightenment” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “gnome-shell” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “kscreenlocker_greet” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “kwin” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “kwin_x11” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “plasmashell” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “ksplashqml” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “systemsettings5” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “muffin” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “dso”, “matches” : “libmutter” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “steam” }, “profile” : “No GSYNC/OSD” },
{ “pattern” : { “feature” : “procname”, “matches” : “steamcompmgr” }, “profile” : “No GSYNC/OSD” },
{
“pattern” : “Borderlands2”,
“profile” : “UseThreadedOptimizations”
},
{
“pattern” : “BorderlandsPreSequel”,
“profile” : “UseThreadedOptimizations”
},
{
“pattern” : “GoatGame”,
“profile” : “NonStrictDrawRangeElements”
},
{
“pattern” : “ShadowOfMordor”,
“profile” : “NoEnforceShaderInputOutputMatching”
},
{
“pattern” : “shotcut”,
“profile” : “NoThreadedOptimizations”
},
{
“pattern” : “MetroLL”,
“profile” : “NoThreadedOptimizations”
},
{ “pattern”: “AlienIsolation”, “profile” : “UseThreadedOptimizations” },
{ “pattern”: “Civ6”, “profile” : “UseThreadedOptimizations” },
{ “pattern”: “CivBE”, “profile” : “UseThreadedOptimizations” },
{ “pattern”: “overlord.i386”, “profile” : “UseThreadedOptimizations” }
]
}


Skipping ldd output (glxinfo not found)


Vulkan loader not found


/sbin/lspci -d “10de:*” -v -xxx

04:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 247, NUMA node 0
Memory at c4000000 (32-bit, non-prefetchable)
Memory at 27000000000 (64-bit, prefetchable)
Memory at 27800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 c4 0c 00 00 00 70 02 00 00 0c 00 00 00
20: 78 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 98 05 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 08 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

05:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 248, NUMA node 0
Memory at c3000000 (32-bit, non-prefetchable)
Memory at 26000000000 (64-bit, prefetchable)
Memory at 26800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 c3 0c 00 00 00 60 02 00 00 0c 00 00 00
20: 68 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 b8 05 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 10 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

08:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 249, NUMA node 0
Memory at c1000000 (32-bit, non-prefetchable)
Memory at 25000000000 (64-bit, prefetchable)
Memory at 25800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 c1 0c 00 00 00 50 02 00 00 0c 00 00 00
20: 58 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 d8 05 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 08 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

09:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 250, NUMA node 0
Memory at c0000000 (32-bit, non-prefetchable)
Memory at 24000000000 (64-bit, prefetchable)
Memory at 24800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 c0 0c 00 00 00 40 02 00 00 0c 00 00 00
20: 48 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 f8 05 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 10 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

85:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 251, NUMA node 1
Memory at fa000000 (32-bit, non-prefetchable)
Memory at 2f000000000 (64-bit, prefetchable)
Memory at 2f800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 fa 0c 00 00 00 f0 02 00 00 0c 00 00 00
20: f8 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 d8 01 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 08 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

89:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 252, NUMA node 1
Memory at f8000000 (32-bit, non-prefetchable)
Memory at 2e000000000 (64-bit, prefetchable)
Memory at 2e800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 f8 0c 00 00 00 e0 02 00 00 0c 00 00 00
20: e8 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 f8 01 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 08 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

8a:00.0 3D controller: NVIDIA Corporation Device 1db6 (rev a1)
Subsystem: NVIDIA Corporation Device 124a
Flags: bus master, fast devsel, latency 0, IRQ 253, NUMA node 1
Memory at f7000000 (32-bit, non-prefetchable)
Memory at 2d000000000 (64-bit, prefetchable)
Memory at 2d800000000 (64-bit, prefetchable)
Capabilities: [60] Power Management version 3
Capabilities: [68] MSI: Enable+ Count=1/1 Maskable- 64bit+
Capabilities: [78] Express Endpoint, MSI 00
Capabilities: [100] Virtual Channel
Capabilities: [250] Latency Tolerance Reporting
Capabilities: [258] L1 PM Substates
Capabilities: [128] Power Budgeting <?> Capabilities: [420] Advanced Error Reporting Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
Capabilities: [900] #19
Capabilities: [ac0] #23
Kernel driver in use: nvidia
Kernel modules: nouveau, nvidia_drm, nvidia
00: de 10 b6 1d 07 00 10 00 a1 00 02 03 00 00 00 00
10: 00 00 00 f7 0c 00 00 00 d0 02 00 00 0c 00 00 00
20: d8 02 00 00 00 00 00 00 00 00 00 00 de 10 4a 12
30: 00 00 00 00 60 00 00 00 00 00 00 00 0b 01 00 00
40: de 10 4a 12 00 00 00 00 00 00 00 00 00 00 00 00
50: 03 00 00 00 01 00 00 00 ce d6 23 00 00 00 00 00
60: 01 68 03 00 08 00 00 00 05 78 81 00 18 05 e0 fe
70: 00 00 00 00 00 00 00 00 10 00 02 00 e1 8d 64 00
80: 30 21 00 00 03 41 45 10 00 01 03 11 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 13 08 04 00
a0: 00 00 00 00 0e 00 00 00 03 00 1e 00 00 00 00 00
b0: 00 00 00 00 09 00 14 01 00 00 10 80 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 02 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00


/sbin/lspci -d “10b5:*” -v -xxx

02:00.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Physical Slot: 2
Flags: bus master, fast devsel, latency 0, IRQ 95, NUMA node 0
Memory at c5000000 (32-bit, non-prefetchable)
Bus: primary=02, secondary=03, subordinate=05, sec-latency=0
Memory behind bridge: c3000000-c4ffffff
Prefetchable memory behind bridge: 0000026000000000-0000027801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [b00] Latency Tolerance Reporting Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 c5 00 00 00 00 02 03 05 00 f1 01 00 00
20: 00 c3 f0 c4 01 00 f1 01 60 02 00 00 78 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 d8 03 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 52 00 04 80 00 00
70: 20 08 09 00 03 61 41 00 00 00 03 01 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 40 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

03:08.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 96, NUMA node 0
Bus: primary=03, secondary=04, subordinate=04, sec-latency=0
Memory behind bridge: c4000000-c4ffffff
Prefetchable memory behind bridge: 0000027000000000-0000027801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 03 04 04 00 f1 01 00 00
20: 00 c4 f0 c4 01 00 f1 01 70 02 00 00 78 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 f8 03 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 08 00 00 03 e1 80 0c 40 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

03:10.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 97, NUMA node 0
Bus: primary=03, secondary=05, subordinate=05, sec-latency=0
Memory behind bridge: c3000000-c3ffffff
Prefetchable memory behind bridge: 0000026000000000-0000026801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 03 05 05 00 f1 01 00 00
20: 00 c3 f0 c3 01 00 f1 01 60 02 00 00 68 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 18 04 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 10 00 00 03 e1 80 0c 80 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

06:00.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Physical Slot: 3
Flags: bus master, fast devsel, latency 0, IRQ 98, NUMA node 0
Memory at c2000000 (32-bit, non-prefetchable)
Bus: primary=06, secondary=07, subordinate=09, sec-latency=0
Memory behind bridge: c0000000-c1ffffff
Prefetchable memory behind bridge: 0000024000000000-0000025801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [b00] Latency Tolerance Reporting Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 c2 00 00 00 00 06 07 09 00 f1 01 00 00
20: 00 c0 f0 c1 01 00 f1 01 40 02 00 00 58 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 38 04 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 52 00 04 80 00 00
70: 20 08 09 00 03 61 41 00 00 00 03 01 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 40 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

07:08.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 99, NUMA node 0
Bus: primary=07, secondary=08, subordinate=08, sec-latency=0
Memory behind bridge: c1000000-c1ffffff
Prefetchable memory behind bridge: 0000025000000000-0000025801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 07 08 08 00 f1 01 00 00
20: 00 c1 f0 c1 01 00 f1 01 50 02 00 00 58 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 58 04 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 08 00 00 03 e1 80 0c 40 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

07:10.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 100, NUMA node 0
Bus: primary=07, secondary=09, subordinate=09, sec-latency=0
Memory behind bridge: c0000000-c0ffffff
Prefetchable memory behind bridge: 0000024000000000-0000024801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 07 09 09 00 f1 01 00 00
20: 00 c0 f0 c0 01 00 f1 01 40 02 00 00 48 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 78 04 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 10 00 00 03 e1 80 0c 80 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

83:00.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Physical Slot: 6
Flags: bus master, fast devsel, latency 0, IRQ 105, NUMA node 1
Memory at fb000000 (32-bit, non-prefetchable)
Bus: primary=83, secondary=84, subordinate=86, sec-latency=0
Memory behind bridge: fa000000-faffffff
Prefetchable memory behind bridge: 000002f000000000-000002f801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [b00] Latency Tolerance Reporting Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 fb 00 00 00 00 83 84 86 00 f1 01 00 00
20: 00 fa f0 fa 01 00 f1 01 f0 02 00 00 f8 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 18 01 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 52 00 04 80 00 00
70: 20 08 09 00 03 61 41 00 00 00 83 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 40 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

84:08.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 106, NUMA node 1
Bus: primary=84, secondary=85, subordinate=85, sec-latency=0
Memory behind bridge: fa000000-faffffff
Prefetchable memory behind bridge: 000002f000000000-000002f801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 84 85 85 00 f1 01 00 00
20: 00 fa f0 fa 01 00 f1 01 f0 02 00 00 f8 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 38 01 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 08 00 00 03 e1 80 0c 40 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

84:10.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 107, NUMA node 1
Bus: primary=84, secondary=86, subordinate=86, sec-latency=0
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 84 86 86 00 f1 01 00 00
20: f0 ff 00 00 f1 ff 01 00 00 00 00 00 00 00 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 58 01 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 10 08 09 00 03 61 79 10 00 00 01 00 80 0c 80 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 01 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

87:00.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Physical Slot: 4
Flags: bus master, fast devsel, latency 0, IRQ 108, NUMA node 1
Memory at f9000000 (32-bit, non-prefetchable)
Bus: primary=87, secondary=88, subordinate=8a, sec-latency=0
Memory behind bridge: f7000000-f8ffffff
Prefetchable memory behind bridge: 000002d000000000-000002e801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Upstream Port, MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [b00] Latency Tolerance Reporting Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 f9 00 00 00 00 87 88 8a 00 f1 01 00 00
20: 00 f7 f0 f8 01 00 f1 01 d0 02 00 00 e8 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 78 01 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 52 00 04 80 00 00
70: 20 08 09 00 03 61 41 00 00 00 03 01 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 40 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

88:08.0 PCI bridge: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch (rev ca) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 109, NUMA node 1
Bus: primary=88, secondary=89, subordinate=89, sec-latency=0
Memory behind bridge: f8000000-f8ffffff
Prefetchable memory behind bridge: 000002e000000000-000002e801ffffff
Capabilities: [40] Power Management version 3
Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
Capabilities: [68] Express Downstream Port (Slot+), MSI 00
Capabilities: [a4] Subsystem: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch
Capabilities: [100] Device Serial Number ca-87-00-10-b5-df-0e-00
Capabilities: [fb4] Advanced Error Reporting
Capabilities: [138] Power Budgeting <?> Capabilities: [10c] #19 Capabilities: [148] Virtual Channel Capabilities: [e00] #12 Capabilities: [f24] Access Control Services Capabilities: [b70] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp
00: b5 10 47 87 07 04 10 00 ca 00 04 06 10 00 01 00
10: 00 00 00 00 00 00 00 00 88 89 89 00 f1 01 00 00
20: 00 f8 f0 f8 01 00 f1 01 e0 02 00 00 e8 02 00 00
30: 00 00 00 00 40 00 00 00 00 00 00 00 0b 01 10 00
40: 01 48 03 c8 08 00 00 00 05 68 87 01 98 01 e0 fe
50: 00 00 00 00 00 00 00 00 ff 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 10 a4 62 01 04 80 00 00
70: 20 08 09 00 03 61 79 08 00 00 03 e1 80 0c 40 00
80: 00 00 40 00 00 00 00 00 00 00 00 00 60 08 04 00
90: 00 00 00 00 0e 01 00 00 03 00 1e 00 00 00 00 00
a0: 00 00 00 00 0d 00 00 00 b5 10 47 87 00 00 00 00
b0: 00 00 00
50nvidia-bug-report.log.rar (2.49 MB)

The missing card isn’t detected by the system at all. Check that it is properly seated, all the power connectors are properly plugged in, check in another system if it is broken.
The card that is erroring out, also check for properly connected power connectors, run cuda memtest to check for a memory failure, also check in another system for a general hardware failure.

Thank you very much. Under the observation of updating the latest graphics driver, there are hardware problems with the lost graphics card. Is there any other pressure testing tool to check for faults?

cuda-memtest to check for memory faults, gpu-burn for stress testing.