Vulkan not working with A100-SXM4-80GB GPU in VM, vkCreateInstance failed with ERROR_INCOMPATIBLE_DRIVER

Env Configuration :

  • GPU : A100-SXM4-80GB
  • Hypervisor : Vmware
  • OS : RHEL 8.8
  • NVIDIA Driver : 535.154.05(case 1), 470.223.02(case 2)
  • Vulkan : 1.3.260(case 1), 1.2.189(case 2)

Trying to set up GPU server to run our app on VM. The GPU server has RHEL 8.8.
I’m having problem with getting Vulkan is not working in the GPU server

nvidia-smi :

+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.154.05          Driver Version: 535.154.05      CUDA Version: 12.6     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          sp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA A100-SXM4-80GB          On  | 00000000:01:00.0 Off |                    0 |
| N/A   39C    P0             59W / 275W  |      4MiB / 81920MiB |      0%      Default |
|                                         |                      |             Disabled |                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+

icd configuration (/etc/vulkan/icd.d/ or /usr/share/vulkan/icd.d) :

{
    "file_format_version" : "1.0.0",
    "ICD": {
        "library_path": "/usr/lib64/libGLX_nvidia.so.0",
        "api_version" : "1.3.260"
    }
}

libGLX_nvidia.so.0 file is valid path and file.

vulkaninfo output :

ERROR: [Loader Message] Code 0 : vkCreateInstance: Found no drivers!
Cannot create Vulkan instance.
This problem is often caused by a faulty installation of the Vulkan driver or attempting to use a GPU that does not support Vulkan.
ERROR at /xxxx/xxxx/xxxx/vulkan/1.3.260.0/source/Vulkan-Tools/vulkaninfo/vulkaninfo.h:688:vkCreateInstance failed with ERROR_INCOMPATIBLE_DRIVER

I confirmed that vulkan operates normally in the this configuration(RHEL8.6, A100-PCIe-80GB, NVIDIA-515-65.01, vulkan 1.2.xxx) in another virtual machine. Currently the GPU cannot use A100-PCIe-80GB and must use A100-SXM4-80GB.

Does A100-SXM4-80GB support vulkan in a virtual environment?
If supported, which version of Nvidia drivers and vulkan should I use?

I succeeded by reinstalling to v8.6 RHEL(VM, GuestOS) and NVIDIA driver 525.104.07with vulkan 1.2.189.
It seems that version 8.8 does not support vulkan yet on VM.