Preview for CUDA on WSL Updated for Performance

Recently Microsoft announced their Public Preview program for their Windows Subsystem for Linux (WSL) capability on Microsoft Windows platforms. NVIDIA co-released GPU-accelerated support via CUDA on WSL, where AI frameworks run as Linux executables on Microsoft Windows platforms.

We are happy to announce the release of the latest version of the preview driver with enhancements that will improve the experience for CUDA WSL users and enable more of the native CUDA features on WSL:

  • Performance of CUDA on WSL2 was particularly lacking on small workloads without batching, as they incurred higher CPU overhead. We have improved the performance of such workloads by optimizing the driver for launch and synchronization tasks. We plan to deliver additional performance optimizations in upcoming drivers to improve the CUDA experience on WSL.
  • DirectML API support for DirectX 12 based GPU acceleration
  • One of the key CUDA features enabled in this driver is the support for PTX JIT. This will enable CUDA developers to run [PTX code] on WSL2. Note that unlike Native Linux, in WSL we load PTX JIT from the Driver Store directly, so you will not find the library in your lib folders.

Features planned in upcoming releases:

  • Support for driver libraries such as Optix
  • Performance optimizations related to memory access
  • Support for NVML and Nvidia-smi for GPU management
  • Additional improvements for multi-GPU systems

Interested participants register in both the NVIDIA Developer Program and the Microsoft Windows Insider Program, and can then access the driver installers and documentation via the Downloads area on our CUDA on WSL webpage. Developers can use our Forum for sharing their public preview feedback with the WSL community.

Leverage our developer blog to learn much more about how CUDA works with WSL, including how to get started with running applications, including deep learning containers.

1 Like

Is it enough to download and install the new drivers for these changes to take effect or is it necessary to follow the entire procedure and reinstall WSL 2 as well?

A simple driver install would do the trick. Going forward with WSL2, a driver update will update everything (your native display driver and the WSL drivers).

1 Like

Hi All,

Do you think we will see 3060 Ti device-id added to this driver : .
Just received my card but its hardware-id is not yet added to the driver yet, I guess because the card only got release last week.

Thanks :)