Unable to run TensorRT LLM on azure vm

Description

Unable to run TensorRT LLM on azure vm

Version 23.09.1

  • Ubuntu Server 22.04 (x86)
  • NVIDIA TRD Driver 535.54.03
  • Docker-ce 24.0.6
  • NVIDIA Container Toolkit 1.13.5
  • Latest Azure CLI
  • Miniconda
  • JupyterLab latest and other Jupyter core packages
  • NGC CLI 3.22.0
  • Git, Python3-PIP

When we try to execute nvidia-smi it says

What to do?
What nvidia driver version should i manually install to run Nvidia tensorRT LLM

Hi @shivam.mehta ,
Have you tried removing and reinstalling drivers?