Run SGLang in Thor

Robotics & Edge Computing Jetson Systems Jetson Thor
10

I don’t know sglang but this might help.

env |grep -i cuda

If following values aren't returned, set them and add to ~/.bashrc

CUDA_HOME=/usr/local/cuda
LIBRARY_PATH=/usr/local/cuda-13.0/targets/sbsa-linux/lib
PATH=$PATH:/usr/local/cuda/bin