Thor开发板上测试vllm失败

[AastaLLL]

Hi,

You will need our latest vLLM container for the GPT-OSS support.
Please find more details in the comment below:

Issue with run gpt-oss-120b in vLLM

Hi, Thanks for your patience. Below are the steps to run gpt-oss-20b with our new vLLM container. (Test with 20b model, but 120b is expected to work as well) For gpt-oss model, you will need the WAR mentioned in this link on Harmony encoding. $ sudo docker run -it --rm nvcr.io/nvidia/vllm:25.09-py3 # mkdir /etc/encodings # wget https://openaipublic.blob.core.windows.net/encodings/cl100k_base.tiktoken -O /etc/encodings/cl100k_base.tiktoken # wget https://openaipublic.blob.core.windows.net/e…

Thanks.