ChatRTX: "There was a problem downloading Meta Llama 3.1 8b NIM"

AI & Data Science AI Foundation Models and Endpoints
,
1

Hello everyone,
I’m trying to use ChatRTX with my NVIDIA RTX 5080, but I have the following problem:

I can’t download the Meta Llama 3.1 8b NIM model and get the following error message:
“There was a problem downloading Meta Llama 3.1 8b NIM. Restart ChatRTX and try again later”

I was able to download and use the CLIP model without any problems.

My PC (Win 11 24H2) also fulfills all other requirements and I have installed the following.

NVIDIA ChatRTX 0.5
NVIDIA Driver 572.83
NVIDIA AI Workbench 0.97.5
NVIDIA FrameView SDK 1.5.10920

The Meta Llama 3.1 8b is unfortunately the only model that I can use with my 5080 (apart from CLIP) according to the documentation.

Here is a picture of my installation:

grafik
grafik591×338 49.1 KB

Any help would be appreciated.

Best regards

1 Like
2

I have exactly the same issue.

3

hi @benoitcherel and @second-fred because this issue is on ChatRTX, please take a look at this post for the best way to get support SUPPORT for ChatRTX Users.

Thanks,

Sophie

4

I installed it last night and Llama failed when I checked later. It looks like I will have to do some digging to get this installed properly now..