ChatRTX compatibility

AI & Data Science AI Foundation Models and Endpoints
1

Hi everyone I am using latest nvidia driver as of this date. My gpu is RTX5070TI. When I try to install chatrtx 0.5 i get an error that my system is not compatible, although chatrtx seems compatible with rtx3080 for example. Is that a bug? When I try installing chatrtx0.4 from nvidia app, installation failed without further details. I use default installation directory which is C:\Program Files\NVIDIA Corporation.…

Does anyone with rtx50 experience similar issues?

3 Likes
2

Hello, I experience the same issue with my 5070ti.
I searched for the NVIDIA ChatRTX User Guide and found out the following prerequisite:

  • ChatRTX is currently built for GeForce RTX 3xxx, RTX 4xxx series GPUs that have at least 8 GB GPU memory, and RTX 5xxx series GPUs (limited to the 5080 and 5090 variants) that have at least 16GB of GPU memory (vGPU configurations are not currently supported). RTX 4xxx (limited to the 4080 and 4090 desktop variants) or RTX 5xxx (limited to the 5080 and 5090 desktop variants) and RTX 6000 Ada GPUs with at least 16GB of GPU memory is required to use ChatRTX with NVIDIA NIM

So yes, it seems that 5070ti and lower 50xx gpus are not supported for some reason

3

Hey I know about this, but it doesnt make sence since all rtx30 are more hardware limited than rtx5070ti (except 3090 ti because of vram). There must be something else. Maybe driver issue ? I saw these requirements but they are old, at the time they were published, 5070ti was available yet (5070ti was released a bit later from 80s and 90s)