ChatRTX compatibility

Hi everyone I am using latest nvidia driver as of this date. My gpu is RTX5070TI. When I try to install chatrtx 0.5 i get an error that my system is not compatible, although chatrtx seems compatible with rtx3080 for example. Is that a bug? When I try installing chatrtx0.4 from nvidia app, installation failed without further details. I use default installation directory which is C:\Program Files\NVIDIA Corporation.…

Does anyone with rtx50 experience similar issues?

7 Likes

Hello, I experience the same issue with my 5070ti.
I searched for the NVIDIA ChatRTX User Guide and found out the following prerequisite:

  • ChatRTX is currently built for GeForce RTX 3xxx, RTX 4xxx series GPUs that have at least 8 GB GPU memory, and RTX 5xxx series GPUs (limited to the 5080 and 5090 variants) that have at least 16GB of GPU memory (vGPU configurations are not currently supported). RTX 4xxx (limited to the 4080 and 4090 desktop variants) or RTX 5xxx (limited to the 5080 and 5090 desktop variants) and RTX 6000 Ada GPUs with at least 16GB of GPU memory is required to use ChatRTX with NVIDIA NIM

So yes, it seems that 5070ti and lower 50xx gpus are not supported for some reason

2 Likes

Hey I know about this, but it doesnt make sence since all rtx30 are more hardware limited than rtx5070ti (except 3090 ti because of vram). There must be something else. Maybe driver issue ? I saw these requirements but they are old, at the time they were published, 5070ti was available yet (5070ti was released a bit later from 80s and 90s)

1 Like

hi, i just bought an msi vector with an rtx 5080 for some reason and its not working. i want to know why chat rtx is not working? it keeps saying the gpu isnt compatible.

1 Like

Looks like a common issue, no idea why yet

Hi @jaspratap.s.kalkat,

Laptop Blackwell GPUs are not supported in ChatRTX 0.5 - Desktop RTX 5080 is supported.

Best,

Sophie

what about desktop rtx 5070 ti? Are u going to support it any time soon ?

6 Likes

@sophwats Why do you assume it’s about laptops? Desktop 5070 ti has no support too. When will it be supported?

5 Likes

I’m having the same issue, NVIDIA when will you open chatrtx up to the 5070ti???

3 Likes

Get it working on the 5070 asap! I am both a user and a shareholder.

4 Likes

No whining. Yeah, it’s a beta. Unless non-xx80 or xx90 series is baked in during development its not going to happen. Maybe play with LM Studio to scratch that itch?

Wow that sucks! Makes no sense because 5070Ti is on the same chip & vram as a 5080 but gets neglected for compatibility!

2 Likes

hi,
ChatRTX 0.5 is supported only on 5090 and 5080 Desktop gpus. Currently, there is no plan to extend support for other Blackwell desktop gpus.

There is no explanation why RTX 5070/TI aren’t supported, but RTX 4060 LAPTOP 8GB is supported, even 3060 it screams laziness in my eyes..

3 Likes

I just bought a new PC with the 5070 ti, I cannot believe that the ai is not supported.

4 Likes

That doesn’t make any sense… Why wouldn’t ChatRTX download on to my 5070 when it downloaded on to my 3070ti? Do you know the technical reason/s for this? If not, would you please direct us to someone that does?

2 Likes

ChatRTX 0.5 supports only NIMs on Blackwell gpus and not rest of the legacy models. At the time of ChatRTX 0.5 development, NIMs were not tested on other Blackwell gpus like 5070 because they were not released.

would u extend ur development to cover 5070. I have a very powerful device Asus Proart P16 with 64RAM AI9 HX with your RTX5070 & i can’t run although i can run on LM-Studio way bigger models than my 8VRAM 5070!!!

I Just noticed that i paid around 350 $ more to get the 5070 instead the 4070 (8vRAM as well) which is according to announced spec compatible !!! IT FEELS LIKE DOWNGRADE to me not Upgrade??!!

You Support is highly appreciated

3 Likes

What is the likelihood that future versions of ChatRTX will be supported on RTX 5090 Blackwell laptop GPUs? The hardware seems more than capable of handling the workload.