Impossible to install ChatRTX? Fails to build Mistral 7B engine

I’ve been trying to install ChatRTX (version 0.4). Tried everything that seems to be suggested, but nothing is working. Installing from the app always fails somewhere during the downloading and installing of dependencies, while installing locally via the downloaded setup (in admin mode) always fails at building the Mistral 7B INT4 engine, shortly after allowing Python through the Firewall.

Setup:
-AMD Ryzen 9 9950X3D
-ROG Astral RTX 5090 OC
-64 GB RAM
-1.5 TB free on the M.2 SSD I’m installing on
-Windows 11 Pro (unlicensed, for now, if it matters?)
-Most recent drivers for my hardware are installed
-My username contains no spaces

Attempted:
-Install from NVIDIA app
-Install from downloaded setup (admin mode)
-Install to the default directory (C:\Program Files\NVIDIA Corporation\ChatRTX)
-Install to the recommended directory (C:\Users\UserName\AppData\Local\NVIDIA\ChatWithRTX)
-Install to a custom folder (C:\ChatRTX)
-Resume installation after fail
-Clean installation
-Disable Windows Defender & Firewall

1 Like

Hi @battlers_forever - Sorry you’re hitting fails on the install.

For ChatRTX end-user issues (e.g. installation problems, bugs, feature requests), please refer to the GeForce forum.

For developer requests associated the ChatRTX source code/repo, please refer to the ChatRTX Github.

Thanks,
Sophie