I’ve been trying to install ChatRTX (version 0.4). Tried everything that seems to be suggested, but nothing is working. Installing from the app always fails somewhere during the downloading and installing of dependencies, while installing locally via the downloaded setup (in admin mode) always fails at building the Mistral 7B INT4 engine, shortly after allowing Python through the Firewall.
Setup:
-AMD Ryzen 9 9950X3D
-ROG Astral RTX 5090 OC
-64 GB RAM
-1.5 TB free on the M.2 SSD I’m installing on
-Windows 11 Pro (unlicensed, for now, if it matters?)
-Most recent drivers for my hardware are installed
-My username contains no spaces
Attempted:
-Install from NVIDIA app
-Install from downloaded setup (admin mode)
-Install to the default directory (C:\Program Files\NVIDIA Corporation\ChatRTX)
-Install to the recommended directory (C:\Users\UserName\AppData\Local\NVIDIA\ChatWithRTX)
-Install to a custom folder (C:\ChatRTX)
-Resume installation after fail
-Clean installation
-Disable Windows Defender & Firewall