Installation issues with Chat with RTX

[scott164]

Tried this, changed RAG file setting from default 15 to 7 and now the llma2 installer shows up. I can see three options now but llma2 fails to install.

Chat with RTX did not seem to install Llama LLM

So it seems the engine is not being built for some reason, the “…/llama/llama13_int4_engine/” was not created. K, so you can modify the minimum requirements for a GPU with less than 16GB in this file llama13b.nvi located in the installation directory “\NVIDIA_ChatWithRTX_Demo\ChatWithRTX_Offline_2_11_mistral_Llama\RAG”. [image] [image]