Hello, I’ve tried searching for a way to get other LLMs on Chat With RTX but I couldn’t find any helpful information. Can anyone please help me with this? I’ve seen videos where the app launches in the browser but mine just launches in its own window with no option to add a model.
(Here is an image of what my ui looks like) Thank you very much! :)
I’m having the same issue. I’ve downloaded a few AI models that work very well in LMStudio. However, limiting our choice of AI models to a low quality Mistral 7B int4 is not a good choice. Especially when some of us having higher amount of RAMs and GPUs (in my case 64G RAM and 12B GPUs).
It’s quite odd how they came out with such a good program and then decided to limit us this much. It could be an ease-of-use thing but most people who are messing around with it are more than knowledgeable enough to. Hopefully, this will be implemented in the future.
I found another program that was a good alternative for me, it’s called Jan AI. You can download models via pasting huggingface links and it can also be given PDF files. I am not sure whether you can attach other file types.