# Chat with RTX Model Version Problem While Starting **URL:** \ **Category:** NVIDIA Nemotron\ **Created:** [March 25, 2024, 11:59am UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268 "2024-03-25T11:59:22Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![mehmettozbek](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@mehmettozbek](https://forums.developer.nvidia.com/u/mehmettozbek)\ **Post date:** [March 25, 2024, 11:59am UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/1 "2024-03-25T11:59:22Z")
Hey there, I succesfully installed Chat with RTX on my computer (i9 RTX3090Ti 32GB RAM and enough disk size). It installed correctly but when I click program I got this error below: Any suggestion to fix this ? ```auto Environment path found: C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag App running with config { "models": { "supported": [ { "name": "Mistral 7B int4", "installed": true, "metadata": { "model_path": "model\\mistral\\mistral7b_int4_engine", "engine": "llama_float16_tp1_rank0.engine", "tokenizer_path": "model\\mistral\\mistral7b_hf", "max_new_tokens": 1024, "max_input_token": 7168, "temperature": 0.1 } }, { "name": "Llama 2 13B int4", "installed": true, "metadata": { "model_path": "model\\llama\\llama13_int4_engine", "engine": "llama_float16_tp1_rank0.engine", "tokenizer_path": "model\\llama\\llama13_hf", "max_new_tokens": 1024, "max_input_token": 3900, "temperature": 0.1 } } ], "selected": "Mistral 7B int4" }, "sample_questions": [ { "query": "How does NVIDIA ACE generate emotional responses?" }, { "query": "What is Portal prelude RTX?" }, { "query": "What is important about Half Life 2 RTX?" }, { "query": "When is the launch date for Ratchet & Clank: Rift Apart on PC?" } ], "dataset": { "sources": [ "directory", "nodataset" ], "selected": "directory", "path": "dataset", "isRelative": true }, "strings": { "directory": "Folder Path", "nodataset": "AI model default" } } [03/25/2024-12:33:38] You try to use a model that was created with version 2.5.1, however, your version is 2.2.2. This might cause unexpected behavior or errors. In that case, try to update to the latest version. ╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮ │ C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\RAG\trt-llm-rag-windows-main\app.py:109 in │ │ │ │ │ │ 106 ) │ │ 107 │ │ 108 # create embeddings model object │ │ ❱ 109 embed_model = HuggingFaceEmbeddings(model_name=embedded_model) │ │ 110 service_context = ServiceContext.from_defaults(llm=llm, embed_model=embed_model, │ │ 111 │ │ │ │ │ │ │ │ │ │ │ context_window=model_config["max_input_to │ │ 112 │ │ │ │ │ │ │ │ │ │ │ chunk_overlap=200) │ │ │ │ C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag\lib\site-packages\langchain\embeddi │ │ ngs\huggingface.py:66 in __init__ │ │ │ │ 63 │ │ │ │ "Please install it with `pip install sentence-transformers`." │ │ 64 │ │ │ ) from exc │ │ 65 │ │ │ │ ❱ 66 │ │ self.client = sentence_transformers.SentenceTransformer( │ │ 67 │ │ │ self.model_name, cache_folder=self.cache_folder, **self.model_kwargs │ │ 68 │ │ ) │ │ 69 │ │ │ │ C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag\lib\site-packages\sentence_transfor │ │ mers\SentenceTransformer.py:95 in __init__ │ │ │ │ 92 │ │ │ │ │ │ │ │ │ │ use_auth_token=use_auth_token) │ │ 93 │ │ │ │ │ 94 │ │ │ if os.path.exists(os.path.join(model_path, 'modules.json')): #Load as Sen │ │ ❱ 95 │ │ │ │ modules = self._load_sbert_model(model_path) │ │ 96 │ │ │ else: #Load with AutoModel │ │ 97 │ │ │ │ modules = self._load_auto_model(model_path) │ │ 98 │ │ │ │ C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag\lib\site-packages\sentence_transfor │ │ mers\SentenceTransformer.py:840 in _load_sbert_model │ │ │ │ 837 │ │ modules = OrderedDict() │ │ 838 │ │ for module_config in modules_config: │ │ 839 │ │ │ module_class = import_from_string(module_config['type']) │ │ ❱ 840 │ │ │ module = module_class.load(os.path.join(model_path, module_config['path'])) │ │ 841 │ │ │ modules[module_config['name']] = module │ │ 842 │ │ │ │ 843 │ │ return modules │ │ │ │ C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag\lib\site-packages\sentence_transfor │ │ mers\models\Pooling.py:120 in load │ │ │ │ 117 │ │ with open(os.path.join(input_path, 'config.json')) as fIn: │ │ 118 │ │ │ config = json.load(fIn) │ │ 119 │ │ │ │ ❱ 120 │ │ return Pooling(**config) │ │ 121 │ ╰──────────────────────────────────────────────────────────────────────────────────────────────────╯ TypeError: Pooling. __init__ () got an unexpected keyword argument 'pooling_mode_weightedmean_tokens' Press any key to continue . . . ``` ---
**Author:** ![c.dupuis.02](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/c.dupuis.02/32/325388_2.png) [@c.dupuis.02](https://forums.developer.nvidia.com/u/c.dupuis.02)\ **Post date:** [March 25, 2024, 12:05pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/2 "2024-03-25T12:05:59Z")
I was about to post for this issue! I will try installing an older driver and see if it works ---
**Author:** ![olletyrland](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@olletyrland](https://forums.developer.nvidia.com/u/olletyrland)\ **Post date:** [March 25, 2024, 12:07pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/3 "2024-03-25T12:07:00Z")
Getting the EXACT same error message. I successfully installed it once, for user A and running it worked out of the box! Bravo. Then I realized that it was a hassle trying to run it when logged in with user B (which I must be), so I uninstalled it. Re-installing it works but launching it now, I get the same error as you do. And same model version warning. EDIT: I installed version 2.5.1 of the package but trying to launch now gives me more wild errors that I realize there is no way to get past… _sigh_ ---
**Author:** ![c.dupuis.02](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/c.dupuis.02/32/325388_2.png) [@c.dupuis.02](https://forums.developer.nvidia.com/u/c.dupuis.02)\ **Post date:** [March 25, 2024, 12:17pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/4 "2024-03-25T12:17:18Z")
What are they talking about for “version 2.5.1”? ---
**Author:** ![olletyrland](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@olletyrland](https://forums.developer.nvidia.com/u/olletyrland)\ **Post date:** [March 25, 2024, 12:25pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/5 "2024-03-25T12:25:03Z")
You can see in the error message in the command window sentence-transformers. It’s a python package. However, as I mention, upgrading it to 2.5.1 just gives me more intricate problems. ---
**Author:** ![c.dupuis.02](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/c.dupuis.02/32/325388_2.png) [@c.dupuis.02](https://forums.developer.nvidia.com/u/c.dupuis.02)\ **Post date:** [March 25, 2024, 12:39pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/6 "2024-03-25T12:39:02Z")
I tried upgrading it too (2.5.1 even if the latest version is 2.6.0) and it just ignored it, saying I need to install it. ---
**Author:** ![olletyrland](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@olletyrland](https://forums.developer.nvidia.com/u/olletyrland)\ **Post date:** [March 25, 2024, 12:53pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/7 "2024-03-25T12:53:04Z")
This fixed it for me: [Rtx with Chat successfully installed but causes error when run - #4 by aakashr1996](https://forums.developer.nvidia.com/t/rtx-with-chat-successfully-installed-but-causes-error-when-run/287223/4) ---
**Author:** ![mehmettozbek](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@mehmettozbek](https://forums.developer.nvidia.com/u/mehmettozbek)\ **Post date:** [March 25, 2024, 1:02pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/8 "2024-03-25T13:02:03Z")
This fixed it for me as well, 1. Copy the content of **Pooling.py** 2. Paste it under **\NVIDIA\ChatWithRTX\env\_nvd\_rag\Lib\site-packages\sentence\_transformers\models\Pooling.py** Here is the result. It shows the same error for a while then reinstall with new values and program started. ```auto Environment path found: C:\Users\mehmet\AppData\Local\NVIDIA\ChatWithRTX\env_nvd_rag App running with config { "models": { "supported": [ { "name": "Mistral 7B int4", "installed": true, "metadata": { "model_path": "model\\mistral\\mistral7b_int4_engine", "engine": "llama_float16_tp1_rank0.engine", "tokenizer_path": "model\\mistral\\mistral7b_hf", "max_new_tokens": 1024, "max_input_token": 7168, "temperature": 0.1 } }, { "name": "Llama 2 13B int4", "installed": true, "metadata": { "model_path": "model\\llama\\llama13_int4_engine", "engine": "llama_float16_tp1_rank0.engine", "tokenizer_path": "model\\llama\\llama13_hf", "max_new_tokens": 1024, "max_input_token": 3900, "temperature": 0.1 } } ], "selected": "Mistral 7B int4" }, "sample_questions": [ { "query": "How does NVIDIA ACE generate emotional responses?" }, { "query": "What is Portal prelude RTX?" }, { "query": "What is important about Half Life 2 RTX?" }, { "query": "When is the launch date for Ratchet & Clank: Rift Apart on PC?" } ], "dataset": { "sources": [ "directory", "nodataset" ], "selected": "directory", "path": "dataset", "isRelative": true }, "strings": { "directory": "Folder Path", "nodataset": "AI model default" } } [03/25/2024-13:58:57] You try to use a model that was created with version 2.5.1, however, your version is 2.2.2. This might cause unexpected behavior or errors. In that case, try to update to the latest version. Generating new values Parsing nodes: 100%|██████████████████████████████████████████████████████████████████| 30/30 [00:00<00:00, 185.30it/s] Generating embeddings: 100%|█████████████████████████████████████████████████████████| 156/156 [00:04<00:00, 37.50it/s] The file at ./config/preferences.json does not exist. Open http://127.0.0.1:44939?cookie=a615b0bc-6921-4d8a-80e1-8ff8663f4f34&__theme=dark in browser to start Chat with RTX Running on local URL: http://127.0.0.1:44939 To create a public link, set `share=True` in `launch()`. ``` ---
**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\ **Post date:** [April 8, 2024, 1:02pm UTC](https://forums.developer.nvidia.com/t/chat-with-rtx-model-version-problem-while-starting/287268/9 "2024-04-08T13:02:32Z")
Closed on April 8, 2024, 1:02pm UTC This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.