Hi all,
i check model llama-31-405b-instruct provide by NVIDIA NIMS : llama-3.1-405b-instruct Model by Meta | NVIDIA NIM
i try use with python SDK and shell script, it quite diffirence result,
Do you have any notes for me regarding preprocessing special characters in strings within the input data?
I think this is reason of inconsistent from python SDK and API
Thanks,
TraDinh
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| OpenAI Compatible API does not work | 6 | 663 | August 26, 2024 | |
| Nvidia / llama-3.1-nemotron-70b-instruct openai api is not working | 1 | 355 | November 10, 2024 | |
| NVIDIA NIM API invoked by Langchain returns statuscode 500 | 1 | 291 | September 4, 2024 | |
| NIM HTTP API Inference (Run Anywhere) Taking Extremely Long! | 1 | 388 | September 11, 2024 | |
| Open AI Endpoint | 0 | 275 | April 28, 2024 | |
| Not connect to endpoint https://integrate.api.nvidia.com/v1 | 1 | 724 | February 17, 2025 | |
| Open AI API Compatible | 1 | 229 | November 14, 2025 | |
| Not getting response for this model since yesterday meta/llama-3.1-405b-instruct model | 0 | 113 | December 13, 2024 | |
| NVIDIA NIM API / openai.API: Error code: 402,Cloud credits expired - Please contact NVIDIA representatives | 8 | 599 | January 19, 2025 | |
| Question Regarding Draft Model Support AnythingLLM via NVIDIA NIM | 3 | 83 | January 2, 2026 |