Hi all,
i check model llama-31-405b-instruct provide by NVIDIA NIMS : llama-3.1-405b-instruct Model by Meta | NVIDIA NIM
i try use with python SDK and shell script, it quite diffirence result,
Do you have any notes for me regarding preprocessing special characters in strings within the input data?
I think this is reason of inconsistent from python SDK and API
Thanks,
TraDinh
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Profiles doesnt match machine even though specs are correct | 0 | 26 | November 29, 2024 | |
| NIM HTTP API Inference (Run Anywhere) Taking Extremely Long! | 1 | 170 | September 11, 2024 | |
| The NIM endpoints for Llama 3.1 405B are unreliable sometimes | 3 | 150 | August 11, 2024 | |
| API connect | 1 | 92 | September 20, 2024 | |
| There is a problem with Llama405B instruct model | 4 | 90 | January 3, 2025 | |
| Api for audio2face-2d | 3 | 223 | October 25, 2024 | |
| Generate code with Abacus AI’s Dracarys Large Language Model | 1 | 25 | September 17, 2024 | |
| "404 Page Not Found" Error When api used as openai | 2 | 126 | January 25, 2025 | |
| NVIDIA NIM API / openai.API: Error code: 402,Cloud credits expired - Please contact NVIDIA representatives | 8 | 379 | January 19, 2025 | |
| Unable to Run NIM on H100 GPU Due to Profile Compatibility Issue Despite Sufficient GPU Resources | 1 | 150 | November 12, 2024 |