Topics tagged llama-31-8b-instruct

Topic	Replies	Views	Activity
Request to enable "Public API Endpoints" permission for my personal organization NVIDIA Nemotron nim , llama-31-8b-instruct , llama	0	21	April 30, 2026
Issue running NIM Llama 3.1 8B in air‑gapped environment: corrupted output on chat/completions Models nim , llama-31-8b-instruct , llama	4	67	April 20, 2026
How can i integrate NVIDIA LLM's to my system? NVIDIA Nemotron llm , llama-31-8b-instruct , llama , nemotron	0	75	February 19, 2026
Playbook vLLM inference models naming/links issue DGX Spark / GB10 Projects jetson , llama-31-8b-instruct , llama , jira-issue , documentation-update , nemotron	1	204	February 10, 2026
DFlash: Block Diffusion for Flash Speculative Decoding(Blackwell 6000 Pro) JAX llm , llama-31-8b-instruct , llama	5	303	February 8, 2026
Building RAG Agents with LLMs ----Function not found using meta/llama-3.1-8b-instruct Certification Exams llama-31-8b-instruct , llama	2	72	January 13, 2026
Question Regarding Draft Model Support AnythingLLM via NVIDIA NIM DGX Spark / GB10 nim , llama-31-8b-instruct , llama	5	245	January 2, 2026
Example ran out of memory on dgxspark DGX Spark / GB10 llama-31-8b-instruct , llama-31-70b-instruct , llama	4	286	December 25, 2025
Certificate verify failed while installing NIM models Models cuda , nim , llm , llama-31-8b-instruct , llama	1	192	December 15, 2025
Cannot enable --enable-auto-tool-choice and --tool-call-parser Models nim , llama-31-8b-instruct , llama	2	1690	December 15, 2025
Announcing new VLLM container & 3.5X increase in Gen AI Performance in just 5 weeks of Jetson AGX Thor Launch Jetson Thor jetson , llama-31-8b-instruct , llama , deepseek , nemotron	46	3848	December 14, 2025
Second NIM container won't start due to less than desired GPU memory utilization DGX Spark / GB10 docker , nim , llama-31-8b-instruct , llama	10	464	December 3, 2025
NVIDIA NIM: LLAMA-4 (Maverick) Image for performance Benchmarking on Nvidia H200 GPUs Models cuda , nim , llama-31-8b-instruct , llama	2	251	November 17, 2025
Title: 401 Unauthorized when calling NVIDIA Integrate API (/v1/chat/completions) from container (API key works for /v1/models but fails for chat) NVIDIA Blueprints cuda , kernel , ubuntu , llama-31-8b-instruct , llama-31-70b-instruct , llama	0	311	November 6, 2025
Vllm client connection refused Jetson Thor ai , llama-31-8b-instruct , llama	10	317	October 31, 2025
Trying to Run DAPT-Continual PreTraining on Chip_design Data NVIDIA NeMo cuda , nemo , llama-31-8b-instruct , llama	2	128	August 5, 2025
Speculative decoding using vLLM on the Nvidia Jetson AGX Orin 64GB dev kit Jetson Projects generative_ai , llama-31-8b-instruct , llama	0	293	March 9, 2025
VSS local deployment single gpu: Failed to load VIA stream handler - Guardrails / CA-RAG setup failed Visual AI Agent nim , llama-31-8b-instruct , llama	4	234	July 4, 2025
Example-hybrid-rag NVIDIA AI Workbench nim , llama-31-8b-instruct , llama	7	252	June 2, 2025
Model _ request Model Does not exist error NIM on RTX AI PCs and Workstations nim , llama-31-8b-instruct , llama	0	88	May 31, 2025
SOTA inference speed using SGlang and EAGLE-3 speculative decoding on the NVIDIA Jetson AGX Orin Jetson Projects llama-31-8b-instruct , llama	2	1122	March 23, 2025
Batch processing using NVIDIA NIM \| Docker \| Self-hosted Models python , nim , llama3-8b-instruct , llama-31-8b-instruct , llama	11	868	January 29, 2025
Running LMdeploy inference engine on the NVIDIA Jetson AGX Orin Devkit Jetson Projects jetson , llama-31-8b-instruct , llama	2	264	January 14, 2025
Failed to MLC-compile mlc-ai/Llama-3.1-8B-Instruct-fp8-MLC on Jetson AGX orin Jetson AGX Orin generative_ai , llama-31-8b-instruct , llama	5	385	January 13, 2025
Jetson Orin Nano Super Dev Kit Performance Jetson Orin Nano cudnn , gemma-2-9b-it , llama-31-8b-instruct , llama	6	1318	January 28, 2025
How to fix 0 compatible profiles? Where to get compatible profiles? Models nim , llama-31-8b-instruct , llama	4	746	November 26, 2024
Boosting LLM Inference Speed Using Speculative Decoding in MLC-LLM on Nvidia Jetson AGX Orin Jetson Projects generative_ai , llama-31-8b-instruct , llama	0	294	November 23, 2024
NIM TensorRT-LLM on H100 NVL Models nim , llama-31-8b-instruct , llama	2	329	November 22, 2024
Unable to Run NIM on H100 GPU Due to Profile Compatibility Issue Despite Sufficient GPU Resources Models nim , llama-31-8b-instruct , llama	1	341	November 12, 2024
NIM does not support llama-3.1-8b-instruct and llama-3.1-70b-instruct on GH200 On-Prem deployment Models nim , llama-31-8b-instruct , llama	1	373	November 7, 2024