Topics tagged llama

Topic	Replies	Views	Activity
vLLM 0.17.0 wheel for Jetson Orin with Marlin GPTQ (SM 8.7) Jetson AGX Orin llama	0	13	March 15, 2026
"RTX 5090 + 5070 Ti Multi-GPU Training: CUDA Driver Crash During Backward Pass (sm_120, PyTorch, gradient_checkpointing)" NVIDIA Nemotron jetson , llama , nemotron	0	14	March 15, 2026
RAG Blueprint on DGX Spark (ARM64 / GB10): NIMs & Milvus OK, but ingestor-server / rag-server fail with exec format error DGX Spark / GB10 nim , llama , blueprints , nemotron	5	401	March 15, 2026
Vulkan as alternative backend for llama.cpp DGX Spark / GB10 vulkan , llama , nemotron	1	47	March 15, 2026
Building Local + Hybrid LLMs on DGX Spark That Outperform Top Cloud Models DGX Spark / GB10 Projects jetson , nim , llama3-70b-instruct , llama , deepseek , nemotron	19	3031	March 15, 2026
To NVIDIA Staff: Is This a Hardware Issue Requiring Repeated Shutdowns and RMA Under High Load? DGX Spark / GB10 llama	23	529	March 14, 2026
LLM library recomendations for maximum token speeds Jetson AGX Orin cuda , llama	10	246	March 14, 2026
NVidia GreenBoost kernel modules opensourced Linux llama	1	672	March 14, 2026
Nemotron-3-Super 120B on GB10 — llama.cpp sm_121 build + Ollama GGUF incompatibility fix DGX Spark / GB10 llama , nemotron	0	105	March 14, 2026
Missing vision reasoning with Qwen3.5-122B Q4 on vLLM (works on llama.cpp) DGX Spark / GB10 llama	4	300	March 13, 2026
How do I run Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled on vllm community docker? DGX Spark / GB10 llama	4	291	March 13, 2026
"unable to allocate CUDA0 buffer" after Updating Ubuntu Packages Jetson Orin Nano cuda , jetson , generative_ai , llama	244	13922	March 13, 2026
DGX crashing after ~8 hours: Stability issues switching from GLM 4.6v (FP8) to Qwen 122B (Q6) in llama.cpp DGX Spark / GB10 llama	1	114	March 13, 2026
HOW-TO: Run Qwen3-Coder-Next on Spark DGX Spark / GB10 llama	89	6559	March 12, 2026
New tool: llama-benchy - llama-bench style benchmarking for ANY LLM backend (vLLM, SGLang, llama.cpp, etc.) DGX Spark / GB10 Projects llama	9	776	March 12, 2026
Single node and Dual node llama.cpp build flag DGX Spark / GB10 llama	5	62	March 11, 2026
(sparkrun) Qwen3.5 GGUF Benchmarks over llama.cpp RPC DGX Spark / GB10 Projects llama	3	443	March 11, 2026
HOW-TO: setup-dgx-spark docker inference - A "Sane" Inference Stack for GB10 (Need Contributors!) DGX Spark / GB10 Projects docker , llama , dgx	30	1058	March 11, 2026
Distributed Spark DGX Spark / GB10 llama	2	78	March 10, 2026
NVIDIA ACE: Model Archive General Topics and Other SDKs gaming , llama , agentic-ai , nemotron	1	55	March 10, 2026
Open-Source CLI Agent Framework for NVIDIA AI Endpoints - Seeking Feedback TensorRT cudnn , ai , open-source-software , api , jetson , nim , llama , agentic-ai , deepseek , nemotron	2	38	March 10, 2026
Cuda headers in crt/math_functions.h still broken in debian-13 repo CUDA NVCC Compiler linux , llama	1	31	March 9, 2026
CUDA headers in crt/math_functions.h still broken in debian-13 repo Linux llama	1	19	March 9, 2026
VSS Jetson Thor: GPU memory increase during summarization causes OOM unless VSS is restarted Visual AI Agent llama , cosmos	2	37	March 9, 2026
MSI EdgeXpert Suddenly Power-Off During llama-benchy – Possible PD Firmware Issue? DGX Spark / GB10 llama	25	294	March 9, 2026
Missing official native ARM64 NIM images for essential AI models DGX Spark / GB10 nim , llama	5	429	March 9, 2026
Home Assistant on DGX? DGX Spark / GB10 llama	5	236	March 9, 2026
Max observed wattage DGX Spark / GB10 llama	4	136	March 8, 2026
DGX Spark crashes when running tensorrt-llm DGX Spark / GB10 llama	3	167	March 7, 2026
TRT LLM for Inference with NVFP4 safetensors slower than LM studio GGUF on the Spark DGX Spark / GB10 tensorrt , llm , llama	9	1035	March 6, 2026