AI & Data Science Deep Learning (Training & Inference)

TensorRT Riva NVIDIA Riva is a GPU-accelerated SDK for developing multimodal conversational AI applications that delivers real-time performance on GPUs. Triton Inference Server - archived Maxine Engage with NVIDIA directly and discuss the latest Maxine technology with a global developer community DIGITS (Locked) cuDNN Frameworks JAX This area is to discuss how to best use JAX on NVIDIA GPUs - and discuss problems and issues. Feel free to share your experiences or ask questions and NVIDIA engineers are here to support you.

Topic	Replies	Views	Activity
E: Version '8.3.1.22-1+cuda10.2' for 'libcudnn8' was not found cuDNN kb	30	25251	December 2, 2023
TensorRT Installation problem TensorRT tensorrt , cudnn	3	123	December 2, 2023
TensorRT vs TVM TensorRT	3	3054	December 1, 2023
DLA enabled engine not getting created in NVIDIA Orin NX using C++ API TensorRT jetson-inference , cudnn , dla	1	28	December 1, 2023
Post processing logic for TensorRT Peoplenet in Python TensorRT tensorrt , cuda	8	75	December 1, 2023
How to suppress TensorRT-related warning messages？ TensorRT	4	183	December 1, 2023
Better GPU for training & Inference & Execution LLModels TensorRT cudnn	1	49	November 30, 2023
I am unable to perform inference with the TensorRTExecutionProvider specified in onnxruntime TensorRT tensorrt , cudnn	1	49	November 30, 2023
How Tensorrt's horizontal layer fusion output data works? TensorRT tensorrt	1	53	November 30, 2023
How to change NV power on ORIN? Because the inference time is higher which is not expected TensorRT tensorrt	2	54	November 30, 2023
Error in Deepstream-occupancy-analytics compilation TensorRT gstreamer , cudnn	2	59	November 30, 2023
Nvtracker obj_id <65536 TensorRT	2	68	November 30, 2023
C++ - Stuck with YoloV4, ONNX and TensorRT TensorRT	3	85	November 30, 2023
Pip Installation Error with pytorch-quantization TensorRT	6	487	November 30, 2023
Orin nx run Riva use es8316 Riva riva	2	57	November 30, 2023
Best practice for nvdia riva streaming with socketio Riva	0	37	November 30, 2023
Serialization (Serialization assertion creator failed.Cannot deserialize plugin since corresponding IPluginCreator not found in Plugin Registry) TensorRT tensorrt , cudnn	4	138	November 30, 2023
Cudnn cuDNN	10	53	November 30, 2023
Riva_quickstart_v2.13.1: the TTS does not work well with Mandarin TensorRT riva	3	139	November 29, 2023
What is the official suggestion to use weight only quantization / smooth quant in TensorRT? TensorRT	5	223	November 28, 2023
RIVA ASR StreamingRecognition low confidence for word transcripts Riva	1	142	November 29, 2023
NCCL operation hangs Riva	1	86	November 29, 2023
TensorRT quantization Optimization TensorRT cudnn	1	180	November 29, 2023
RIVA ASR performance for AGX Orin Riva	1	82	November 29, 2023
Unable to convert ONNX to TRT after upgrading TensorRT from 8.5.2 to tensorRT 8.6.1 in NVIDIA ORIN TensorRT cudnn	1	184	November 29, 2023
File not found! cuDNN cuda , cudnn	2	113	November 29, 2023
Nvidia dali Frameworks	0	53	November 28, 2023
Trtexec fails with null pointer exception when useDLACore enabled TensorRT dla	16	687	November 28, 2023
Can Stable Diffusion run on lower tensorrt version(like 7.2.3) and lower driver? TensorRT	2	146	November 28, 2023
Failed mnistCUDNN test, Prediction mismatch cuDNN cuda , cudnn	1	62	November 28, 2023