AI & Data Science Deep Learning (Training & Inference)

TensorRT DIGITS Maxine Engage with NVIDIA directly and discuss the latest Maxine technology with a global developer community Triton Inference Server - archived cuDNN Frameworks Riva NVIDIA Riva is a GPU-accelerated SDK for developing multimodal conversational AI applications that delivers real-time performance on GPUs.

Topic	Replies	Views	Activity
2.5GB of video memory missing in TensorFlow on both Linux and Windows [RTX 3080] TensorRT cuda , tensorflow , python , gpu	9	979	August 6, 2022
AttributeError: 'tensorrt.tensorrt.Builder' object has no attribute 'max_workspace_size' TensorRT tensorrt	0	26	August 6, 2022
Could not load library cudnn_cnn_infer64_8.dll. Error code 193 cuDNN	13	1274	August 5, 2022
The same model consumes different sizes of GPU memory in different GPU TensorRT	7	483	August 5, 2022
Tensortrt AttributeError: '_UserObject' object has no attribute 'add_slot' TensorRT	5	1879	August 5, 2022
Trtexec error converting onnx TensorRT onnx	5	100	August 5, 2022
Internal Error: GPU error during getBestTactic: PWN(LeakyRelu_4) : misaligned address TensorRT tensorrt	5	193	August 5, 2022
CuDNN RNN cuDNN	1	93	August 4, 2022
cudnnRNNForward() issue cuDNN cuda	5	267	August 4, 2022
Cudnn.h is missing in libcudnn8/unknown,now 8.4.1.50-1+cuda11.6 cuDNN	1	45	August 4, 2022
Missing cub/cub.h when installing TensorRT OSS TensorRT	4	41	August 4, 2022
Inference on png images TensorRT tensorrt	1	47	August 4, 2022
Riva-Deploy (Occasional) Error Riva	2	102	August 4, 2022
Internal Error (Assertion isMultiple(tensor.start[vectorDim], spv) failed. ) when loading ONNX file TensorRT	5	109	August 4, 2022
Recreate QuickStart Stock Citrinet Model with Modified Parameters Riva	14	754	August 4, 2022
The convoluion was slow in cudnn 8.4.0 and 8.4.1 cuDNN	0	31	August 4, 2022
Could not convert reshape layer in Mobilevit model TensorRT	7	341	August 4, 2022
ONNX Quantization with INT8 calibration TOP1 accuracy using TensorRT C++ API TensorRT tensorrt , jetson-inference , calibration , benchmarks , jetson	4	142	August 4, 2022
NVIDIA FLARE for decentralized FL Frameworks	0	27	August 4, 2022
Invalid resource handle when doing inference with TensorRT TensorRT	2	53	August 4, 2022
Inference with TensorRT model -- PyTorch BERT model > ONNX > TensorRT > Inference? Frameworks tensorrt	0	33	August 4, 2022
Finetune AM from pretained riva/tlt model Riva riva	0	33	August 4, 2022
First inference after a pause is always long TensorRT	5	444	August 4, 2022
Inference time becomes longer when doing non-continuous fp16 or int8 inference TensorRT tensorrt , jetson-inference	31	1193	August 4, 2022
Running SSD-Lite from Pytorch model zoo runs into errors on TensorRT TensorRT	1	40	August 4, 2022
Building a engine takes too long TensorRT	1	44	August 4, 2022
Why while ONNX-TensorRT conversion with INT8 quantizations some layers are not quantized? TensorRT tensorrt , pytorch , onnx	10	337	August 3, 2022
Tensorrt inference with batch > 1 TensorRT	3	106	August 3, 2022
Jetson Nano: Could not load dynamic library 'libnvinfer.so.7'; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory TensorRT	4	1291	August 3, 2022
How to export pretrained Nvidia's tao model .tlt to .riva? Riva tao	1	94	August 3, 2022