Topics tagged tensorrt

Topic	Replies	Views	Activity
Yolov8 on Orin NX with Jetpack 5.1.2 DeepStream SDK tensorrt , yolo , deepstream	2	38	December 5, 2024
Deepstream-gaze-app: Results are not good DeepStream SDK tensorrt , opencv , cuda , gstreamer , deepstream	9	21	December 5, 2024
SGIE Classifier output inconsistent in deepstream app DeepStream SDK tensorrt , deepstream	12	52	December 5, 2024
RetinaNet trained with taotoolkit cannot be run on the triton server when converting with TensorRT 10.04 TAO Toolkit tensorrt , inference-server-triton , jetson	12	24	December 5, 2024
Timing Issue with TensorRT Model on Jetson Orin Nano Using TensorFlow Framework Jetson Orin Nano tensorrt , cuda , tensorflow , python	0	15	December 4, 2024
[Xavier] Can't find the TensorRT for Cuda11.8 Jetson AGX Xavier tensorrt , cuda	4	19	December 4, 2024
Jetson AGX tensorrt inference latency very high after upgrade the kernel from 32.7.2 to 32.7.4 Jetson AGX Orin tensorrt , kernel	10	28	December 4, 2024
Is there a plan to support DLA on the next TensorRT version? Jetson AGX Orin tensorrt , nvbugs , dla , tensorrt-model-optimizer	4	62	December 4, 2024
TensorRT 8 to 10 migration (orin nx) c++ is a nightmare :-( Jetson Orin NX tensorrt	1	31	December 4, 2024
JetPack 6.1, downgrade TRT from 10 to 8 (jetson orin nx) Jetson Orin NX tensorrt	3	27	December 4, 2024
Help Needed. Unable to run VideoMAE model on Xavier NX Jetson Xavier NX tensorrt , cuda , cudnn	7	39	December 3, 2024
Inswapper onnx model conversion to tensorrt model Jetson AGX Orin tensorrt , onnx	21	187	December 3, 2024
Retain the trt model on GPU after processing the entire video DeepStream SDK tensorrt , gstreamer , deepstream	3	14	December 3, 2024
Holistically-Nested Edge Detection using TensoRT Jetson AGX Xavier tensorrt , deepstream , tensorrt-model-optimizer	0	11	December 2, 2024
Clarification on TensorRT Binding Order and Guarantee of Input-Output Sequence (bindingIsInput() etc) TensorRT tensorrt	1	21	December 2, 2024
Emotionet output video file not saving in directory DeepStream SDK tensorrt , opencv , cuda , gstreamer , deepstream	2	15	December 2, 2024
How can I optimize multi-batch and parallel inference in TensorRT for faster performance on high-resolution image patches? TensorRT tensorrt , cuda , ubuntu , python , cudnn , deep-learning	2	44	December 2, 2024
Significant latency regression when compiling deformable attention layers in TensorRT 10.5 TensorRT tensorrt , cudnn	1	73	November 30, 2024
Trtexc specifies the precision for the specified layer TensorRT tensorrt , cudnn	1	12	November 30, 2024
Segmentation fault when running inference of Bert example on jetson orin nano TensorRT tensorrt , cudnn , jetson	1	14	November 30, 2024
TensorRT-10.5.0.18 nvinfer_10.dll possibly corrupted or not fully Windows made? TensorRT tensorrt	1	65	November 30, 2024
Inference Time When Using Multi Stream Multi Context in TensorRT is Slower than a Single One TensorRT tensorrt , cuda , cudnn	1	21	November 30, 2024
None Type Object TensorRT tensorrt , cuda , python , cudnn	1	19	November 30, 2024
Dinov2 TensorRT model performance issue TensorRT tensorrt , pytorch , onnx , jetson , jetson-nano	1	47	November 30, 2024
SIGFPE Error Occurs When Converting TensorRT Model with Custom Plugins TensorRT tensorrt , cudnn	1	23	November 30, 2024
Model inference fails after Holoscan 2.6 update: Not compatible with useCudaGraph TensorRT tensorrt , cuda , jetson-inference , cudnn , jetson-orin	1	22	November 30, 2024
Error converting ONNX model to TensorRT TensorRT tensorrt	1	25	November 30, 2024
Jetson orin nx ModuleNotFoundError: No module named 'tensorrt' Jetson Orin NX tensorrt	1	12	November 29, 2024
Using TensorRT for model inference, does a stable QPS (Queries Per Second) have a significant impact on the prediction response time (RT)? TensorRT tensorrt , cudnn	1	18	November 29, 2024
How to Use a Retrained Model with pbrun deepvariant Parabricks tensorrt , ai , training , deepvariant	0	10	November 29, 2024