Issue while Serving the model using Triton Server

AI & Data Science Deep Learning (Training & Inference) Triton Inference Server - archived

darshancganji12 November 18, 2020, 1:16pm 1

Hi Nvidia Team,

I am trying to Serve the Custom Model using Triton Server on my PC(having RTX 2060 GPU).
I am using nvcr.io/nvidia/tensorrtserver:19.10-py3 container for Serving.

While I am serving I am getting an error(found in the attached image below).

I used nvcr.io/nvidia/tensorrt:19.10-py2 Image to convert the Model from ONNX to Tensorrt.
May I know where I am doing wrong? And how to avoid this error?

Thanks in advance

Topic		Replies	Views
Triton inference server with tensorRT, Error code 1 : Cask (Cask convolution execution) TensorRT	1	690	September 11, 2023
Model tensor shape configuration hints for dynamic batching but the underlying engine doesn't support batching Triton Inference Server - archived	4	2390	October 12, 2021
P2PNet converted to onnx return bad output when used on triton server TensorRT inference-server-triton	2	460	September 12, 2023
What docker image should be used for TRITON: tensorrtserver or tritonserver? Triton Inference Server - archived	0	484	October 9, 2020
Error while running Tritron server DeepStream SDK	2	288	January 12, 2024
Deploying Pytorch converted to ONNX TensorRT	3	806	November 12, 2018
Got Cudnn Error in executeConv: 3 (CUDNN_STATUS_BAD_PARAM) TensorRT tensorrt , cuda , ubuntu	1	1397	February 21, 2022
Triton server for squad model on P100 with TensorRT 6.0 Triton Inference Server - archived	0	889	June 23, 2020
Facing failed to load 'yolo' version 1: Internal: onnx runtime error 1: Load model from /data/yolo/1/best.onnx failed:Fatal error: TRT:EfficientNMS_T TensorRT onnx , inference-server-triton	1	382	May 31, 2024
Triton server memory accumulation problem TensorRT cudnn	1	273	March 14, 2024

Issue while Serving the model using Triton Server

Related topics