Deploy nvidia pre-trained yolov4 model to Tao Trition

[music1913]

Please provide the following information when requesting support.

• Hardware (T4/V100/Xavier/Nano/etc)
Ubuntu20, x86, RTX3090
• Network Type
Yolo_v4
• TLT Version (Please run “tlt info --verbose” and share “docker_tag” here)
• Training spec file(If have, please share here)
• How to reproduce the issue ? (This is for errors. Please share the command line and the detailed log here.)

There’s a Nvidia pretrained model lpdNet for detect car plate, I’m wondering how to directly download and use the Version 2.0 models based on YoloV4-Tiny with FP16 accuracy of this model to start the triton server infer?
This is what I understand:

1. Convert the .etlt to .plan
   by modifying download_and_convert.sh of adding yolov4_tiny_ccpd_deployable.etlt convert.
   Could you provide a sample?
2. Adding PostProcess
   All object detection model need add custom postprogrss, is that correct?
   Could you provide a sample?

[Morganh]

The LPDNet version 2.0 model is based on YOLOv4_tiny network. It is also very similar to YOLOv4 network. So, your work is to implement YOLOv4 network in triton by yourself. To get started, suggest you to run YOLOv3 to get familiar with YOLOv3 network which is already available in the triton apps.
For example,

• https://github.com/NVIDIA-AI-IOT/tao-toolkit-triton-apps/blob/main/scripts/start_server.sh#L72-L75,
• https://github.com/NVIDIA-AI-IOT/tao-toolkit-triton-apps/blob/main/scripts/download_and_convert.sh#L49-L56,
• https://github.com/NVIDIA-AI-IOT/tao-toolkit-triton-apps/blob/main/model_repository/yolov3_tao/config.pbtxt,
• https://github.com/NVIDIA-AI-IOT/tao-toolkit-triton-apps/blob/main/tao_triton/python/postprocessing/yolov3_postprocessor.py.

The YOLOv4 postprocessing can be found in https://github.com/NVIDIA/tao_tensorflow1_backend/blob/c7a3926ddddf3911842e057620bceb45bb5303cc/nvidia_tao_tf1/cv/yolo_v4/scripts/inference.py.

[music1913]

thanks Morgan.
If I prefer the Detectnet_v2 based model (version 1.0) of the LPDNet, what do I need to change? Could you provide some hint.

[Morganh]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

If using version 1.0, since it is based on detectnet_v2 network, so there is not much change needed. You can refer to DashCamNet or Peoplenet in GitHub - NVIDIA-AI-IOT/tao-toolkit-triton-apps: Sample app code for deploying TAO Toolkit trained models to Triton as the examples. They are both based on detectnet_v2 network.