The engine file trained and converted by TLT runs incorrectly in Deepstream on the jetson platform

Accelerated Computing Intelligent Video Analytics TAO Toolkit
#1

I use TLT to train Mask-Rcnn, the data set is coco2017, and the errors running in Deepstream are as follows:

image
image1498×622 66.6 KB

any idea?thanks.

#2

Where did you run inference, in Jetson devices?

#3

yep,xavier nx

#4

How did you generate the trt engine, in host PC?

#5

Oh, do I need to run tlt-converter in xavier to get engine files?

#6

Yes, please use tlt-converter jetson version to generate trt engine in your nx.

#7

hi,Morganh i run tlt-converter in xavier to get engine files,It works normally, but the FPS is only 3. What is the problem?

image
image1184×652 17.3 KB

#8

Refer to Training Instance Segmentation Models Using Mask R-CNN on the NVIDIA Transfer Learning Toolkit | NVIDIA Developer Blog
I’m afraid it is similar to your result. (Please run it with batch size 2).

Currently, the Maskrcnn does not support pruning yet. So, if you want to get a higher fps, you can train a smaller network.

MaskRCNN

  • Input size : C * W * H (where C = 3, W > =128, H >=128 and W, H are multiples of 32)
  • Image format : JPG
  • Label format : COCO detection
#9