Detectron2 Jetson NX

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX
,
1

We are trying to run a Detectron2(MASK-RCNN) Model on an NX, but we are getting just 6FPS. Does anyone have a recommendation or experience on running this model on an NX.

Also, would Deepstream help with live video inference ?

Thanks

1 Like
3

Hi,

Here are some performance result for NX:

For live video, yes, it’s recommended to use Deepstream.

Thanks.

1 Like
4

Thanks, AastaLLL, now for a realtime 30 FPS live video fee, what would be better the new Jetson Xavier NX or the Jetson AGX Xavier, we would need to run Detectron 2 (Mask Rcnn) inferance.

5

@cpalomares, how did you convert Detectron2(Mask RCNN)? I am trying to convert a Detectron2 - Keypoint Detector and getting some issues. My post is here. Can you please give me any advice? Thanks.

6

@cogbot,
we do not have it converted and working yet, just running detector2 native on the board, no containers, but it is very slow… we are trying to get it converted.

I will share it if we are sussecfull.

1 Like
7

Hi,

We are going to check the Detectron2 model for Xavier and NX.
Will share more information with you both.

Thanks.

1 Like
8

@AastaLLL, that’s great. Thank you very much.

9

Thank you !!!

10

Hi any update on this?
Thanks

1 Like
11

Hi,

Sorry to keep you waiting.
We are still working on this. Will keep you updated.

Thanks.

1 Like
15

Hi any update on this?
Thanks

1 Like
16

Hi,

Sorry that we are still checking this.
Will share more information once we finished.

1 Like
17

Hi @AastaLLL is there any update? Thanks

18

Same

19

Any updates on this?

20

Hi,

Sorry that we are still working on this.
Will update here once the customization is done.

Thanks.

1 Like
21

Hi,
I’m trying to deploy a detectron2 trained FasterRCNN-Resnet-50-FPN model to Jetson AGX Xavier.
Are there any results on this? Could you please share some guidlines that I should follow?

Thanks.

22

Hi,

This may work but not guarantee.

  1. Convert your detectron2 model into ONNX format first.
    You can find some information below:
    detectron2.export — detectron2 0.6 documentation

  2. Try to modify TensorRT FasterRCNN (caffe-based) example.
    Although the file format is different, you should get the required plugin layer from the example:

https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/sampleFasterRCNN

Thanks.

1 Like
23

@AastaLLL after the export - will it be kind of tensorrt model executed by tensorrt launcher?

24

Hi,

The detectron2.export will output an ONNX type model file.
You will also need to convert it with nvonnxparser and the required plugin library.

Thanks.