TAO pretrained model performance metrics changed, documentation tables need clarified

[rsc44]

I recently checked the performance metrics for the pre-trained models, specifically peoplenet.

I noticed that the stats have changed, and according to your charts the FPS is less than previously reported.

This is what was reported in September 2021, a reference can be found at this post.

This is the reported performance now, according to the (guide).

Is this an graphical error, or did the performance decrease ?

Update

I noticed a newer version of peoplenet(v2.6) was added, and it looks like the tables are currently reflecting the latest versions.

As it turns out version 2.1 is double the speed of version 2.6, the tables in the documentation should include the metrics from earlier versions as well.

[Fiona.Chen]

We will check the document and update.

[Fiona.Chen]

There is no update from you for a period, assuming this is not an issue anymore.
Hence we are closing this topic. If need further support, please open a new one.
Thanks

This performance is expected due to a heavier model. We will keep updating to newer models from time to time and adding performance for older ones may be dropped.