According to your comments,
- tlt-infer: good
- deepstream: get biased result
- Triton server: get biased result
Right? For deepstream, please refer to Issue with image classification tutorial and testing with deepstream-app - #12 by Morganh, there are two ways for classification model inference. You can have a try.