Firstly, please run tlt-infer to check your peoplenet.engine.
Below is working on my side.
Inference command:
tlt-infer detectnet_v2 -e infer_spec.txt -k tlt_encode -o infer_result -i input_11ft45deg_000070.jpg
Spec:
inferencer_config{
#defining target class names for the experiment.
#Note: This must be mentioned in order of the networks classes.
target_classes: “Person”
target_classes: “Bag”
target_classes: “Face”
#Inference dimensions.
image_width: 960
image_height: 544
#Must match what the model was trained for.
image_channels: 3
batch_size: 1
gpu_index: 0
#model handler config
tensorrt_config{
trt_engine: “./peoplenet.engine”
}
}
bbox_handler_config{
kitti_dump: true
disable_overlay: false
overlay_linewidth: 2
classwise_bbox_handler_config{
key:“Person”
value: {
confidence_model: “aggregate_cov”
output_map: “Person”
confidence_threshold: 0.9
bbox_color{
R: 0
G: 255
B: 0
}
clustering_config{
coverage_threshold: 0.005
dbscan_eps: 0.3
dbscan_min_samples: 0.05
minimum_bounding_box_height: 4
}
}
}
classwise_bbox_handler_config{
key:“Face”
value: {
confidence_model: “aggregate_cov”
output_map: “Face”
confidence_threshold: 0.9
bbox_color{
R: 255
G: 0
B: 0
}
clustering_config{
coverage_threshold: 0.005
dbscan_eps: 0.3
dbscan_min_samples: 0.05
minimum_bounding_box_height: 4
}
}
}
classwise_bbox_handler_config{
key:“Bag”
value: {
confidence_model: “aggregate_cov”
output_map: “Bag”
confidence_threshold: 0.9
bbox_color{
R: 0
G: 0
B: 255
}
clustering_config{
coverage_threshold: 0.005
dbscan_eps: 0.3
dbscan_min_samples: 0.05
minimum_bounding_box_height: 4
}
}
}
}
Log:
Using TensorFlow backend.
2020-11-24 07:56:01.212334: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.0
2020-11-24 07:56:03,880 [INFO] iva.detectnet_v2.scripts.inference: Overlain images will be saved in the output path.
2020-11-24 07:56:03,880 [DEBUG] iva.detectnet_v2.inferencer.build_inferencer: Initializing Tensorrt inferencer.
2020-11-24 07:56:03,880 [INFO] iva.detectnet_v2.inferencer.build_inferencer: Constructing inferencer
2020-11-24 07:56:04,364 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Reading from engine file at: ./peoplenet.engine
[TensorRT] WARNING: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
2020-11-24 07:56:05,068 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Generated TRT execution context.
2020-11-24 07:56:05,068 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Binding name: input_1, size: 1566720
2020-11-24 07:56:05,070 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Binding name: output_bbox/BiasAdd, size: 24480
2020-11-24 07:56:05,070 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Binding name: output_cov/Sigmoid, size: 6120
2020-11-24 07:56:05,071 [INFO] iva.detectnet_v2.scripts.inference: Initialized model
2020-11-24 07:56:05,071 [INFO] iva.detectnet_v2.scripts.inference: Commencing inference
0%| | 0/1 [00:00<?, ?it/s]2020-11-24 07:56:05,076 [DEBUG] iva.detectnet_v2.scripts.inference: Time lapsed to prepare batch: 0.005053043365478516
2020-11-24 07:56:05,077 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Inferring images
2020-11-24 07:56:05,132 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Number of input blobs 1
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Number of outputs: 2
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Output shape: (24480,), (12, 34, 60)
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Output shape: (6120,), (3, 34, 60)
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Coverage blob shape: (1, 12, 34, 60)
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.inferencer.trt_inferencer: Inferred_outputs: 2
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.scripts.inference: Time lapsed to infer batch: 0.06382989883422852
2020-11-24 07:56:05,140 [DEBUG] iva.detectnet_v2.scripts.inference: Preprocessing complete
2020-11-24 07:56:05,141 [DEBUG] iva.detectnet_v2.postprocessor.bbox_handler: Clustering bboxes Person
2020-11-24 07:56:05,141 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes
2020-11-24 07:56:05,141 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes using dbscan.
2020-11-24 07:56:05,147 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Number of boxes: 15
2020-11-24 07:56:05,148 [DEBUG] iva.detectnet_v2.postprocessor.bbox_handler: Clustering bboxes Bag
2020-11-24 07:56:05,148 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes
2020-11-24 07:56:05,148 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes using dbscan.
2020-11-24 07:56:05,150 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Number of boxes: 16
2020-11-24 07:56:05,151 [DEBUG] iva.detectnet_v2.postprocessor.bbox_handler: Clustering bboxes Face
2020-11-24 07:56:05,151 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes
2020-11-24 07:56:05,151 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Clustering bboxes using dbscan.
2020-11-24 07:56:05,152 [DEBUG] iva.detectnet_v2.postprocessor.utilities: Number of boxes: 5
2020-11-24 07:56:05,153 [DEBUG] iva.detectnet_v2.scripts.inference: Classwise_detections
2020-11-24 07:56:05,153 [DEBUG] iva.detectnet_v2.scripts.inference: Postprocessing detections: overlaying, metadata and crops.
2020-11-24 07:56:05,661 [DEBUG] iva.detectnet_v2.scripts.inference: Time lapsed: 0.5080950260162354
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 1.69it/s]
2020-11-24 07:56:05,661 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Clearing input buffers.
2020-11-24 07:56:05,662 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Clearing output buffers.
2020-11-24 07:56:05,662 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Clearing tensorrt runtime.
2020-11-24 07:56:05,662 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Clearing tensorrt context.
2020-11-24 07:56:05,662 [INFO] iva.detectnet_v2.inferencer.trt_inferencer: Clearing tensorrt engine.
2020-11-24 07:56:05,662 [INFO] iva.detectnet_v2.scripts.inference: Inference complete