Hi,
Is it possible to get any layer output tensor of TensortRT engine (converting from Yolov3 caffe model)?
I only find getNbBindings,getBindingIndex…in TensorRT ICudaEngine api.
It seems only focusing on model input/ouput?
Thanks,
Jerry
Hi,
Is it possible to get any layer output tensor of TensortRT engine (converting from Yolov3 caffe model)?
I only find getNbBindings,getBindingIndex…in TensorRT ICudaEngine api.
It seems only focusing on model input/ouput?
Thanks,
Jerry
TRT engine supports multiple outputs, the API mark_output
could be invoked multiple times if needed.
Thanks
layer1=>layer2=>…Layer100
I mean get the intermediate tensor output of layer like layer10 in the model expect input data and output (last layer).
Thanks,
Yes, in that case specify that layer of model in “mark_output” while generating TRT model.