how to use created .engine file for inference

hi,

I created mnist.engine file using this sample to have the understanding of how tensorrt works using this link

https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/topics/topics/workflows/caffe_to_tensorrt.html

I am not able to understand hoe to use this mnist.engine file for inference.

My ideal point of learning to use tensorrt is I want to create inference engine for object detection using Faster RCNN architecture and Caffe framework with Titan X GPU.how can I use Tensorrt for this?

I am not getting intuitive understanding.

is dataset needed for inference?
what is binaryproto file what’s the use of it?

i am completely into python so any explanation in python perspective. will be more helpful for me.

can anyone help me please.
Thank you in advance .

Here are a couple of resources you might find helpful

https://devblogs.nvidia.com/tensorrt-3-faster-tensorflow-inference/
(in particular the section labeled “TensorRT run time inference”)

https://devblogs.nvidia.com/production-deep-learning-nvidia-gpu-inference-engine/

https://devblogs.nvidia.com/deploying-deep-learning-nvidia-tensorrt/

https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/topics/topics/workflows/caffe_to_tensorrt.html

https://docs.nvidia.com/deeplearning/sdk/tensorrt-developer-guide/index.html#fasterrcnn_sample

https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/topics/topics/pkg_ref/infer.html#executioncontext

https://docs.nvidia.com/deeplearning/sdk/tensorrt-api/topics/topics/pkg_ref/infer.html#runtime

Hope this helps!

We also have a deep learning institute with online and face to face courseware to help you get an intuitive understanding of this.

For example the “Fundamentals of Deep Learning for Computer Vision” course includes object detection and deployment with TensorRT.

This Fundamentals course will give the developer a better understanding of how to implement and deploy deep learning capabilities in their applications:

https://courses.nvidia.com/courses/course-v1:DLI+C-FX-01+V2/about

Additional self-paced training available at www.nvidia.com/dli

Also, it is kind of Jetson specific but might still be interesting:

https://developer.nvidia.com/embedded/twodaystoademo