unable to run sample_int8

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

I am unable to run sample_int8

$ ./bin/sample_int8  mnist
ERROR: runtime.cpp (16) - Cuda Error in allocate: 2
ERROR: runtime.cpp (16) - Cuda Error in allocate: 2
sample_int8: sampleINT8.cpp:81: bool caffeToGIEModel(const string&, const string&, const std::vector<std::__cxx11::basic_string<char> >&, unsigned int, nvinfer1::DataType, nvinfer1::IInt8Calibrator*, nvinfer1::IHostMemory*&): Assertion `engine' failed.
Aborted (core dumped)

Environment:

CUDA version: 8
CUDNN version: 7

2

We created a new “Deep Learning Training and Inference” section in Devtalk to improve the experience for deep learning and accelerated computing, and HPC users:
https://devtalk.nvidia.com/default/board/301/deep-learning-training-and-inference-/

We are moving active deep learning threads to the new section.

URLs for topics will not change with the re-categorization. So your bookmarks and links will continue to work as earlier.

-Siddharth

3

Does ./infer_device work on your machine?

4

I have a similar problem with the same environment. Do you have any solutions?