Build_cuda_engine() throws error

trivedi.nagaraj · July 18, 2024, 2:40am

Hi all, I tried using build_cuda_engine(network) but it throws the error as below

engine = builder . build_cuda_engine ( network )
AttributeError: ‘tensorrt.tensorrt.Builder’ object has no attribute ‘build_cuda_engine’. Did you mean: ‘build_engine’?

Few details about existing software/libraries

Cuda version - cuda-12.2
Jetpack version is 6

Please let me know what could be the reason.

Thanks and Regards

Nagaraj. Trivedi

AastaLLL · July 18, 2024, 6:01am

Hi,

The API has changed.
Please follow the below sample to run an ONNX model with TensorRT 8.6:

github.com

NVIDIA/TensorRT/blob/release/8.6/samples/python/onnx_custom_plugin/sample.py#L52


      
          
          # Path to which trained model will be saved (check README.md)
          ENGINE_FILE_PATH = os.path.join(WORKING_DIR, 'bidaf.trt')
          
          # Define global logger object (it should be a singleton,
          # available for TensorRT from anywhere in code).
          # You can set the logger severity higher to suppress messages
          # (or lower to display more messages)
          TRT_LOGGER = trt.Logger(trt.Logger.WARNING)
          
          # Builds TensorRT Engine
          def build_engine(model_path):
          
              builder = trt.Builder(TRT_LOGGER)
              network = builder.create_network(common.EXPLICIT_BATCH)
              config = builder.create_builder_config()
              parser = trt.OnnxParser(network, TRT_LOGGER)
              runtime = trt.Runtime(TRT_LOGGER)
          
              # Parse model file
              print("Loading ONNX file from path {}...".format(model_path))

Thanks.

trivedi.nagaraj · July 18, 2024, 9:24am

Hi, thank you for providing this info. I will try this and let you know.

Thanks and Regards

Nagaraj Trivedi

system · August 14, 2024, 4:56am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Error while parseing pre-trained Onnx model with Tensorrt on jetson nano TensorRT	2	975	October 30, 2019
Builder.build_cuda_engine fails to build engine but prints no errors TensorRT	3	987	September 30, 2021
TypeError: build_cuda_engine(): incompatible function arguments TensorRT	7	5660	October 12, 2021
buildCudaEngine failed on windows 10 with TensorRT-5.0.4.3 TensorRT	7	1969	October 12, 2021
AttributeError: 'TensorRTBackendRep' object has not attribute 'create_execution_context' TensorRT jetson-inference , cudnn	1	300	March 14, 2024
Failed to create engine from onnx file using 'buildEngine.py' Jetson Xavier NX onnx	6	607	February 28, 2023
Getting error while using tensorRT engine Jetson Nano tensorrt	5	1694	October 15, 2021
Build engine from onnx failed TensorRT	2	976	December 14, 2021
Conversion from onnx to TensorRT engine TensorRT tensorrt , cuda	1	479	July 24, 2023
TensorRT issues TensorRT	4	608	October 20, 2020

Build_cuda_engine() throws error

Related topics