engine_model_path = “./bert.trt”
Build a TensorRT engine.
engine = get_engine(engine_model_path)
Contexts are used to perform inference.
context = engine.create_execution_context()
if context is None:
print(“Failed to create execution context”)
engine_model_path = “./bert.trt”
engine = get_engine(engine_model_path)
context = engine.create_execution_context()
if context is None:
print(“Failed to create execution context”)
hi @lifeisaflower666666 ,
Can you please share more details about the case.
Thanks