Is there a way to generate the engine files of the model before starting the pipeline and entering the loop?
I’m looking to optimize my workflow and I believe pre-generating these files could save some time.
Any guidance or suggestions would be greatly appreciated.
Thank you in advance for your help!
Yes. You can refer to our build_triton_engine.sh script to learn how to use the command to generate the engine file. You need to configure it according to your own model’s property.