How to use GPU+2 * DLA inference model

AI & Data Science Deep Learning (Training & Inference) TensorRT

240871567 February 4, 2024, 5:19am 1

I currently only know how to use the following command for inference: trtexec --onnx=model_gn.onnx --shapes=input:32x3x32x32 --int8 --useDLACore=0 --allowGPUFallback --useSpinWait
, but it seems to only use one DLA. How can I use GPU+2 * DLA inference simultaneously?

Topic		Replies	Views
DLA utilization in Xavier AGX Jetson TX2 dla	2	948	March 9, 2022
We want to use GPU+DLA. How do I use DLA when converting onnx to trt model? Is there a python sample Jetson Xavier NX jetson-inference	4	1087	September 19, 2021
Multi-model inference paralle on jetson agx orin TensorRT	2	75	March 24, 2025
How does the TRT inference run on both DLA and GPUs? Jetson Orin NX tensorrt , dla	2	853	August 30, 2023
How to use 2 DLA for the same model DRIVE AGX Orin General driveos-dl	2	584	August 11, 2023
How to run two inferences on different DLAs？ TensorRT	2	609	October 27, 2020
How to use both DLA and GPU cores concurrently? Jetson AGX Orin dla	8	101	April 25, 2025
TensorRT inference problem Jetson AGX Xavier	8	959	October 18, 2021
How to use DLA + INT8 + I/O reformatting? TensorRT tensorrt , dla	1	633	June 13, 2023
Help for converting .onnx to TensorRT Jetson AGX Orin tensorrt , onnx	4	1362	April 10, 2024

How to use GPU+2 * DLA inference model

Related topics