How can we use each cuda gpu separately for our own object detection like threading?

Hi, Have you converted your model into TensorRT successfully? If yes, based on our benchmark table, XavierNX can reach 900up fps with SSD Mobilenet-V1. Jetson Benchmarks Jetson is used to deploy a wide range of popular DNN models and ML frameworks to the edge with high performance in…

CUDA threading in Jetson Xavier separately

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX

AastaLLL December 20, 2021, 8:28am 3

Hi,

Please find an example below:

Thanks.

Topic		Replies	Views
multithread for CPU/GPU parrallel Jetson AGX Xavier	3	562	October 18, 2021
Is it possible to run multiple TensorRT model inference on a GPU simultaneously and parallelly? TensorRT tensorrt , cuda	3	2040	August 23, 2022
Can NVDLA and GPU work in parallel? TensorRT	3	2121	October 12, 2021
Running two neural networks simultaneously Jetson Xavier NX tensorrt , python , dla	4	1966	August 29, 2021
Running Multiple TensorRT Engines On Jetson AGX Jetson AGX Xavier tensorrt , yolo	2	2481	August 29, 2021
Multithread inference Jetson Xavier NX tensorrt	4	844	August 29, 2021
Invoking Tensorrt Model on Jetson Xavier with threads performs slower than invoking in serial manner Jetson Xavier NX tensorrt , cuda	2	511	October 18, 2021
Concurrently run two or more engine on a tensorrt TensorRT	4	2303	April 14, 2020
In jetson agx orin, tensorRT performance Jetson AGX Orin tensorrt , cudnn	11	377	April 10, 2024
How to inference with tensorrt on multi gpus in python TensorRT	2	2185	April 9, 2021

CUDA threading in Jetson Xavier separately

Related topics