Hi all, it is regarding getting to know practical implementation of cuda graph in tensorrt. Though the sample program code for trtexec is present in the directory /usr/src/tensorrt/samples/common/ It is complex and has become difficult understand for writing a separate code. I request you to ple…

Hi ShivaRamaKrishna, I tried executing it but it thrown the error as from cuda import cudart ModuleNotFoundError: No module named ‘cuda’ When I tried echoing the contents LD_LIBRARY_PATH it showed the following output $ echo $LD_LIBRARY_PATH /usr/lib/llvm-8/lib:/usr/lib/llvm-8/lib:/usr/local/cu…

Hi ShivaRamaKrishna, please update me on this. I need it to make it work quickly as it is holding my work. Thanks and Regards Nagaraj Trivedi

Dear @trivedi.nagaraj , is cuda python package installed? can you try suggestion at Install PyCuda on Jetson NX - #3 by AastaLLL

Hi ShivaramaKrishnan, it is already installed long back and when tried installing it said Requirement already satisfied. Now let me know even though it is already installed much before what could be the actual problem for ModuleNotFoundError: No module named ‘cuda’ (which I was posted before) Belo…

Hi ShivaramaKrishna, please provide update on this. Thanks and Regards Nagaraj Trivedi

Dear @trivedi.nagaraj , check if it helps to fix. nvidia@tegra-ubuntu:~$ pip3 install cuda-python Collecting cuda-python Downloading cuda_python-12.3.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (22.9 MB) |████████████████████████████████| 22.9 MB 40.7 MB/s Installing collect…

[image] SivaRamaKrishnaNV: pip3 install cuda-python Hi SivaramaKrishna, thank you for the information you have provided. I tried it but could not succeed in installing. Here the error message I have got pip3 install cuda-python Defaulting to user installation because normal site-packages is…

Dear @trivedi.nagaraj , Just confirming if you are using Xavier board? What is the jetpack version?

Hi SivaRamakrishnan, yes I am using Xavier board and the jetpack version is Package: nvidia-jetpack Version: 4.6-b199 Thanks and Regards Nagaraj Trivedi

Dear @trivedi.nagaraj , I could install using jetpack 5 release. Can you upgrade to latest release?

Please provide a sample file making use of cuda graph

Robotics & Edge Computing Jetson Systems Jetson AGX Xavier

SivaRamaKrishnaNV January 7, 2024, 12:26pm 31

Dear @trivedi.nagaraj,
Please see I don't install anything on Jetson Nano - #3 by vercetti.tony

Topic		Replies	Views
Code modified for CUDA Graph in the sampleINTAPI is throwing error Jetson AGX Xavier cuda	19	1309	January 16, 2024
--useCudaGraph using Python API? TensorRT	7	2371	March 1, 2024
TF-TRT issue Jetson TX2	25	4377	February 22, 2019
how execute Python code on GPU Graph Jetson TX1 Jetson TX1	7	1763	June 15, 2018
Regarding an immediate and straight forward solution to my queries Jetson AGX Xavier jetson-inference	4	677	January 7, 2024
Create inference graph failed on Agx Xavier Jetson AGX Xavier	31	2494	June 3, 2020
Don't get any 'TRTEngineOp' after optimizing model via TensorRT in Jeton TX2 TensorRT	16	3873	July 22, 2019
No improvements from TensorRT on NVIDIA-AI-IOT/tf_trt_models TensorRT	3	1681	February 21, 2019
Running tensorRT sample on nano Jetson Nano tensorrt	1	902	December 28, 2020
Setting up CUDA/TensorRT manually on Jetson AGX Xavier Jetson AGX Xavier	12	21219	January 5, 2021

Please provide a sample file making use of cuda graph

Related topics