I want to measure the time of ONLY the inference in the TX2. How can I improve my function to do that? As right now I am measuring:
the transfer of the image from CPU to GPU
transfer of results from GPU to CPU
Or is that not possible because of the way GPUs work?
THIS WHERE I HAVE SET THE TIMER
THIS IS THE “do_inference” FUNCTION