Greetings ! This is my first project on Jetson Xavier development kit – JetPack 4.6 L4T 32.6.1. (installed 512 GB NVMeM.2 SSD). I am running Yolo 4 with Darknet on custom trained model. (Wall crack images). The model detects wall crack from live Tello drone video. Yolo4 custom model weights is 256 MB
During the inference Xavier running on Power Mode 30W - 6 core i am getting only 10 FPS. because of this low FPS there is some issue on detection. When run on 15W - Desktop mode, gives 7 to 8 FPS.** . To get reasonable accuracy at least 18 to 20 FPS or above needed. When i show this demo to my boss, he ask why such a low FPS and wonder the model running on Xavier CPU or GPU. (he has high hope for Jetson Xavier)
though my script executed without any specific instruction to run on - -gpus 0
as explained in this blog -
Here is data flow → Tello Drone Flying and send video to → Jetson Xavier - that video is feed into the → Yolo4 model during the inference (instead web came the video comes from external source). All run in single script (darknet_video.py ) with 4 threads
python3 darknet_video.py --weightspath yolov4-custom_final.weights --configpath yolov4-custom.cfg --datapath /home/jetson/darknet/data/CrackDetection/obj.data
Running this same model on Windows Laptop - i7-10750H CPU @ 2.60GHz RTX 2060 (6GB) with i am getting 16 to 18 FPS.
So my question ,
- Is there any specific way to check /ensure the model runs on GPU itself on Jetson Xavier ?
- Is there any basic optimization rules to rule of thumb (Power Mode?) while running to heavy models like YOLO V4 ?
- or am i missing some basic points? Any suggestion is welcome.