Testing run_cgf_demo on target

ashwin.nanda · October 4, 2024, 10:37am

Hi @SivaRamaKrishnaNV, I accepted the answer before as you mentioned, any custom node integration gets logged, however we still facing issues with display.

powering off/on was the only option before, when it was irresponsive I tried with remmina vnc to have a dispaly remotely, still the same issue.

roadrunner is a black screen and launcher exit status is 33.

ashwin.nanda · October 9, 2024, 11:23am

Hi @SivaRamaKrishnaNV friendly ping for any idea you have on this yet.

SivaRamaKrishnaNV · October 9, 2024, 1:47pm

Dear @ashwin.nanda ,
I see log level is still DW_LOG_ERROR in the picture you have shared. Please use sudo ./run_cgf_demo.sh --loglevel DW_LOG_VERBOSE to enabled verbose logs. Then, I would expect to see the prints from HelloWorldNodeImpl.cpp/SumNodeImpl.cpp in camera_pipeline0.log to confirm if the nodes are executed.

Please double check the modified files with the files I have shared. I would expect the application to work with the steps I have provided on freshly installed machine.

Note: Please use text messages instead of pictures for logs while posting. This helps others in the community to search.

ashwin.nanda · October 9, 2024, 4:25pm

Hello @SivaRamaKrishnaNV ,
We are running the script as you have mentioned, please find the message while running the script below

sudo ./run_cgf_demo.sh --loglevel DW_LOG_VERBOSE
20241009_140431
20241009_140431
DW_TOP_PATH=/usr/local/driveworks
RR_TOP_PATH=/usr/local/driveworks/apps/roadrunner-2.0
CGF_SYS_PATH=/usr/local/driveworks/apps/cgf_demo
RR_LOG_PATH=/usr/local/driveworks-5.14/bin/LogFolder
RR_RUN_CFG_PATH=/usr/local/driveworks-5.14/bin/RunFolder
DATA_PATH=
Current DISPLAY is :1
fs.mqueue.msg_max = 4096
|–> Tuning network stack
LD_LIBRARY_PATH: /usr/local/driveworks/apps/roadrunner-2.0:/usr/local/driveworks/src/cgf/nodes:/usr/local/driveworks/bin::/usr/local/driveworks/lib
/usr/local/driveworks-5.14/bin/LogFolder dir exists
/usr/local/driveworks-5.14/bin/RunFolder dir exists
total 12
drwxr-xr-x. 3 root root 4096 Sep 30 15:10 .
drwxr-xr-x. 5 root root 4096 Sep 30 15:10 …
drwxr-xr-x. 3 root root 4096 Sep 30 15:10 config
Running command: /usr/local/driveworks/bin/launcher --binPath=/usr/local/driveworks/bin --spec=/usr/local/driveworks/apps/cgf_demo/CGFDemo.app.json --logPath=/usr/local/driveworks-5.14/bin/LogFolder --dwdatapath=/usr/local/driveworks/data --schedule=/usr/local/driveworks/apps/cgf_demo/CGFDemo__standardSchedule.stm,/usr/local/driveworks/apps/cgf_demo/CGFDemo__slowSchedule.stm --start_timestamp=0 --loglevel=DW_LOG_VERBOSE --fullscreen=1 --winSizeW=1280 --winSizeH=800 --disableStmControlLogger=1 --gdb_debug=0 --app_parameter= --useLCM=0 --datapath=/usr/local/driveworks/data/samples/cgf/trafficlightturning-hyperion8 --mapPath=maps/sample/sanjose_loop --path=/usr/local/driveworks/apps/roadrunner-2.0 --virtual=1 > /usr/local/driveworks-5.14/bin/LogFolder/launcher.log 2>&1
Check if reset NetworkStack needed
Restore LD_LIBRARY_PATH to
=======================================================================
launcher exit status: 33

Please find the LogFolder of the same below for your reference. Issue still persists, display cant be seen after the script is run.
LogFolder.zip (3.7 MB)

lizhensheng · October 12, 2024, 2:14am

follow this to run your first minimal cgf app with just HelloworldNode and SumNode and multiple transport tested including nvsci.
nv_driveworks/README_en.md at main · ZhenshengLee/nv_driveworks (github.com)

ashwin.nanda · October 17, 2024, 11:57am

Hi @SivaRamaKrishnaNV any updates so far? we would like to have the insight.

SivaRamaKrishnaNV · October 17, 2024, 7:13pm

Dear @ashwin.nanda ,
From camera_pipeline0_0.log , I notice the SumNode and HelloWorldNode are executed only once.

<13>1 2024-10-09T14:05:07.552047Z - camera_pipeline0 33418 - - [1728482624924711us][DEBUG][tid:28][HelloWorldNodeImpl.cpp:78][HelloWorldNode] [Epoch 0] Sent value0 = 0
<13>1 2024-10-09T14:05:07.552105Z - camera_pipeline0 33418 - - [1728482624924775us][DEBUG][tid:28][HelloWorldNodeImpl.cpp:82][HelloWorldNode] [Epoch 0] Sent value1 = 10000
<13>1 2024-10-09T14:05:07.552122Z - camera_pipeline0 33418 - - [1728482624924792us][DEBUG][tid:28][HelloWorldNodeImpl.cpp:85][HelloWorldNode] [Epoch 0] Greetings from HelloWorldNodeImpl: Hello Demo!
<13>1 2024-10-09T14:05:07.552173Z - camera_pipeline0 33418 - - [1728482624924843us][DEBUG][tid:28][SumNodeImpl.cpp:72][SumNode] [Epoch 0] Received 0 from input VALUE_0, received 10000 from input VALUE_1. Add together: 10000!

Do you notice the same after system poweroff/on? If so, can you please re-install CGF packages and double check if CGF Demo working properly before trying modifications. Also, check adding --offscreen=1 to confirm if display is causing the app to be failed.

ashwin.nanda · October 23, 2024, 3:09pm

Hello @SivaRamaKrishnaNV

sudo ./run_cgf_demo.sh --loglevel DW_LOG_VERBOSE
20241023_124047
20241023_124047
DW_TOP_PATH=/usr/local/driveworks
RR_TOP_PATH=/usr/local/driveworks/apps/roadrunner-2.0
CGF_SYS_PATH=/usr/local/driveworks/apps/cgf_demo
RR_LOG_PATH=/usr/local/driveworks-5.14/bin/LogFolder
RR_RUN_CFG_PATH=/usr/local/driveworks-5.14/bin/RunFolder
DATA_PATH=
Current DISPLAY is :1
fs.mqueue.msg_max = 4096
|–> Tuning network stack
LD_LIBRARY_PATH: /usr/local/driveworks/apps/roadrunner-2.0:/usr/local/driveworks/src/cgf/nodes:/usr/local/driveworks/bin::/usr/local/driveworks/lib
/usr/local/driveworks-5.14/bin/LogFolder dir exists
/usr/local/driveworks-5.14/bin/RunFolder dir exists
total 12
drwxr-xr-x. 3 root root 4096 Sep 30 16:10 .
drwxr-xr-x. 5 root root 4096 Sep 30 16:10 …
drwxr-xr-x. 3 root root 4096 Sep 30 16:10 config
Running command: /usr/local/driveworks/bin/launcher --binPath=/usr/local/driveworks/bin --spec=/usr/local/driveworks/apps/cgf_demo/CGFDemo.app.json --logPath=/usr/local/driveworks-5.14/bin/LogFolder --dwdatapath=/usr/local/driveworks/data --schedule=/usr/local/driveworks/apps/cgf_demo/CGFDemo__standardSchedule.stm,/usr/local/driveworks/apps/cgf_demo/CGFDemo__slowSchedule.stm --start_timestamp=0 --loglevel=DW_LOG_VERBOSE --fullscreen=1 --offscreen=1 --winSizeW=1280 --winSizeH=800 --disableStmControlLogger=1 --gdb_debug=0 --app_parameter= --useLCM=0 --datapath=/usr/local/driveworks/data/samples/cgf/trafficlightturning-hyperion8 --mapPath=maps/sample/sanjose_loop --path=/usr/local/driveworks/apps/roadrunner-2.0 --virtual=1 > /usr/local/driveworks-5.14/bin/LogFolder/launcher.log 2>&1
Check if reset NetworkStack needed
Restore LD_LIBRARY_PATH to
=======================================================================
launcher exit status: 0

We have added --offscreen=1 in this script.
Please find the attached LogFolder for your reference
LogFolder.tar.gz (2.3 MB)

SivaRamaKrishnaNV · October 24, 2024, 8:14am

Dear @ashwin.nanda,
Looks like sample working without any issue when display is disabled(–offscreen=1) .
Other DW samples working which need GUI output?

prit.shah · October 24, 2024, 8:49am

Hello @SivaRamaKrishnaNV

Yes, when we are running another sample it is showing us display. Even when running the sample CGF it is showing but when we are implementing custom node (helloworldnode and sumnode) there is no display at that time.

SivaRamaKrishnaNV · October 28, 2024, 9:11am

Dear @prit.shah ,
Make sure you are running the application in the same window where export DISPLAY:=0 is set when tested using VNC. I don’t see any issue with VNC viewer client from host.

prit.shah · October 29, 2024, 11:01am

Hello @SivaRamaKrishnaNV

After passing this argument we are getting another error mentioned below

> sudo ./run_cgf_demo.sh --loglevel DW_LOG_VERBOSE
> 20241029_105149
> 20241029_105149
> DW_TOP_PATH=/usr/local/driveworks
> RR_TOP_PATH=/usr/local/driveworks/apps/roadrunner-2.0
> CGF_SYS_PATH=/usr/local/driveworks/apps/cgf_demo
> RR_LOG_PATH=/usr/local/driveworks-5.14/bin/LogFolder
> RR_RUN_CFG_PATH=/usr/local/driveworks-5.14/bin/RunFolder
> DATA_PATH=
> Current DISPLAY is :0
> fs.mqueue.msg_max = 4096
> |–> Tuning network stack
> LD_LIBRARY_PATH: /usr/local/driveworks/apps/roadrunner-2.0:/usr/local/driveworks/src/cgf/nodes:/usr/local/driveworks/bin::/usr/local/driveworks/lib
> /usr/local/driveworks-5.14/bin/LogFolder dir exists
> /usr/local/driveworks-5.14/bin/RunFolder dir exists
> total 12
> drwxr-xr-x. 3 root root 4096 Sep 30 16:10 .
> drwxr-xr-x. 5 root root 4096 Sep 30 16:10 …
> drwxr-xr-x. 3 root root 4096 Sep 30 16:10 config
> Running command: /usr/local/driveworks/bin/launcher --binPath=/usr/local/driveworks/bin --spec=/usr/local/driveworks/apps/cgf_demo/CGFDemo.app.json --logPath=/usr/local/driveworks-5.14/bin/LogFolder --dwdatapath=/usr/local/driveworks/data --schedule=/usr/local/driveworks/apps/cgf_demo/CGFDemo__standardSchedule.stm,/usr/local/driveworks/apps/cgf_demo/CGFDemo__slowSchedule.stm --start_timestamp=0 --loglevel=DW_LOG_VERBOSE --fullscreen=1 --winSizeW=1280 --winSizeH=800 --disableStmControlLogger=1 --gdb_debug=0 --app_parameter= --useLCM=0 --datapath=/usr/local/driveworks/data/samples/cgf/trafficlightturning-hyperion8 --mapPath=maps/sample/sanjose_loop --path=/usr/local/driveworks/apps/roadrunner-2.0 --virtual=1 > /usr/local/driveworks-5.14/bin/LogFolder/launcher.log 2>&1
> Check if reset NetworkStack needed
**> Restore LD_LIBRARY_PATH to **
> =======================================================================
> launcher exit status: 217

prit.shah · October 31, 2024, 10:27am

Hello @SivaRamaKrishnaNV ,

can we have an update on this?

prit.shah · November 7, 2024, 9:13am

Hello @SivaRamaKrishnaNV

Is there any update on this ?

ashwin.nanda · November 19, 2024, 11:21am

Hi @SivaRamaKrishnaNV we are awaiting a reply on this, since our custom applications for a third party DBW system and LiDAR depends on building custom nodes and graphlets for the main pipeline. If the display issue isnt sorted out even on samples, we cannot proceed ahead unless knowing which side is responsible.

SivaRamaKrishnaNV · November 19, 2024, 11:57am

Dear @ashwin.nanda ,
I don’t see any issue with cgf_demo sample with shared steps on my side. But you seems to have issue when display is enabled. Do you have any other target to try the same steps. Or you may try reflashing once to see if fixes.

ashwin.nanda · November 19, 2024, 1:50pm

Hello there @SivaRamaKrishnaNV, I’ll cast out the situations as below:

thank you for providing the YAML, and JSON files which helped us generate node creation (verified through logs)
powering on/off, reinstalling, and even flashing are the very early and basic debugging steps performed several times.
switching to x11vnc was suggested by yourself, and do please note that the vnc and $DISPLAY environment variable use same window ( :1).
However, we DO NOT prefer to use the vnc for display losses over the network, and use a monitor connected to the target.

either way, after CGF custom node integration the display(on monitor or vnc) when the application is running is a complete black screen.
we WANT to fix this.

ashwin.nanda · November 19, 2024, 3:20pm

dear @SivaRamaKrishnaNV please also note that @prit.shah has already mentioned the logs with --off-screen=1 which resulted in the successful launcher status.

SivaRamaKrishnaNV · November 25, 2024, 6:03pm

Dear @ashwin.nanda,
We have tested the CGF Demo custom node integration steps and verified the display via VNC only. We would expect it work with display as well if VNC works. It is not clear to me why it fails to run with display option where as other DW samples are able to run. Is the same behavior observed on other Devkits as well?

ashwin.nanda · November 26, 2024, 9:05am

dear @SivaRamaKrishnaNV thank you for the reply, Ive got only one target unfortunately, however would you recommend me to switch boot-chain and try installing Driveworks 5.14 samples and deb files again on boot-chain B and try?
(also can I use boot-chain B for our own testing and development practices?)

Topic		Replies	Views
Unable to run sample_cgf_camera_interprocess DRIVE AGX Orin General driveworks-cgf	5	486	October 25, 2023
MAX96712 Failure after flash DRIVE AGX Orin General driveos-nvmedia	5	581	December 19, 2023
AR0231 RCCB Sekonix module (SF3324 and SF3325) not running on Orin 6.0.6 using nvsipl_camera command DRIVE AGX Orin General driveos-nvmedia	2	450	April 17, 2024
Drive AGX flash error DRIVE AGX Orin General drive-platform-setup	17	519	August 8, 2024
Can not run the CGF sample correctly DRIVE AGX Orin General drive-docs	11	1170	April 20, 2023
Nvsipl_camera example not working DRIVE AGX Orin General driveos-nvmedia	4	1482	March 17, 2023
Unable to run recorder-qtgui on Drive AGX Orin DRIVE AGX Orin General driveworks-recording	38	104	October 3, 2024
The camera is not streaming on 6.0.8.1 DRIVE AGX Orin General driveos-nvmedia	6	175	August 5, 2024
Disable ISP(Not use .nito) in sample_camera demo DRIVE AGX Orin General driveworks	16	696	June 26, 2024
Driveworks Entron camera queue timeout DRIVE AGX Orin General driveworks	12	99	October 17, 2024

Testing run_cgf_demo on target

Related topics