Isaac_ros_argus_camera test error

1471131969 · June 25, 2024, 6:38am

Device: Nova Orin Developer Kit
Camera: 3 Owl monocular cameras + 3 Hawk stereo cameras
Extra Info:
1. Use this script “nova_preflight_checker -v” to check the sensors ----> all passed
2. Follow tutorial from “Run all Sensors on the Nova Orin Developer Kit” to visualize the sensor outputs ------> both stereo/monocular camera images are normal

Script: ros2 launch isaac_ros_examples isaac_ros_examples.launch.py launch_fragments:=argus_stereo

Using the following script to test Hawk camera and meet this problem:

[INFO] [launch]: All log files can be found below /home/admin/.ros/log/2024-06-25-14-13-23-233861-ubuntu-11398
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container_mt-1]: process started with pid [11412]
[component_container_mt-1] [INFO] [1719296003.608188411] [isaac_ros_examples.container]: Load Library: /opt/ros/humble/lib/libstereo_node.so
[component_container_mt-1] [INFO] [1719296003.653292090] [isaac_ros_examples.container]: Found class: rclcpp_components::NodeFactoryTemplatenvidia::isaac_ros::argus::ArgusStereoNode
[component_container_mt-1] [INFO] [1719296003.653379258] [isaac_ros_examples.container]: Instantiate class: rclcpp_components::NodeFactoryTemplatenvidia::isaac_ros::argus::ArgusStereoNode
[component_container_mt-1] [INFO] [1719296003.656395354] [argus_stereo]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] [INFO] [1719296003.656771642] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/std/libgxf_std.so
[component_container_mt-1] [INFO] [1719296003.660073434] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_gxf_helpers.so
[component_container_mt-1] [INFO] [1719296003.664686554] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_sight.so
[component_container_mt-1] [INFO] [1719296003.669798906] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_atlas.so
[component_container_mt-1] e[33m2024-06-25 14:13:23.682 WARN gxf/std/program.cpp@532: No GXF scheduler specified.e[0m
[component_container_mt-1] [INFO] [1719296003.684505018] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/cuda/libgxf_cuda.so
[component_container_mt-1] [INFO] [1719296003.688053594] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_argus.so
[component_container_mt-1] e[33m2024-06-25 14:13:23.700 WARN gxf/std/program.cpp@532: No GXF scheduler specified.e[0m
[component_container_mt-1] [INFO] [1719296003.700392986] [argus_stereo]: [NitrosNode] Starting NitrosNode
[component_container_mt-1] [INFO] [1719296003.704566810] [argus_stereo]: [NitrosNode] Loading extensions
[component_container_mt-1] [INFO] [1719296003.704668346] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/multimedia/libgxf_multimedia.so
[component_container_mt-1] [INFO] [1719296003.708140570] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_message_compositor.so
[component_container_mt-1] [INFO] [1719296003.709229434] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/serialization/libgxf_serialization.so
[component_container_mt-1] [INFO] [1719296003.710523322] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_messages.so
[component_container_mt-1] [INFO] [1719296003.711827354] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_tensorops.so
[component_container_mt-1] [INFO] [1719296003.717077434] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_rectify.so
[component_container_mt-1] [INFO] [1719296003.721733530] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_timestamp_correlator.so
[component_container_mt-1] [INFO] [1719296003.730603834] [argus_stereo]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_camera_utils.so
[component_container_mt-1] [INFO] [1719296003.731789242] [argus_stereo]: [NitrosNode] Loading graph to the optimizer
[component_container_mt-1] [INFO] [1719296003.738397466] [argus_stereo]: [NitrosNode] Running optimization
[component_container_mt-1] [INFO] [1719296003.841041209] [argus_stereo]: [NitrosNode] Obtaining graph IO group info from the optimizer
[component_container_mt-1] [INFO] [1719296003.852140281] [argus_stereo]: [NitrosNode] Starting negotiation…
[INFO] [launch_ros.actions.load_composable_nodes]: Loaded node ‘/argus_stereo’ in container ‘/isaac_ros_examples/container’
[component_container_mt-1] [INFO] [1719296004.852988292] [argus_stereo]: [NitrosNode] Starting post negotiation setup
[component_container_mt-1] [INFO] [1719296004.853099556] [argus_stereo]: [NitrosNode] Getting data format negotiation results
[component_container_mt-1] [INFO] [1719296004.853127108] [argus_stereo]: [NitrosPublisher] Negotiation ended with no results
[component_container_mt-1] [INFO] [1719296004.853147652] [argus_stereo]: [NitrosPublisher] Use only the compatible publisher: topic_name=“/left/image_raw”, data_format=“nitros_image_rgb8”
[component_container_mt-1] [INFO] [1719296004.853159908] [argus_stereo]: [NitrosPublisher] Negotiation ended with no results
[component_container_mt-1] [INFO] [1719296004.853168420] [argus_stereo]: [NitrosPublisher] Use only the compatible publisher: topic_name=“/right/image_raw”, data_format=“nitros_image_rgb8”
[component_container_mt-1] [INFO] [1719296004.853176964] [argus_stereo]: [NitrosPublisher] Negotiation ended with no results
[component_container_mt-1] [INFO] [1719296004.853185092] [argus_stereo]: [NitrosPublisher] Use only the compatible publisher: topic_name=“/left/camera_info”, data_format=“nitros_camera_info”
[component_container_mt-1] [INFO] [1719296004.853193668] [argus_stereo]: [NitrosPublisher] Negotiation ended with no results
[component_container_mt-1] [INFO] [1719296004.853208516] [argus_stereo]: [NitrosPublisher] Use only the compatible publisher: topic_name=“/right/camera_info”, data_format=“nitros_camera_info”
[component_container_mt-1] [INFO] [1719296004.853457604] [argus_stereo]: [NitrosNode] Exporting the final graph based on the negotiation results
[component_container_mt-1] [INFO] [1719296004.864527812] [argus_stereo]: [NitrosNode] Wrote the final top level YAML graph to “/tmp/isaac_ros_nitros/graphs/OUBEQILWIR/OUBEQILWIR.yaml”
[component_container_mt-1] [INFO] [1719296004.864643652] [argus_stereo]: [NitrosNode] Loading application
[component_container_mt-1] [INFO] [1719296004.878846373] [argus_stereo]: [ArgusCameraNode] postLoadGraphCallback().
[component_container_mt-1] [INFO] [1719296004.878961861] [argus_stereo]: [ArgusStereoNode] postLoadGraphCallback().
[component_container_mt-1] [INFO] [1719296004.878980805] [argus_stereo]: [NitrosNode] Initializing and running GXF graph
[component_container_mt-1] [INFO] [1719296004.958483238] [argus_stereo]: [NitrosNode] Node was started
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.205 ERROR extensions/hawk/components/argus_camera.cpp@442: Failed to get CaptureSession interfacee[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.205 ERROR extensions/hawk/components/argus_camera.cpp@1074: Error while setting up output streamse[0m
[component_container_mt-1] e[33m2024-06-25 14:13:25.205 WARN gxf/std/entity_executor.cpp@495: Failed to start entity [OUBEQILWIR_argus_camera]e[0m
[component_container_mt-1] e[33m2024-06-25 14:13:25.205 WARN gxf/std/event_based_scheduler.cpp@329: Error while executing entity E25 named ‘OUBEQILWIR_argus_camera’: GXF_FAILUREe[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.205 ERROR gxf/std/entity_executor.cpp@586: Entity [OUBEQILWIR_argus_camera] must be in Started, Tick Pending, Ticking or Idle stage before stopping. Current state is StartPendinge[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.958 ERROR gxf/std/entity_executor.cpp@210: Entity with eid 89 not found!e[0m
[component_container_mt-1] [WARN] [1719296005.958616406] [argus_stereo]: [NitrosNode] The heartbeat entity (eid=89) was stopped. The graph may have been terminated.
[component_container_mt-1] [INFO] [1719296005.967311637] [argus_stereo]: [NitrosNode] Terminating the running application
[component_container_mt-1] [INFO] [1719296005.967338741] [argus_stereo]: [NitrosContext] Interrupting GXF…
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.967 ERROR gxf/core/runtime.cpp@1468: Graph interrupt failed with error: GXF_FAILUREe[0m
[component_container_mt-1] [ERROR] [1719296005.967408213] [argus_stereo]: [NitrosContext] GxfGraphInterrupt Error: GXF_FAILURE
[component_container_mt-1] [INFO] [1719296005.967412725] [argus_stereo]: [NitrosContext] Waiting on GXF…
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.967 ERROR gxf/std/program.cpp@574: wait failed. Deactivating…e[0m
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] | Job Statistics Report (regular) |
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] | Name | Count | Time (Median - 90% - Max) [ms] | Load (%) | Exec(ms) | Variation (Median - 90% - Max) [ns] |
[component_container_mt-1] |------------------------------------------------------------------------------------------------------------------------------------------------------------------|
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] | Entity Statistics Report (regular) |
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] | Entity Name | Entity State | Count | Time (Median - 90% - Max) [ms] |
[component_container_mt-1] |------------------------------------------------------------------------------------------------------------------------------------------------------------------|
[component_container_mt-1] |==================================================================================================================================================================|
[component_container_mt-1] e[33m2024-06-25 14:13:25.976 WARN gxf/std/entity_warden.cpp@464: Component of type nvidia::gxf::EventBasedScheduler, cid 120 failed to deinitialize with code GXF_FAILUREe[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.976 ERROR gxf/core/runtime.cpp@751: Could not deinitialize entity ‘OUBEQILWIR_EIEAYBNYRV’ (E118): GXF_FAILUREe[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.976 ERROR gxf/std/program.cpp@576: Deactivation failed.e[0m
[component_container_mt-1] e[1;31m2024-06-25 14:13:25.976 ERROR gxf/core/runtime.cpp@1476: Graph wait failed with error: GXF_FAILUREe[0m
[component_container_mt-1] [ERROR] [1719296005.976115285] [argus_stereo]: [NitrosContext] GxfGraphWait Error: GXF_FAILURE
[component_container_mt-1] [INFO] [1719296005.976128021] [argus_stereo]: [NitrosNode] Application termination done
[INFO] [component_container_mt-1]: process has finished cleanly [pid 11412]

Raffaello · June 25, 2024, 2:28pm

Hi @1471131969

I forwarded your issue to the engineering.

Meanwhile, I would like to know if you follow the troubleshooting on these two steps:

Best,
Raffaello

1471131969 · June 26, 2024, 1:57am

   I have tried these two methods( "Restarting the Argus Daemon", " Re-probing camera modules"), stereo camera launch problem exists。
   What's more, I find these two methods can sovle similar problem If I use  another script to launch mono camera: "ros2 launch isaac_ros_argus_camera isaac_ros_argus_camera_mono.launch.py". 
   How to fix this problem？

---------------------------------------- extra info -------------------------------------------
I can install isaac_ros_argus_camera by binary package without error, However launch sereo camera still occur the error above(Failed to get CaptureSession interface)
If I compile isaac_ros_argus_camera from source code, I will meet the following error( listing git files failed)。 I don’t know if this info will help with analysis。

------------------------------------------- log info---------------------------------------------------------
Starting >>> isaac_ros_common
Starting >>> magic_enum
Starting >>> isaac_ros_test
Starting >>> isaac_ros_tensor_list_interfaces
Finished <<< magic_enum [0.82s]
Finished <<< isaac_ros_common [0.84s]
Starting >>> isaac_ros_gxf
Starting >>> isaac_ros_nitros_interfaces
Starting >>> gxf_isaac_timestamp_correlator
Finished <<< gxf_isaac_timestamp_correlator [0.22s]
Finished <<< isaac_ros_gxf [0.30s]
Starting >>> gxf_isaac_gems
Starting >>> gxf_isaac_message_compositor
Starting >>> gxf_isaac_optimizer
Starting >>> gxf_isaac_sight
Starting >>> gxf_isaac_ros_messages
Starting >>> gxf_isaac_image_flip
Starting >>> gxf_isaac_point_cloud
Starting >>> gxf_isaac_argus
Finished <<< gxf_isaac_message_compositor [0.33s]
Finished <<< gxf_isaac_optimizer [0.34s]
Finished <<< gxf_isaac_sight [0.34s]
Finished <<< gxf_isaac_argus [0.33s]
Finished <<< gxf_isaac_ros_messages [0.36s]
Finished <<< gxf_isaac_gems [0.39s]
Finished <<< gxf_isaac_point_cloud [0.36s]
Starting >>> gxf_isaac_atlas
Starting >>> gxf_isaac_gxf_helpers
Starting >>> gxf_isaac_messages
Finished <<< gxf_isaac_image_flip [0.44s]
Finished <<< gxf_isaac_atlas [0.26s]
Finished <<< gxf_isaac_gxf_helpers [0.26s]
Finished <<< gxf_isaac_messages [0.27s]
Starting >>> gxf_isaac_sgm
Starting >>> gxf_isaac_tensorops
Starting >>> gxf_isaac_utils
Starting >>> gxf_isaac_camera_utils
Starting >>> gxf_isaac_rectify
Finished <<< gxf_isaac_camera_utils [0.35s]
Finished <<< gxf_isaac_sgm [0.41s]
Finished <<< gxf_isaac_utils [0.41s]
Finished <<< gxf_isaac_rectify [0.41s]
— stderr: isaac_ros_tensor_list_interfaces
ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Finished <<< isaac_ros_tensor_list_interfaces [2.38s]
— stderr: isaac_ros_nitros_interfaces
ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Finished <<< isaac_ros_nitros_interfaces [1.64s]
Finished <<< gxf_isaac_tensorops [0.68s]
— stderr: isaac_ros_test
ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Finished <<< isaac_ros_test [3.50s]
Starting >>> isaac_ros_nitros
Finished <<< isaac_ros_nitros [0.38s]
Starting >>> isaac_ros_nitros_camera_info_type
Starting >>> isaac_ros_nitros_image_type
Starting >>> isaac_ros_nitros_tensor_list_type
Starting >>> isaac_ros_nitros_disparity_image_type
Starting >>> isaac_ros_nitros_point_cloud_type
Finished <<< isaac_ros_nitros_camera_info_type [0.39s]
Finished <<< isaac_ros_nitros_disparity_image_type [0.39s]
Finished <<< isaac_ros_nitros_image_type [0.41s]
Finished <<< isaac_ros_nitros_point_cloud_type [0.41s]
Starting >>> isaac_ros_stereo_image_proc
Finished <<< isaac_ros_nitros_tensor_list_type [0.44s]
Starting >>> isaac_ros_managed_nitros
Finished <<< isaac_ros_managed_nitros [0.23s]
Starting >>> isaac_ros_image_proc
Finished <<< isaac_ros_stereo_image_proc [0.45s]
Finished <<< isaac_ros_image_proc [0.70s]
Starting >>> isaac_ros_argus_camera
Finished <<< isaac_ros_argus_camera [0.55s]

Summary: 33 packages finished [6.79s]
3 packages had stderr output: isaac_ros_nitros_interfaces isaac_ros_tensor_list_interfaces isaac_ros_test

Raffaello · June 26, 2024, 7:42pm

Hi @1471131969

We suggest to use instead of Isaac_ros_argus_camera the Isaac_ros_hawk that is part of isaac_ros_nova

If you want to work with Isaac_ros_argus_camera you can fix it with the following:

ros2 launch isaac_ros_examples isaac_ros_examples.launch.py launch_fragments:=argus_stereo module_id:=1

Let me know

Best,
Raffaello

1471131969 · June 27, 2024, 2:15am

@Raffaello Thanks. It works by using the script：“ros2 launch isaac_ros_examples isaac_ros_examples.launch.py launch_fragments:=argus_stereo module_id:=1”。Could you please tell me what the the meaning of module_id:=1?

system · July 11, 2024, 2:15am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Isaac ros argus is not publishing GxfGraphWait Error: GXF_FAILURE Isaac ROS isaac-ros-argus-camera	13	491	September 24, 2024
Isaac_ros_argus_camera error Isaac ROS isaac-ros-argus-camera	3	554	March 26, 2024
How can I run issac_ros_nova Isaac ROS camera	6	1007	February 19, 2024
Isaac_ros_argus_camera with custom cameras Isaac ROS isaac-ros-argus-camera	4	42	November 11, 2024
Isaac_ros_argus_camera without docker container Isaac ROS	11	187	July 19, 2024
Problem using isaac camera with isaac rectification node Isaac ROS camera , ros	2	984	September 19, 2023
Isaac ROS Argus Camera on Non-GMSL Stereocamera Isaac ROS isaac-ros-argus-camera	8	1826	November 15, 2023
Isaac ROS VSlam Examples No Realsense devices found (Tried all Troubleshooting mentioned in documentation) Isaac ROS camera , isaac-ros-vslam	5	192	July 15, 2024
Running Isaac ROS Packages with Intel RealSense D457 Isaac ROS	2	128	August 29, 2024
Nova Adaptation and Isaac ROS Nova Packages Isaac ROS	5	51	September 30, 2024

Isaac_ros_argus_camera test error

Using the following script to test Hawk camera and meet this problem:

Finished <<< isaac_ros_tensor_list_interfaces [2.38s] — stderr: isaac_ros_nitros_interfaces ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Finished <<< isaac_ros_nitros_interfaces [1.64s] Finished <<< gxf_isaac_tensorops [0.68s] — stderr: isaac_ros_test ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Related topics

Finished <<< isaac_ros_tensor_list_interfaces [2.38s]
— stderr: isaac_ros_nitros_interfaces
ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any

Finished <<< isaac_ros_nitros_interfaces [1.64s]
Finished <<< gxf_isaac_tensorops [0.68s]
— stderr: isaac_ros_test
ERROR setuptools_scm._file_finders.git listing git files failed - pretending there aren’t any