Detectnet tutorial not working

Hi,
Following the tutorial here…
https://nvidia-isaac-ros.github.io/concepts/object_detection/detectnet/tutorial_isaac_sim.html

Doesn’t work. Launches but looks like

Terminal output is here…
Its seems related to gxf. Which my be related to other bugs… the target was not found when colcon build gxf_issac_image_flip · Issue #48 · NVIDIA-ISAAC-ROS/isaac_ros_image_pipeline · GitHub

admin@system76-pc:/workspaces/isaac_ros-dev$ ros2 launch isaac_ros_detectnet isaac_ros_detectnet_isaac_sim.launch.py
[INFO] [launch]: All log files can be found below /home/admin/.ros/log/2024-10-27-15-23-50-637027-system76-pc-507884
[INFO] [launch]: Default logging verbosity is set to INFO
[INFO] [component_container_mt-1]: process started with pid [507895]
[INFO] [isaac_ros_detectnet_visualizer.py-2]: process started with pid [507897]
[INFO] [rqt_image_view-3]: process started with pid [507899]
[rqt_image_view-3] QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-admin'
[component_container_mt-1] [INFO] [1730067830.967922493] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libresize_node.so
[component_container_mt-1] [INFO] [1730067831.020162330] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ResizeNode>
[component_container_mt-1] [INFO] [1730067831.020223326] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ResizeNode>
[component_container_mt-1] [INFO] [1730067831.024208705] [image_resize_node_left]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] [INFO] [1730067831.025862597] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/std/libgxf_std.so
[component_container_mt-1] 2024-10-27 15:23:51.025 ERROR gxf/std/extension_loader.cpp@114: Failed to load extension /workspaces/isaac_ros-dev/install/isaac_ros_gxf/share/isaac_ros_gxf/gxf/lib/std/libgxf_std.so Error: /workspaces/isaac_ros-dev/install/isaac_ros_gxf/share/isaac_ros_gxf/gxf/lib/std/libgxf_std.so: cannot open shared object file: No such file or directory
[component_container_mt-1] [ERROR] [1730067831.026131737] [NitrosContext]: [NitrosContext] GxfLoadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.026143319] [TypeAdapterNitrosContext]: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.028510052] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'image_resize_node_left' of type 'nvidia::isaac_ros::image_proc::ResizeNode' in container '/detectnet_container/detectnet_container': Component constructor threw an exception: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [INFO] [1730067831.029555361] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ResizeNode>
[component_container_mt-1] [INFO] [1730067831.029585669] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ResizeNode>
[component_container_mt-1] [INFO] [1730067831.033481097] [detectnet_encoder.resize_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] [INFO] [1730067831.035524007] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_gxf_helpers.so
[component_container_mt-1] 2024-10-27 15:23:51.037 WARN  external/com_nvidia_gxf/gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::SchedulingTerm
[component_container_mt-1] 2024-10-27 15:23:51.037 ERROR gxf/std/extension_loader.cpp@138: Failed to load extension /opt/ros/humble/share/gxf_isaac_gxf_helpers/gxf/lib/libgxf_isaac_gxf_helpers.so
[component_container_mt-1] [ERROR] [1730067831.037815347] [NitrosContext]: [NitrosContext] GxfLoadExtensions Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.037821599] [TypeAdapterNitrosContext]: loadExtensions Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.040663511] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadExtensions Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'resize_node' of type 'nvidia::isaac_ros::image_proc::ResizeNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadExtensions Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.041628820] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libtriton_node.so
[component_container_mt-1] [INFO] [1730067831.044928800] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::TritonNode>
[component_container_mt-1] [INFO] [1730067831.044941404] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::TritonNode>
[component_container_mt-1] [INFO] [1730067831.048326636] [triton_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] [INFO] [1730067831.050900962] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_sight.so
[component_container_mt-1] 2024-10-27 15:23:51.050 ERROR gxf/std/extension_loader.cpp@114: Failed to load extension /workspaces/isaac_ros-dev/install/gxf_isaac_sight/share/gxf_isaac_sight/gxf/lib/libgxf_isaac_sight.so Error: /workspaces/isaac_ros-dev/install/gxf_isaac_sight/share/gxf_isaac_sight/gxf/lib/libgxf_isaac_sight.so: cannot open shared object file: No such file or directory
[component_container_mt-1] [ERROR] [1730067831.051140085] [NitrosContext]: [NitrosContext] GxfLoadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.051145816] [TypeAdapterNitrosContext]: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.053125736] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'triton_node' of type 'nvidia::isaac_ros::dnn_inference::TritonNode' in container '/detectnet_container/detectnet_container': Component constructor threw an exception: loadExtensions Error: GXF_EXTENSION_FILE_NOT_FOUND
[component_container_mt-1] [INFO] [1730067831.054053904] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libcrop_node.so
[component_container_mt-1] [INFO] [1730067831.055098944] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::CropNode>
[component_container_mt-1] [INFO] [1730067831.055110175] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::CropNode>
[component_container_mt-1] [INFO] [1730067831.058533970] [detectnet_encoder.crop_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] [INFO] [1730067831.061740744] [NitrosContext]: [NitrosContext] Loading extension: gxf/lib/libgxf_isaac_atlas.so
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@344: Component type not found nvidia::gxf::Allocator
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@475: Parameter Override failed for Component "nvidia::isaac::OccupancyGridMap" and Parameter "allocator"
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@344: Component type not found nvidia::gxf::Allocator
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@475: Parameter Override failed for Component "nvidia::isaac::OccupancyGridMap" and Parameter "device_allocator"
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@344: Component type not found nvidia::gxf::Tensor
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR external/com_nvidia_gxf/gxf/core/parameter_registrar.hpp@475: Parameter Override failed for Component "nvidia::isaac::OccupancyGridMap" and Parameter "occupancy_map_image"
[component_container_mt-1] 2024-10-27 15:23:51.065 ERROR gxf/std/extension_loader.cpp@138: Failed to load extension /opt/ros/humble/share/gxf_isaac_atlas/gxf/lib/libgxf_isaac_atlas.so
[component_container_mt-1] [ERROR] [1730067831.065518499] [NitrosContext]: [NitrosContext] GxfLoadExtensions Error: GXF_ENTITY_COMPONENT_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.065525092] [TypeAdapterNitrosContext]: loadExtensions Error: GXF_ENTITY_COMPONENT_NOT_FOUND
[component_container_mt-1] [ERROR] [1730067831.067276649] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadExtensions Error: GXF_ENTITY_COMPONENT_NOT_FOUND
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'crop_node' of type 'nvidia::isaac_ros::image_proc::CropNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadExtensions Error: GXF_ENTITY_COMPONENT_NOT_FOUND
[component_container_mt-1] [INFO] [1730067831.068343660] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libdetectnet_decoder_node.so
[component_container_mt-1] [INFO] [1730067831.069722873] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::detectnet::DetectNetDecoderNode>
[component_container_mt-1] [INFO] [1730067831.069732842] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::detectnet::DetectNetDecoderNode>
[component_container_mt-1] [INFO] [1730067831.074906601] [detectnet_decoder_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] 2024-10-27 15:23:51.078 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.078 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.078568417] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.081229027] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.081967034] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libimage_format_converter_node.so
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'detectnet_decoder_node' of type 'nvidia::isaac_ros::detectnet::DetectNetDecoderNode' in container '/detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.082786496] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ImageFormatConverterNode>
[component_container_mt-1] [INFO] [1730067831.082797267] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::image_proc::ImageFormatConverterNode>
[component_container_mt-1] [INFO] [1730067831.086445236] [detectnet_encoder.image_format_converter_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] 2024-10-27 15:23:51.089 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.089 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.089649526] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.091770192] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'image_format_converter_node' of type 'nvidia::isaac_ros::image_proc::ImageFormatConverterNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.093324076] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libimage_to_tensor_node.so
[component_container_mt-1] [INFO] [1730067831.127005892] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ImageToTensorNode>
[component_container_mt-1] [INFO] [1730067831.127048533] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ImageToTensorNode>
[component_container_mt-1] 2024-10-27 15:23:51.134 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.134 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.134119166] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.136708159] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'image_to_tensor' of type 'nvidia::isaac_ros::dnn_inference::ImageToTensorNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.138471109] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libimage_tensor_normalize_node.so
[component_container_mt-1] [INFO] [1730067831.139214356] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ImageTensorNormalizeNode>
[component_container_mt-1] [INFO] [1730067831.139223293] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ImageTensorNormalizeNode>
[component_container_mt-1] 2024-10-27 15:23:51.144 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.144 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.145006227] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.147297707] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'normalize_node' of type 'nvidia::isaac_ros::dnn_inference::ImageTensorNormalizeNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.148670627] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libinterleaved_to_planar_node.so
[component_container_mt-1] [INFO] [1730067831.149348411] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::InterleavedToPlanarNode>
[component_container_mt-1] [INFO] [1730067831.149357498] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::InterleavedToPlanarNode>
[component_container_mt-1] [INFO] [1730067831.153720032] [detectnet_encoder.interleaved_to_planar_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] 2024-10-27 15:23:51.157 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.157 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.157512044] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.160123961] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'interleaved_to_planar_node' of type 'nvidia::isaac_ros::dnn_inference::InterleavedToPlanarNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [INFO] [1730067831.161596911] [detectnet_container.detectnet_container]: Load Library: /opt/ros/humble/lib/libreshape_node.so
[component_container_mt-1] [INFO] [1730067831.162353735] [detectnet_container.detectnet_container]: Found class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ReshapeNode>
[component_container_mt-1] [INFO] [1730067831.162366449] [detectnet_container.detectnet_container]: Instantiate class: rclcpp_components::NodeFactoryTemplate<nvidia::isaac_ros::dnn_inference::ReshapeNode>
[component_container_mt-1] [INFO] [1730067831.166618803] [detectnet_encoder.reshape_node]: [NitrosNode] Initializing NitrosNode
[component_container_mt-1] 2024-10-27 15:23:51.170 WARN  gxf/core/type_registry.cpp@50: Unknown type: nvidia::gxf::UnboundedAllocator
[component_container_mt-1] 2024-10-27 15:23:51.170 ERROR gxf/std/yaml_file_loader.cpp@403: Could not add component of type 'nvidia::gxf::UnboundedAllocator' to entity.
[component_container_mt-1] [ERROR] [1730067831.170221287] [TypeAdapterNitrosContext]: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[component_container_mt-1] [ERROR] [1730067831.172589783] [detectnet_container.detectnet_container]: Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME
[ERROR] [launch_ros.actions.load_composable_nodes]: Failed to load node 'reshape_node' of type 'nvidia::isaac_ros::dnn_inference::ReshapeNode' in container 'detectnet_container/detectnet_container': Component constructor threw an exception: loadApplication Error: GXF_FACTORY_UNKNOWN_CLASS_NAME

Build in an IsaacROSDev Container. Instructions in the readme

Hi @Ahung:),
I don’t think I agree that this is an IsaacSim issue. I think its a gxf (or something) issue. I’m using IsaacSim simply to provide a way to recreate.

I haven’t looked into the details yet, but according to the note on Getting Started — isaac_ros_docs documentation, have you tried using version 4.0.0?

Last validated with Isaac Sim 4.0.0

Hi @VickNV,
Can’t say I have. I’m using IsaacSim 4.2.
And IsaacROS 3.1
I think its related to gxf, inside IsaacROS3.1

Hi @brettpac

It seems that you got two problems. If it’s about the colcon build issue, could you check if this post can help?