Encountering File and Package Location Issues with Human Reconstruction Running the Demonstration Scene in Isaac Sim

I’ve been following the process for Human Reconstruction in Isaac Sim Running the Demonstration Scene in Isaac Sim, using the nvblox packages.
Following is the Documentation link
Documentation Link:
https://nvidia-isaac-ros.github.io/concepts/scene_reconstruction/nvblox/tutorials/tutorial_human_reconstruction_isaac_sim.html
Up until step 4, the setup and execution were proceeding without any issues.
The command executed at this stage was:
Step 4 command:

cd /workspaces/isaac_ros-dev &&
colcon build --symlink-install &&
source install/setup.bash

However, the build process encountered a critical error during the compilation of the isaac_ros_benchmark package. The error message indicated a missing file:

Starting >>> isaac_ros_common
Starting >>> isaac_ros_test
Starting >>> nvblox_msgs
Starting >>> nvblox_ros_common
Starting >>> nvblox
Starting >>> nvblox_cpu_gpu_tools
Starting >>> nvblox_performance_measurement_msgs
Starting >>> isaac_ros_to_h264_msgs_packet
Starting >>> network_performance_measurement
Starting >>> nvblox_examples_bringup
Starting >>> nvblox_isaac_sim
Starting >>> odometry_flattener
Finished <<< isaac_ros_common [1.61s]
Finished <<< nvblox_examples_bringup [1.48s]
Starting >>> isaac_ros_bi3d_interfaces
Starting >>> isaac_ros_apriltag_interfaces
Starting >>> isaac_ros_benchmark
Starting >>> isaac_ros_nitros_bridge_interfaces
Starting >>> isaac_ros_nova_interfaces
Starting >>> isaac_ros_pointcloud_interfaces
Starting >>> isaac_ros_tensor_list_interfaces
Finished <<< network_performance_measurement [1.82s]
Finished <<< nvblox_ros_common [2.01s]
Starting >>> nvblox_image_padding
Finished <<< odometry_flattener [2.10s]
Finished <<< nvblox_isaac_sim [2.55s]
Finished <<< isaac_ros_test [2.80s]
Starting >>> isaac_ros_bi3d_freespace
Starting >>> isaac_ros_h264_decoder
Starting >>> isaac_ros_h264_encoder
Finished <<< nvblox_cpu_gpu_tools [2.86s]
Finished <<< isaac_ros_to_h264_msgs_packet [2.86s]
— stderr: isaac_ros_benchmark
In file included from /workspaces/isaac_ros-dev/src/isaac_ros_benchmark/isaac_ros_benchmark/>src/
nitros_playback_node.cpp:18:
/workspaces/isaac_ros-dev/src/isaac_ros_benchmark/isaac_ros_benchmark/include/>isaac_ros_benchmark/nitros_playback_node.hpp:31:10: fatal error: ros2_benchmark/>playback_node.hpp: No such file or directory
31 | include “ros2_benchmark/playback_node.hpp”
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [CMakeFiles/nitros_playback_node.dir/build.make:76: CMakeFiles/>nitros_playback_node.dir/src/
nitros_playback_node.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:194: CMakeFiles/nitros_playback_node.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs…
make: *** [Makefile:146: all] Error 2

Failed <<< isaac_ros_benchmark [1.33s, exited with code 2]
Aborted <<< nvblox [3.05s]
Aborted <<< isaac_ros_bi3d_freespace [0.31s]
Aborted <<< isaac_ros_h264_decoder [0.27s]
Aborted <<< isaac_ros_h264_encoder [0.25s]
Aborted <<< isaac_ros_nitros_bridge_interfaces [1.35s]
Aborted <<< isaac_ros_pointcloud_interfaces [1.28s]
Aborted <<< isaac_ros_tensor_list_interfaces [1.23s]
Aborted <<< nvblox_image_padding [1.03s]
Aborted <<< isaac_ros_bi3d_interfaces [1.48s]
Aborted <<< isaac_ros_nova_interfaces [1.38s]
Aborted <<< nvblox_performance_measurement_msgs [3.09s]
Aborted <<< isaac_ros_apriltag_interfaces [1.62s]
Aborted <<< nvblox_msgs [3.36s]

Summary: 9 packages finished [4.68s]
1 package failed: isaac_ros_benchmark
13 packages aborted: isaac_ros_apriltag_interfaces isaac_ros_bi3d_freespace >isaac_ros_bi3d_interfaces isaac_ros_h264_decoder isaac_ros_h264_encoder >isaac_ros_nitros_bridge_interfaces isaac_ros_nova_interfaces isaac_ros_pointcloud_interfaces >isaac_ros_tensor_list_interfaces nvblox nvblox_image_padding nvblox_msgs >nvblox_performance_measurement_msgs
1 package had stderr output: isaac_ros_benchmark
9 packages not processed

Following this, attempting to proceed to step 5 with the command:
Step 5 command:

ros2 launch nvblox_examples_bringup isaac_sim_humans_example.launch.py
Error:
Package ‘nvblox_examples_bringup’ not found: “package ‘nvblox_examples_bringup’ not found, >searching: [‘/opt/ros/humble’]”
This seems to mirror the issue discussed in this forum post, suggesting a possible similar error pattern.
Forum post link:
Difficulty Locating the nvblox_examples_bringup Package for Dynamic Reconstruction in Isaac Sim

Error Image:

I’m looking for insights or solutions that might address both the missing file during the isaac_ros_benchmark build and the inability to locate the nvblox_examples_bringup package. Any assistance or shared experiences with similar issues would be greatly appreciated.

Hi @sweetyleah0

This error is the same as the error you reported in this post: No Output Mesh in Nvblox QuickStart - #2 by Raffaello

I see isaac_ros_benchmark is unrelated to the demo you are testing and fail your building:

— stderr: isaac_ros_benchmark
Errors while running CTest
Output from these tests are in: /workspaces/isaac_ros-dev/build/isaac_ros_benchmark/Testing/Temporary/ > LastTest.log
Use “–rerun-failed --output-on-failure” to re-run the failed cases verbosely.

Finished <<< isaac_ros_benchmark [2.01s] [ with test failures ]

Please remove the isaac_ros_benchmark package from your workspace, and the colon build will finish compiling nvblox to test this demo.

I’m reaching out for guidance following an update on the previous issue I reported, which, thanks to the community’s advice, has been successfully resolved. However, I’ve encountered a new challenge while progressing to the next step of my project, specifically during the launch of nvblox for human mapping.

Command Executed
Step5: Launch nvblox configured for human mapping

ros2 launch nvblox_examples_bringup isaac_sim_humans_example.launch.py

Observations:
After executing the above command, I’ve noticed that the rviz visualization does not appear to render as expected. Additionally, the logs generated during the process contain entries that I find unusual and potentially indicative of underlying issues. For clarity, here are some snippets from the logs:

Log:

[component_container_mt-1] avg=71.953614, min=0.000000, max=650.000034, std_dev=56.059538, >count=3061
[component_container_mt-1] [INFO] [1707361212.497041976] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361213.497013403] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361214.497011657] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361215.487101594] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361216.497204039] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361217.507021088] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361218.506979112] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361219.507105468] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361220.596929675] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361221.557362187] [nvblox_human_node]: color_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361221.963356329] [nvblox_human_node]: Depth plus Mask >Statistics:
[component_container_mt-1] avg=72.043183, min=0.000000, max=650.000034, std_dev=55.963400, >count=3196
[component_container_mt-1] [INFO] [1707361222.556875384] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361223.557035496] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361224.566997073] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361225.576908287] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361226.566912436] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361227.567019991] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361228.587047898] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361229.576952885] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361230.577023418] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361231.587052915] [nvblox_human_node]: color_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361231.976040240] [nvblox_human_node]: Color plus Mask >Statistics:
[component_container_mt-1] avg=83.974139, min=0.000000, max=550.000029, std_dev=68.252557, >count=2861
[component_container_mt-1] [INFO] [1707361232.676996864] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 2 messages.
[component_container_mt-1] [INFO] [1707361233.636825379] [nvblox_human_node]: depth_mask vqueue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361234.646958865] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361235.636804019] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361236.686924456] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361237.706911085] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361238.746911286] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361239.746949129] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361240.746892271] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361241.816913537] [nvblox_human_node]: depth_mask >queue was longer than 30 deleted 1 messages.
[component_container_mt-1] [INFO] [1707361242.069120301] [nvblox_human_node]: Color plus Mask >Statistics:

Repeated messages regarding the depth_mask and color_mask queues being longer than 30 and the subsequent deletion of messages are particularly concerning. The statistics provided in the logs, such as average, minimum, maximum values, and standard deviation for depth and color masks, also caught my attention but I’m uncertain how to interpret these in the context of my project.

Rviz

Isaac Sim

I appreciate your time and assistance in helping me navigate these challenges. The community’s expertise has been invaluable to my project’s progress, and I look forward to your advice on these matters.

Thank you!

Hi @sweetyleah0

such I report on Difficulty Locating the nvblox_examples_bringup Package for Dynamic Reconstruction in Isaac Sim there is a bug on the global frame

ros2 launch nvblox_examples_bringup isaac_sim_dynamics_example.launch.py run_vslam:=True global_frame:=odom

Let me know if fix your issue

It works perfectly, thanks