Is the Skeleton Pose Estimation app pre-trained?

Hello,
do I need to download and process COCO 2017 as said in the Training section of the doc or could I just run
bob@desktop:~/isaac$ bazel run packages/skeleton_pose_estimation/apps/openpose:openpose_inference

I didn’t followed the training section and I get an error when I try to run the app, seem like I’m missing some packages.

Thank you

This is my shell output :

thoth@thoth-c:~/Desktop/isaac$ sudo bazel run packages/skeleton_pose_estimation/apps/openpose:openpose_inference
[sudo] password for thoth: 
Starting local Bazel server and connecting to it...
INFO: Analyzed target //packages/skeleton_pose_estimation/apps/openpose:openpose_inference (94 packages loaded, 5731 targets configured).
INFO: Found 1 target...
INFO: Deleting stale sandbox base /home/thoth/.cache/bazel/_bazel_root/dc79a1e30bd3043dce110d9bc189705e/sandbox
Target //packages/skeleton_pose_estimation/apps/openpose:openpose_inference up-to-date:
  bazel-bin/packages/skeleton_pose_estimation/apps/openpose/run_openpose_inference
  bazel-bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference
INFO: Elapsed time: 561.646s, Critical Path: 83.78s
INFO: 50 processes: 50 processwrapper-sandbox.
INFO: Build completed successfully, 599 total actions
INFO: Build completed successfully, 599 total actions
2020-07-01 10:43:17.617 INFO  engine/alice/tools/websight.cpp@166: Loading websight...
2020-07-01 10:43:17.617 WARN  engine/alice/backend/application_json_loader.cpp@174: This application does not have an explicit scheduler configuration. One will be autogenerated to the best of the system's abilities if possible.
2020-07-01 10:43:17.669 INFO  engine/alice/backend/redis_backend.cpp@40: Successfully connected to Redis server.

2020-07-01 10:43:17.873 WARN  engine/alice/backend/backend.cpp@201: This application does not have an execution group configuration. One will be autogenerated to the best of the systems abilities if possible.
2020-07-01 10:43:17.873 WARN  engine/gems/scheduler/scheduler.cpp@337: No default execution groups specified. Attempting to create scheduler configuration for 4 remaining cores. This may be non optimal for the system and application.
2020-07-01 10:43:17.873 INFO  engine/gems/scheduler/scheduler.cpp@290: Scheduler execution groups are:
2020-07-01 10:43:17.873 INFO  engine/gems/scheduler/scheduler.cpp@299: __BlockerGroup__: Cores = [3], Workers = No
2020-07-01 10:43:17.873 INFO  engine/gems/scheduler/scheduler.cpp@299: __WorkerGroup__: Cores = [0, 1, 2], Workers = Yes
2020-07-01 10:43:17.922 INFO  engine/alice/backend/modules.cpp@226: Loaded module 'packages/message_generators/libmessage_generators_module.so': Now has 63 components total
2020-07-01 10:43:20.995 INFO  engine/alice/backend/modules.cpp@226: Loaded module 'packages/sight/libsight_module.so': Now has 65 components total
2020-07-01 10:43:21.015 INFO  engine/alice/backend/modules.cpp@226: Loaded module 'packages/skeleton_pose_estimation/libskeleton_pose_estimation_module.so': Now has 66 components total
2020-07-01 10:43:21.767 INFO  engine/alice/backend/modules.cpp@226: Loaded module 'packages/viewers/libviewers_module.so': Now has 95 components total
2020-07-01 10:43:21.768 ERROR engine/alice/backend/modules.cpp@250: packages/ml/libml_module.so: /home/thoth/.cache/bazel/_bazel_root/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/ml/libml_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-01 10:43:21.768 ERROR engine/alice/backend/modules.cpp@250: packages/ml/libtensorrt_module.so: /home/thoth/.cache/bazel/_bazel_root/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/ml/libtensorrt_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-01 10:43:21.768 ERROR engine/alice/backend/modules.cpp@250: packages/perception/libperception_module.so: /home/thoth/.cache/bazel/_bazel_root/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/perception/libperception_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-01 10:43:21.768 PANIC engine/alice/backend/modules.cpp@252: Could not load all required modules for application
====================================================================================================
|                            Isaac application terminated unexpectedly                             |
====================================================================================================
#01 engine/alice/tools/main(+0x8aada) [0x55b1def12ada]
#02 engine/alice/tools/main(+0x172140) [0x55b1deffa140]
#03 engine/alice/tools/main(+0x1724b0) [0x55b1deffa4b0]
#04 /lib/x86_64-linux-gnu/libpthread.so.0(+0x12890) [0x7fb72ccda890]
#05 /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7) [0x7fb72c374e97]
#06 /lib/x86_64-linux-gnu/libc.so.6(abort+0x141) [0x7fb72c376801]
#07 engine/alice/tools/main(+0x96eae) [0x55b1def1eeae]
#08 engine/alice/tools/main(+0x4f5a5) [0x55b1deed75a5]
#09 engine/alice/tools/main(+0x51a92) [0x55b1deed9a92]
#10 engine/alice/tools/main(+0x51dfd) [0x55b1deed9dfd]
#11 engine/alice/tools/main(+0x26767) [0x55b1deeae767]
#12 /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fb72c357b97]
#13 engine/alice/tools/main(+0x2efda) [0x55b1deeb6fda]
====================================================================================================
Minidump written to: /tmp/6bd94096-ddfb-4314-3339d7ab-cc759efd.dmp
Aborted (core dumped)

Hi, I can confirm you can just run

and it will work, no need for training locally. I’m afraid I can’t offer any insight into the error though.

Hope this helps,
Felix

1 Like

thank you @felix.chippendale

Hi, @Planktos ,

There is no need to use “sudo” for “bazel run”. If it does cause problem, maybe re-installing Isaac SDK and related dependencies would help.

Reading the error information, likely some dependencies are missing. Please try again after installing all dependencies.

1 Like

If scrolled to the right, the error shows as:

undefined symbol: IsaacGatherComponentInfo

Which is likely related to either:

  • missing dependencies (please follow Isaac Documentation / installing pre-requisites);
  • running with sudo.

Note, sudo should not be used with bazel run. If sudo was used, the .cache/bazel folder (in the user’s home directory) may need to be deleted first, before attempting to build again. Normally it is safe to delete this folder.

On the question regarding the model. Two sample pre-trained model are provided. To train a model for specific resolution there is a training guide/manual available at: https://docs.nvidia.com/isaac/isaac/packages/skeleton_pose_estimation/doc/2Dskeleton_pose_estimation.html#training

1 Like

thanks @yangl and thanks @dchichkovd0qb3 (original pseudo by the way ;),
I followed your propositions, I did the following :

  • download Isaac SDK
  • build dependencies
  • ran apt upgrade
  • suppressed bazel cache folders
  • ran app without sudo

but unfortunately I still miss the following packages :

2020-07-02 04:49:51.764 ERROR engine/alice/backend/modules.cpp@250: packages/ml/libml_module.so: /home/thoth/.cache/bazel/_bazel_thoth/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/ml/libml_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-02 04:49:51.764 ERROR engine/alice/backend/modules.cpp@250: packages/ml/libtensorrt_module.so: /home/thoth/.cache/bazel/_bazel_thoth/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/ml/libtensorrt_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-02 04:49:51.764 ERROR engine/alice/backend/modules.cpp@250: packages/perception/libperception_module.so: /home/thoth/.cache/bazel/_bazel_thoth/dc79a1e30bd3043dce110d9bc189705e/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/perception/libperception_module.so: undefined symbol: IsaacGatherComponentInfo
2020-07-02 04:49:51.764 PANIC engine/alice/backend/modules.cpp@252: Could not load all required modules for application

Kind of odd that I have an issue loading lib perception because I can load it with others apps. Also I checked and I do have libtensorrt_module.so and others in the isaac folder so… I’m lost

Thank you for your precious help !

@Planktos
Reading the error message, I guess you may be missing CUDA and cuDNN. Those modules in the latest release requires CUDA 10.0 and cuDNN 7.6.
Please make sure they are installed and added to LD_LIBRARY_PATH env.

1 Like

Thank you @yangl I gonna try that