Now that I have reinstalled all the system (ubuntu 18.04 + isaac dependency script + Jetpack 4.3 host dependency with SDK manager) I get the following error about CUDA when running the script :
2020-07-07 18:01:44.146 PANIC engine/core/buffers/algorithm_cuda.cpp@55: Could not copy memory. Error: 35
2020-07-07 18:01:44.146 ERROR packages/ml/TensorRTInference.cpp@168: TRT ERROR: CUDA initialization failure with error 35. Please check your CUDA installation: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html
Some additional info about my sys :
NVRM version: NVIDIA UNIX x86_64 Kernel Module 450.36.06 Mon Jun 1 23:19:54 UTC 2020
GCC version: gcc version 7.5.0 (Ubuntu 7.5.0-3ubuntu1~18.04)
This is the full output :
thoth@bigC:~$ cd isaac
thoth@bigC:~/isaac$ bazel run packages/skeleton_pose_estimation/apps/openpose:openpose_inference
Starting local Bazel server and connecting to it...
INFO: Analyzed target //packages/skeleton_pose_estimation/apps/openpose:openpose_inference (93 packages loaded, 5730 targets configured).
INFO: Found 1 target...
INFO: Deleting stale sandbox base /home/thoth/.cache/bazel/_bazel_thoth/247cdffee7dc00d5b044836eab653a71/sandbox
Target //packages/skeleton_pose_estimation/apps/openpose:openpose_inference up-to-date:
bazel-bin/packages/skeleton_pose_estimation/apps/openpose/run_openpose_inference
bazel-bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference
INFO: Elapsed time: 89.257s, Critical Path: 11.88s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
INFO: Running command line: bazel-bin/packages/skeleton_pose_estimation/apps/opeINFO: Build completed successfully, 1 total action
2020-07-07 18:01:41.547 INFO engine/alice/tools/websight.cpp@166: Loading websight...
2020-07-07 18:01:41.548 WARN engine/alice/backend/application_json_loader.cpp@174: This application does not have an explicit scheduler configuration. One will be autogenerated to the best of the system's abilities if possible.
2020-07-07 18:01:41.685 INFO engine/alice/backend/redis_backend.cpp@40: Successfully connected to Redis server.
2020-07-07 18:01:41.690 WARN engine/alice/backend/backend.cpp@201: This application does not have an execution group configuration. One will be autogenerated to the best of the systems abilities if possible.
2020-07-07 18:01:41.691 WARN engine/gems/scheduler/scheduler.cpp@337: No default execution groups specified. Attempting to create scheduler configuration for 4 remaining cores. This may be non optimal for the system and application.
2020-07-07 18:01:41.691 INFO engine/gems/scheduler/scheduler.cpp@290: Scheduler execution groups are:
2020-07-07 18:01:41.691 INFO engine/gems/scheduler/scheduler.cpp@299: __BlockerGroup__: Cores = [3], Workers = No
2020-07-07 18:01:41.691 INFO engine/gems/scheduler/scheduler.cpp@299: __WorkerGroup__: Cores = [0, 1, 2], Workers = Yes
2020-07-07 18:01:41.702 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/message_generators/libmessage_generators_module.so': Now has 63 components total
2020-07-07 18:01:43.593 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/ml/libml_module.so': Now has 90 components total
2020-07-07 18:01:43.601 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/ml/libtensorrt_module.so': Now has 90 components total
2020-07-07 18:01:43.855 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/perception/libperception_module.so': Now has 103 components total
2020-07-07 18:01:43.889 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/sight/libsight_module.so': Now has 105 components total
2020-07-07 18:01:43.918 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/skeleton_pose_estimation/libskeleton_pose_estimation_module.so': Now has 106 components total
2020-07-07 18:01:43.928 INFO engine/alice/backend/modules.cpp@226: Loaded module 'packages/viewers/libviewers_module.so': Now has 135 components total
2020-07-07 18:01:43.928 DEBUG engine/alice/application.cpp@348: Loaded 135 components: isaac::alice::BufferAllocatorReport, isaac::alice::ChannelMonitor, isaac::alice::CheckJetsonPerformanceModel, isaac::alice::CheckOperatingSystem, isaac::alice::Config, isaac::alice::ConfigBridge, isaac::alice::ConfigLoader, isaac::alice::Failsafe, isaac::alice::FailsafeHeartbeat, isaac::alice::InteractiveMarkersBridge, isaac::alice::JsonToProto, isaac::alice::LifecycleReport, isaac::alice::MessageLedger, isaac::alice::MessagePassingReport, isaac::alice::NodeStatistics, isaac::alice::Pose, isaac::alice::Pose2Comparer, isaac::alice::PoseFromFile, isaac::alice::PoseInitializer, isaac::alice::PoseMessageInjector, isaac::alice::PoseToFile, isaac::alice::PoseToMessage, isaac::alice::PoseTree, isaac::alice::PoseTreeJsonBridge, isaac::alice::PoseTreeRelink, isaac::alice::ProtoToJson, isaac::alice::PyCodelet, isaac::alice::Random, isaac::alice::Recorder, isaac::alice::RecorderBridge, isaac::alice::Replay, isaac::alice::ReplayBridge, isaac::alice::Scheduling, isaac::alice::Sight, isaac::alice::SightChannelStatus, isaac::alice::Subgraph, isaac::alice::Subprocess, isaac::alice::TcpPublisher, isaac::alice::TcpSubscriber, isaac::alice::Throttle, isaac::alice::TimeOffset, isaac::alice::TimeSynchronizer, isaac::alice::UdpPublisher, isaac::alice::UdpSubscriber, isaac::map::Map, isaac::map::ObstacleAtlas, isaac::map::OccupancyGridMapLayer, isaac::map::PolygonMapLayer, isaac::map::Spline, isaac::map::WaypointMapLayer, isaac::message_generators::BinaryTensorGenerator, isaac::message_generators::CameraGenerator, isaac::message_generators::Detections2Generator, isaac::message_generators::Detections3Generator, isaac::message_generators::DifferentialBaseControlGenerator, isaac::message_generators::DifferentialBaseStateGenerator, isaac::message_generators::FlatscanGenerator, isaac::message_generators::HolonomicBaseControlGenerator, isaac::message_generators::ImageFeatureGenerator, isaac::message_generators::ImageLoader, isaac::message_generators::LatticeGenerator, isaac::message_generators::PanTiltStateGenerator, isaac::message_generators::Plan2Generator, isaac::message_generators::PointCloudGenerator, isaac::message_generators::PoseGenerator, isaac::message_generators::RangeScanGenerator, isaac::message_generators::TensorGenerator, isaac::message_generators::TrajectoryListGenerator, isaac::ml::BoundingBoxPadding, isaac::ml::ColorCameraEncoderCpu, isaac::ml::ColorCameraEncoderCuda, isaac::ml::ConfusionMatrixAggregator, isaac::ml::Detection3Encoder, isaac::ml::DetectionEncoder, isaac::ml::DetectionImageExtraction, isaac::ml::Detections3Comparer, isaac::ml::FilterDetectionsByLabel, isaac::ml::GenerateKittiDataset, isaac::ml::HeatmapDecoder, isaac::ml::HeatmapEncoder, isaac::ml::ImageDetectionExtraction, isaac::ml::LabelToBoundingBox, isaac::ml::ResizeDetections, isaac::ml::RigidbodyToDetections3, isaac::ml::SampleAccumulator, isaac::ml::SegmentationComparer, isaac::ml::SegmentationDecoder, isaac::ml::SegmentationEncoder, isaac::ml::Teleportation, isaac::ml::TensorArgMax, isaac::ml::TensorChannelSum, isaac::ml::TensorRTInference, isaac::ml::TensorReshape, isaac::ml::WaitUntilDetection, isaac::navigation::DistanceMap, isaac::navigation::NavigationMap, isaac::navigation::RangeScanModelClassic, isaac::navigation::RangeScanModelFlatloc, isaac::perception::BirdViewProjection, isaac::perception::ColorSpaceConverter, isaac::perception::CropAndDownsample, isaac::perception::CropAndDownsampleCuda, isaac::perception::EstimateGroundPlane, isaac::perception::EstimateObstacleDistances, isaac::perception::FiducialAsGoal, isaac::perception::ImageWarp, isaac::perception::PointCloudAccumulator, isaac::perception::RangeScanFlattening, isaac::perception::RangeToPointCloud, isaac::perception::ScanAccumulator, isaac::perception::StereoRectification, isaac::sight::AliceSight, isaac::sight::SightWidget, isaac::sight::WebsightServer, isaac::skeleton_pose_estimation::OpenPoseDecoder, isaac::viewers::BinaryMapViewer, isaac::viewers::ColorCameraViewer, isaac::viewers::DepthCameraViewer, isaac::viewers::Detections3Viewer, isaac::viewers::DetectionsViewer, isaac::viewers::FiducialsViewer, isaac::viewers::FlatscanViewer, isaac::viewers::GoalViewer, isaac::viewers::ImageKeypointViewer, isaac::viewers::LidarViewer, isaac::viewers::MosaicViewer, isaac::viewers::ObjectViewer, isaac::viewers::OccupancyMapViewer, isaac::viewers::PointCloudViewer, isaac::viewers::PoseTrailViewer, isaac::viewers::SegmentationCameraViewer, isaac::viewers::SegmentationViewer, isaac::viewers::SkeletonViewer, isaac::viewers::TensorViewer, isaac::viewers::TrajectoryListViewer,
2020-07-07 18:01:43.929 WARN engine/alice/application.cpp@164: The function Application::findComponentByName is deprecated. Please use `getNodeComponentOrNull` instead. Note that the new method requires a node name instead of a component name. (argument: 'websight/isaac.sight.AliceSight')
2020-07-07 18:01:43.929 INFO engine/alice/application.cpp@255: Starting application 'openpose_inference' (instance UUID: '25be8d76-c06b-11ea-8fb8-c9ba49b8b330') ...
2020-07-07 18:01:43.929 DEBUG engine/gems/scheduler/execution_groups.cpp@476: Launching 0 pre-start job(s)
2020-07-07 18:01:43.929 DEBUG engine/gems/scheduler/execution_groups.cpp@485: Replaying 0 pre-start event(s)
2020-07-07 18:01:43.929 DEBUG engine/gems/scheduler/execution_groups.cpp@476: Launching 0 pre-start job(s)
2020-07-07 18:01:43.929 DEBUG engine/gems/scheduler/execution_groups.cpp@485: Replaying 0 pre-start event(s)
2020-07-07 18:01:43.929 INFO engine/alice/backend/asio_backend.cpp@33: Starting ASIO service
2020-07-07 18:01:43.951 INFO packages/sight/WebsightServer.cpp@216: Sight webserver is loaded
2020-07-07 18:01:43.951 INFO packages/sight/WebsightServer.cpp@217: Please open Chrome Browser and navigate to http://<ip address>:3000
2020-07-07 18:01:43.951 WARN engine/alice/backend/codelet_canister.cpp@225: Codelet 'websight/isaac.sight.AliceSight' was not added to scheduler because no tick method is specified.
2020-07-07 18:01:43.951 WARN engine/alice/components/Codelet.cpp@53: Function deprecated. Set tick_period to the desired tick paramater
2020-07-07 18:01:43.954 WARN engine/alice/backend/codelet_canister.cpp@225: Codelet '_check_operating_system/isaac.alice.CheckOperatingSystem' was not added to scheduler because no tick method is specified.
2020-07-07 18:01:43.954 WARN engine/alice/components/Codelet.cpp@53: Function deprecated. Set tick_period to the desired tick paramater
2020-07-07 18:01:43.954 WARN engine/alice/components/Codelet.cpp@53: Function deprecated. Set tick_period to the desired tick paramater
2020-07-07 18:01:44.080 WARN packages/ml/TensorRTInference.cpp@427: Could not read from .plan (path is set to 'external/openpose_model/ix-networks-openpose.plan'). Falling back to building the .plan from frozen model external/openpose_model/ix-networks-openpose.uff. Note: this process may take up to several minutes.
2020-07-07 18:01:44.146 PANIC engine/core/buffers/algorithm_cuda.cpp@55: Could not copy memory. Error: 35
2020-07-07 18:01:44.146 ERROR packages/ml/TensorRTInference.cpp@168: TRT ERROR: CUDA initialization failure with error 35. Please check your CUDA installation: http://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html
====================================================================================================
| Isaac application terminated unexpectedly |
====================================================================================================
#01 engine/alice/tools/main(+0x8aada) [0x5611f1525ada]
#02 engine/alice/tools/main(+0x172140) [0x5611f160d140]
#03 engine/alice/tools/main(+0x1724b0) [0x5611f160d4b0]
#04 /lib/x86_64-linux-gnu/libpthread.so.0(+0x128a0) [0x7f5a3744a8a0]
#05 /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7) [0x7f5a36ae4f47]
#06 /lib/x86_64-linux-gnu/libc.so.6(abort+0x141) [0x7f5a36ae68b1]
#07 isaac::CopyMatrixRaw(void const*, unsigned long, isaac::BufferStorageMode, void*, unsigned long, isaac::BufferStorageMode, unsigned long, unsigned long) /home/thoth/.cache/bazel/_bazel_thoth/247cdffee7dc00d5b044836eab653a71/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/message_generators/libmessage_generators_module.so(_ZN5isaac13CopyMatrixRawEPKvmNS_17BufferStorageModeEPvmS2_mm+0xa3) [0x7f5a36225103]
#08 void isaac::Copy<unsigned char, 3, isaac::Buffer<isaac::detail::TaggedPointer<unsigned char, std::integral_constant<isaac::BufferStorageMode, (isaac::BufferStorageMode)0> >, isaac::CpuAllocator>, isaac::Buffer<isaac::detail::TaggedPointer<unsigned char, std::integral_constant<isaac::BufferStorageMode, (isaac::BufferStorageMode)0> >, isaac::CpuAllocator> >(isaac::ImageBase<unsigned char, 3, isaac::Buffer<isaac::detail::TaggedPointer<unsigned char, std::integral_constant<isaac::BufferStorageMode, (isaac::BufferStorageMode)0> >, isaac::CpuAllocator> > const&, isaac::ImageBase<unsigned char, 3, isaac::Buffer<isaac::detail::TaggedPointer<unsigned char, std::integral_constant<isaac::BufferStorageMode, (isaac::BufferStorageMode)0> >, isaac::CpuAllocator> >&) /home/thoth/.cache/bazel/_bazel_thoth/247cdffee7dc00d5b044836eab653a71/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/message_generators/libmessage_generators_module.so(_ZN5isaac4CopyIhLi3ENS_6BufferINS_6detail13TaggedPointerIhSt17integral_constantINS_17BufferStorageModeELS5_0EEEENS_12CpuAllocatorEEES9_EEvRKNS_9ImageBaseIT_XT0_ET1_EERNSA_ISB_XT0_ET2_EE+0x41) [0x7f5a35fd60a1]
#09 isaac::message_generators::ImageLoader::tick() /home/thoth/.cache/bazel/_bazel_thoth/247cdffee7dc00d5b044836eab653a71/execroot/com_nvidia_isaac/bazel-out/k8-opt/bin/packages/skeleton_pose_estimation/apps/openpose/openpose_inference.runfiles/com_nvidia_isaac//packages/message_generators/libmessage_generators_module.so(_ZN5isaac18message_generators11ImageLoader4tickEv+0x8e6) [0x7f5a35fd96b6]
#10 engine/alice/tools/main(+0x82dc8) [0x5611f151ddc8]
#11 engine/alice/tools/main(+0x14f566) [0x5611f15ea566]
#12 engine/alice/tools/main(+0x2d4dc) [0x5611f14c84dc]
#13 /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xbd6df) [0x7f5a3716c6df]
#14 /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f5a3743f6db]
#15 /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7f5a36bc7a3f]
====================================================================================================
Minidump written to: /tmp/fe310f8c-bce2-40b7-a55c6b82-b146fc4d.dmp
Aborted (core dumped)
Thank you, your help is so precious !