Jetson Nano - Running OpenPose example gives a cuda check failed

angelo_v · June 28, 2019, 4:43am

I used this guide to install OpenPose on my Jetson Nano:

https://github.com/CMU-Perceptual-Computing-Lab/openpose/blob/master/doc/installation_jetson_tx2_jetpack3.3.md

after that, I ran this command from the openpose folder:

bash ./scripts/ubuntu/install_caffe_and_openpose_JetsonTX2_JetPack3.3.sh

I can see my webcam turn on, and I can see a small window labelled OpenPost 1.5.0 open. However, after a few moments, I see this following log:

angelo@angelo-desktop:~/openpose$ ./build/examples/openpose/openpose.bin -camera_resolution 640x480 -net_resolution 128x96
Starting OpenPose demo...
Configuring OpenPose...
Starting thread(s)...
Auto-detecting camera index... Detected and opened camera 0.
Auto-detecting all available GPUs... Detected 1 GPU(s), using 1 of them starting at GPU 0.

Error occurred on a thread. OpenPose closed all its threads and then propagated the error to the main thread. Error description:

Cuda check failed (48 vs. 0): no kernel image is available for execution on the device

Coming from:
- src/openpose/net/netCaffe.cpp:reshapeNetCaffe():112
- src/openpose/gpu/cuda.cpp:cudaCheck():42
- src/openpose/net/netCaffe.cpp:reshapeNetCaffe():117
- src/openpose/net/netCaffe.cpp:forwardPass():256
- src/openpose/pose/poseExtractorCaffe.cpp:forwardPass():626
- src/openpose/pose/poseExtractor.cpp:forwardPass():53
- ./include/openpose/pose/wPoseExtractor.hpp:work():107
- ./include/openpose/thread/worker.hpp:checkAndWork():93
- [All threads closed and control returned to main thread]
- src/openpose/utilities/errorAndLog.cpp:checkWorkerErrors():280
- ./include/openpose/thread/threadManager.hpp:stop():243
- ./include/openpose/thread/threadManager.hpp:exec():202
- ./include/openpose/wrapper/wrapper.hpp:exec():424

I’m not sure how to proceed. I know my camera works, I’ve tested it via Cheese, and the imagenet-camera and detectnet-camera examples (I had to set the default camera to 0 instead of -1).

Does anyone know how to go about this issue? Any help is very much appreciated.

EDIT
It seems that this might be related to the CUDA setup in Caffe?

The Jetson TX2 guide makes you run a script that installs Caffe and OpenPose. Now, what I’m thinking is that the CUDA_ARCH variable wasn’t changed to be compatible with the Nano? This is the following CUDA_ARCH for Jetson Nano:

CUDA_ARCH := -gencode arch=compute_53,code=sm_53 \
             -gencode arch=compute_53,code=compute_53

And I think that this is very much different from the TX2’s.

Right now, I’m not sure how to fix or edit the Makefile.config that the OpenPose script uses. I’ve also had my issues installing Caffe on the Nano as a standalone installation, and the OpenPose for TX2 script file was godsend. But it doesn’t seem to provide flexibility for configuring the Makefile.config.

Any leads are very much appreciated.

EDIT 2

There’s a Makefile.config.Ubuntu16_cuda9_JetsonTX2_JetPack33 file in the openpose/scripts/ubuntu folder. I’ll see what I can do here.

AastaLLL · June 28, 2019, 7:58am

Hi,

YES. Nano is with GPU capacity=53.
Please let us know the following status.

hHanks.

angelo_v · June 28, 2019, 12:46pm

Hello, I tried to update the Makefile.config.Ubuntu16_cuda9_JetsonTX2_JetPack33, and here’s how it looks right now:

## Refer to http://caffe.berkeleyvision.org/installation.html
# Contributions simplifying and improving our build system are welcome!

# CPU-only switch (comment to build without GPU support).
USE_CUDA := 1

# uncomment to disable IO dependencies and corresponding data layers
# USE_OPENCV := 0
# USE_LEVELDB := 0
# USE_LMDB := 0

# uncomment to allow MDB_NOLOCK when reading LMDB files (only if necessary)
#	You should not set this flag if you will be reading LMDBs with any
#	possibility of simultaneous read and write
# ALLOW_LMDB_NOLOCK := 1

# Uncomment if you're using OpenCV 3
OPENCV_VERSION := 3

# To customize your choice of compiler, uncomment and set the following.
# N.B. the default for Linux is g++ and the default for OSX is clang++
# CUSTOM_CXX := g++

# CUDA directory contains bin/ and lib/ directories that we need.
CUDA_DIR := /usr/local/cuda
# On Ubuntu 14.04, if cuda tools are installed via
# "sudo apt-get install nvidia-cuda-toolkit" then use this instead:
# CUDA_DIR := /usr

# CUDA architecture setting: going with all of them.
# For CUDA < 6.0, comment the *_50 through *_61 lines for compatibility.
# For CUDA < 8.0, comment the *_60 and *_61 lines for compatibility.
#CUDA_ARCH := -gencode arch=compute_30,code=sm_30 \
#		-gencode arch=compute_35,code=sm_35 \
#		-gencode arch=compute_50,code=sm_50 \
#		-gencode arch=compute_52,code=sm_52 \
#		-gencode arch=compute_60,code=sm_60 \
#		-gencode arch=compute_61,code=sm_61 \
#		-gencode arch=compute_61,code=compute_61
# Deprecated
# CUDA_ARCH := -gencode arch=compute_20,code=sm_20 \
# 		-gencode arch=compute_20,code=sm_21 \
# 		-gencode arch=compute_30,code=sm_30 \
# 		-gencode arch=compute_35,code=sm_35 \
# 		-gencode arch=compute_50,code=sm_50 \
# 		-gencode arch=compute_52,code=sm_52 \
# 		-gencode arch=compute_60,code=sm_60 \
# 		-gencode arch=compute_61,code=sm_61 \
# 		-gencode arch=compute_61,code=compute_61

# For Jetson Nano
CUDA_ARCH :=   -gencode arch=compute_53,code=sm_53 \
		-gencode arch=compute_53,code=compute_53

# Uncomment to enable op::Profiler
# PROFILER_ENABLED := 1

# DEEP_NET choice:
# caffe for Caffe (default and only option so far)
DEEP_NET := caffe

# Caffe directory
CAFFE_DIR := 3rdparty/caffe/distribute

# Faster GUI display
# WITH_OPENCV_WITH_OPENGL := 1
# OpenPose 3-D Reconstruction
# WITH_3D_RENDERER := 1
# WITH_CERES := 1
# WITH_FLIR_CAMERA := 1
# Eigen directory (Ceres)
# WITH_EIGEN := 1
EIGEN_DIR := /usr/include/eigen3/
# Spinnaker directory
SPINNAKER_DIR := /usr/include/spinnaker

# Whatever else you find you need goes here.
INCLUDE_DIRS := /usr/local/include /usr/include/hdf5/serial
LIBRARY_DIRS := /usr/local/lib /usr/lib /usr/lib/aarch64-linux-gnu /usr/lib/aarch64-linux-gnu/hdf5/serial

# If Homebrew is installed at a non standard location (for example your home directory) and you use it for general dependencies
# INCLUDE_DIRS += $(shell brew --prefix)/include
# LIBRARY_DIRS += $(shell brew --prefix)/lib

# Uncomment to use `pkg-config` to specify OpenCV library paths.
# (Usually not necessary -- OpenCV libraries are normally installed in one of the above $LIBRARY_DIRS.)
# USE_PKG_CONFIG := 1

BUILD_DIR := build
DISTRIBUTE_DIR := distribute

# Uncomment for debugging. Does not work on OSX due to https://github.com/BVLC/caffe/issues/171
# DEBUG := 1

# The ID of the GPU that 'make runtest' will use to run unit tests.
TEST_GPUID := 0

# enable pretty build (comment to see full commands)
Q ?= @

I’ve added in the GPU Capacity 53 in lines 51-53. I’ve also checked the the other lines and they seem to be correct.

I ran: bash ./install_caffe_and_openpose_JetsonTX2_JetPack3.3.sh

After that, I tried to run the openpose bin example again, but it still have the same Cuda error.

Now, I have two options.

Double check everything and make sure that the Makefile.config is correct.
Figure out how to install Caffe on Jetson Nano. This is an option because there’s a script called install_open_JetsonTX2_JetPack3.3.sh and I can just run that after installing Caffe.

Does anyone know how to do one of two, or both of those things? Any leads are appreciated.

1034031403 · June 30, 2019, 5:49am

I have same question after installing caffe on my jeston nano.
when I run the test (or something else), it shows that ‘check failed error: no kernel image is available for…’
PS: I followed the tutorial on this page : 玩转Jetson Nano（六）安装caffe_贝克汉鸭的博客-CSDN博客_jetson nano安装caffe , failed.

Walter_LIU · June 30, 2019, 2:51pm

HI, angelo_v

I have same error in my nano when compile using ‘./scripts/ubuntu/install_caffe_and_openpose_JetsonTX2_JetPack3.3.sh’ . When try compile using ‘./scripts/ubuntu/install_openpose’, this error no longer appears.

I guess that openpose_JetsonTX2_JetPack3.3 is not suitable for JetPack 4.2.

gryogor918 · July 1, 2019, 10:31am

Hello, Walter_LIU

Where did you find the script file ‘install_openpose’? I am also currently struggling with attempts to run openpose on Jetson Nano.

Walter_LIU · July 2, 2019, 2:15am

vi Makefile.config # see attachment
cmake -DCUDA_ARCH_BIN="53" -DCUDA_ARCH_PTX="53" -DUSE_CUDNN=1 .
make -j4

OPENOPSE,cmake,make.txt (60.6 KB)

Makefile.config for openopse.txt (3.42 KB)

angelo_v · July 2, 2019, 7:57am

How did you install caffe?

AastaLLL · July 9, 2019, 6:57am

Hi,

Here is a example to build Caffe on the Jetson platform.
https://devtalk.nvidia.com/default/topic/1044473/jetson-agx-xavier/caffe-installation-on-xavier/post/5299458/#5299458

The only difference is that Nano GPU architecture is sm=5.3.
Please update the CUDA_ARCH to this:

CUDA_ARCH := -gencode arch=compute_53,code=sm_53 \
             -gencode arch=compute_53,code=compute_53

Thanks.

Topic		Replies	Views
OpenCV, CUDA, Python with Jetson Nano Jetson Nano opencv	58	39223	October 14, 2021
How to to install cuda 10.0 on jetson nano separately ? Jetson Nano	27	31911	October 14, 2021
JetPack 4.6 Production Release with L4T 32.6.1 Jetson Nano	47	11939	March 10, 2022
install OpenCV for python3 in Jetson Nano Jetson Nano opencv	37	61361	October 14, 2021
run openpose on tx2 fail, who can told me what is wrong ? Jetson TX2	8	3202	October 18, 2021
Cross Compiling & Installation Issue Jetson TK1	17	4004	April 4, 2015
Installation failed - Jetson Orin Nano (sdkmanager) Jetson Orin Nano sdkm , reflash	8	753	December 22, 2023
Unable to install opencv with CUDA in Jetson Nano Jetson Nano	30	13548	October 18, 2021
OpenCV is not working with the image nvcr.io/nvidia/l4t-jetpack:r35.4.1 Jetson Nano opencv , docker , x11	7	1575	September 25, 2023
Jetson Nano upgrade and CUDA problem Jetson Nano reflash , cuda	4	929	June 18, 2023

Jetson Nano - Running OpenPose example gives a cuda check failed

Related topics