could not find Python headers

I am trying to use python demo-apps in deepstream, i head over to the https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/master/HOWTO.md and followed the instructions, I don’t know how to check if GST Python is installed on my jetson, so I followed the installation instruction, as soon I executed below line:

./autogen.sh PYTHON=python3

It gives an error:

+ passing argument PYTHON=python3 to configure
+ options passed to configure:  PYTHON=python3
+ check for build tools
  checking for autoconf >= 2.60 ... found 2.69, ok.
  checking for automake >= 1.10 ... found 1.15.1, ok.
  checking for libtoolize >= 1.5.0 ... found 2.4.6, ok.
  checking for pkg-config >= 0.8.0 ... found 0.29.1, ok.
+ running libtoolize --copy --force...
libtoolize: putting auxiliary files in '.'.
libtoolize: copying file './ltmain.sh'
libtoolize: putting macros in 'm4'.
libtoolize: copying file 'm4/libtool.m4'
libtoolize: copying file 'm4/ltoptions.m4'
libtoolize: copying file 'm4/ltsugar.m4'
libtoolize: copying file 'm4/ltversion.m4'
libtoolize: copying file 'm4/lt~obsolete.m4'
libtoolize: Consider adding 'AC_CONFIG_MACRO_DIRS([m4])' to configure.ac,
libtoolize: and rerunning libtoolize and aclocal.
+ running aclocal -I m4 -I common/m4 ...
+ running autoheader ...
+ running autoconf ...
+ running automake -a -c -Wno-portability...
configure.ac:47: installing './compile'
configure.ac:13: installing './missing'
gi/overrides/Makefile.am: installing './depcomp'
plugin/Makefile.am:3: warning: 'INCLUDES' is the old name for 'AM_CPPFLAGS' (or '*_CPPFLAGS')
+ running configure ... 
  ./configure default flags: --enable-maintainer-mode
  ./configure external flags:  PYTHON=python3

checking build system type... aarch64-unknown-linux-gnu
checking host system type... aarch64-unknown-linux-gnu
checking target system type... aarch64-unknown-linux-gnu
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... /bin/mkdir -p
checking for gawk... no
checking for mawk... mawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking whether UID '1000' is supported by ustar format... yes
checking whether GID '1000' is supported by ustar format... yes
checking how to create a ustar tar archive... gnutar
checking nano version... 0 (release)
checking whether to enable maintainer-specific portions of Makefiles... yes
checking whether make supports nested variables... (cached) yes
checking how to print strings... printf
checking for style of include used by make... GNU
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking whether gcc understands -c and -o together... yes
checking dependency style of gcc... gcc3
checking for a sed that does not truncate output... /bin/sed
checking for grep that handles long lines and -e... /bin/grep
checking for egrep... /bin/grep -E
checking for fgrep... /bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert aarch64-unknown-linux-gnu file names to aarch64-unknown-linux-gnu format... func_convert_file_noop
checking how to convert aarch64-unknown-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @FILE support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /bin/dd
checking how to truncate binary pipes... /bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking how to run the C preprocessor... gcc -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking for shl_load... no
checking for shl_load in -ldld... no
checking for dlopen... no
checking for dlopen in -ldl... yes
checking whether a program can dlopen itself... yes
checking whether a statically linked program can dlopen itself... no
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... no
checking for gcc... (cached) gcc
checking whether we are using the GNU C compiler... (cached) yes
checking whether gcc accepts -g... (cached) yes
checking for gcc option to accept ISO C89... (cached) none needed
checking whether gcc understands -c and -o together... (cached) yes
checking dependency style of gcc... (cached) gcc3
checking for gcc option to accept ISO C99... none needed
checking for gcc option to accept ISO Standard C... (cached) none needed
checking for python version... 3.6
checking for python platform... linux
checking for python script directory... ${prefix}/lib/python3.6/site-packages
checking for python extension module directory... ${exec_prefix}/lib/python3.6/site-packages
checking for python >= 2.7... checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for GST... yes
checking for PYGOBJECT... yes
okay
checking for headers required to compile python extensions... not found
configure: error: could not find Python headers
  configure failed

How can I fix this?

Even after this, I coouldn’t stopped myself and tried to follow the instruction (in hope that GST Python might be already installed, after flashing with Nvidia SDK Manager) but then again i met with some new errors:

python3 deepstream_test_1.py /opt/nvidia/deepstream/deepstream-4.0/samples/streams/sample_1080p_h264.mp4
Creating Pipeline 
 
Creating Source 
 
Creating H264Parser 

Creating Decoder 

Creating EGLSink 

Playing file /opt/nvidia/deepstream/deepstream-4.0/samples/streams/sample_1080p_h264.mp4 
Adding elements to Pipeline 

Linking elements in the Pipeline 

Starting pipeline 

Using winsys: x11 
Opening in BLOCKING MODE 
Creating LL OSD context new
0:00:01.608424914  5646     0x1ff16b20 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:00:27.188344281  5646     0x1ff16b20 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /opt/nvidia/deepstream/deepstream-4.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_int8.engine
Error: gst-stream-error-quark: Internal data stream error. (1): gstbaseparse.c(3611): gst_base_parse_loop (): /GstPipeline:pipeline0/GstH264Parse:h264-parser:
streaming stopped, reason not-negotiated (-4)

Hi Nitin,
For the error from “./autogen.sh PYTHON=python3”, please install python3-dev and libpython3-dev, i.e.

$ sudo apt-get install python3-dev libpython3-dev

Hey mchi thanks for the help, that worked for installing gst-python (how do I confirm).
But as I am testing python-demo application now it has some other error:

python deepstream_test_1.py ../../../../samples/streams/sample_1080p_h264.mp4
Traceback (most recent call last):
  File "deepstream_test_1.py", line 33, in <module>
    import pyds
ImportError: ../../bindings/jetson/pyds.so: undefined symbol: PyInstanceMethod_Type

I checked manually for pyds.so file it is present inside bindings folder:

>> ls ../../bindings/jetson/
pyds.so

Any clue?

you need to download DeepStream Python Apps and Bindings package - “ds_pybind_0.5.tbz2” from https://developer.nvidia.com/deepstream-download, and untar it as mentioned in HOW-TO -https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/master/HOWTO.md.

FYI - https://devtalk.nvidia.com/default/topic/1066912/deepstream-sdk/deepstream-now-supports-python-/

Yes, i downloaded from the same Link.
And i also followed the above mentioned forum link before submitting any issues here.
One thing that i missed in the last comment is I should have used python3 in place of python.
this is the new error:

python3 deepstream_test_1.py ../../../../samples/streams/sample_1080p_h264.mp4 
Creating Pipeline 
 
Creating Source 
 
Creating H264Parser 

Creating Decoder 

Creating EGLSink 

Playing file ../../../../samples/streams/sample_1080p_h264.mp4 
Adding elements to Pipeline 

Linking elements in the Pipeline 

Starting pipeline 


Using winsys: x11 
Opening in BLOCKING MODE 
Creating LL OSD context new
0:00:00.739775449 29098     0x16952720 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]:initialize(): Trying to create engine from model files
0:00:27.902318202 29098     0x16952720 INFO                 nvinfer gstnvinfer.cpp:519:gst_nvinfer_logger:<primary-inference> NvDsInferContext[UID 1]:generateTRTModel(): Storing the serialized cuda engine to file at /opt/nvidia/deepstream/deepstream-4.0/samples/models/Primary_Detector/resnet10.caffemodel_b1_int8.engine
Error: gst-stream-error-quark: Internal data stream error. (1): gstbaseparse.c(3611): gst_base_parse_loop

I am running the commands into Agx Xavier (with mouse/keyboard/display attached) directly.

Hi Nitin,
As zhliunycm2 mentioned in the link I shared (pasted below)

The deepstream_test_1.py only supports H264 elementary stream (due to H264 parser used https://github.com/NVIDIA-AI-IOT/deepstream_python_apps/blob/43861859fa8aca1f17cf752a208c12b0c8b7d287/apps/deepstream-test1/deepstream_test_1.py#L150). For mp4 support, please see deepstream_test_3.py.

You should use the h264 file - …/…/…/…/samples/streams/sample_720p.h264 as test file.

1 Like

Thanks a lot, now it works as expected.
Now I’ll try to add my own bells and whistles to deepstream applications as with python it is going to be fun.
I’ll keep updating if any further error occurs.