I use this command to capture image from a camera:
v4l2-ctl --set-fmt-video=width=640,height=480,pixelformat=“RG10” --set-ctrl bypass_mode=0 --device=/dev/video0 --stream-skip=100 --stream-count=1 --stream-mmap --stream-to=test.raw
How do I view this image file?
please refer to developer guide, Approaches for Validating and Testing the V4L2 Driver.
Thanks for the link. That’s very helpful in understanding the overall architecture. I tried this command:
gst-launch-1.0 v4l2src device=/dev/video0 ! ‘video/x-raw, format=“RG10”, width=640, height=480, framerate=20.0’ ! xvimagesink -ev
and get the following error message:
WARNING: erroneous pipeline: could not link v4l2src0 to xvimagesink0, neither element can handle caps video/x-raw, format=(string)RG10, width=(int)640, height=(int)480, framerate=(double)20
How do I fix this? And also the link does not give any info on how to view the .raw file if I have the image already captured. Thanks.
hello suwen.wang,
it looks you’re using a bayer sensor, you cannot use v4l2src plugin to to access the camera.
you may refer to Camera Architecture Stack. please go through libargus, or gstreamer plugin nvarguscamerasrc to use internal Jetson ISP.
for instance,
$ gst-launch-1.0 nvarguscamerasrc ! 'video/x-raw(memory:NVMM),framerate=30/1,format=NV12' ! nvvidconv ! 'video/x-raw, format=(string)I420, width=640, height=480' ! queue ! xvimagesink -e
Hi @JerryChang , thank for the follow up. I did try nvarguscamerasrc, however it does not work. If I issue the command:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw,framerate=30.0,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=“RG10”, width=1280, height=720’ ! queue ! xvimagesink -e
I get:
WARNING: erroneous pipeline: no element “nvarguscamerasrc”
When I check the version:
gst-inspect-1.0 --version
gst-inspect-1.0 version 1.20.3
GStreamer 1.20.3
https://launchpad.net/distros/ubuntu/+source/gstreamer1.0
And I followed the link in
for the installation of gstreamer. Am I missing any steps for the installation?
Thanks.
Suwen
hello suwen.wang,
here’s incorrect formats to the gst pipeline, nvvidconv convert the input sources for preview frames, we uses I420 by default.
hence, please give it a try with following command-line.
$ gst-launch-1.0 nvarguscamerasrc ! 'video/x-raw(memory:NVMM),framerate=30/1,format=NV12' ! nvvidconv ! 'video/x-raw, format=I420, width=1280, height=720' ! queue ! xvimagesink -e
Hi @JerryChang , I tried the command as is and still got the same error message:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),framerate=30/1,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=I420, width=1280, height=720’ ! queue ! xvimagesink -e
WARNING: erroneous pipeline: no element “nvarguscamerasrc”
or if I remove (memory:NVMM), I still have the same error:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw,framerate=30/1,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=I420, width=1280, height=720’ ! queue ! xvimagesink -e
WARNING: erroneous pipeline: no element “nvarguscamerasrc”
It seems the error is already occuring before it reaches the first pipe.
it looks like you have not yet install the MMAPI package.
please try… sudo apt install nvidia-l4t-jetson-multimedia-api
Hi @JerryChang I installed the package and still get the same error message. I rebooted the machine and still the same error message. Is there anything else I might be missing? Thanks.
hello suwen.wang,
may I double confirm the Jetpack release version you’re working with?
for instance, are you using SDK Manager to install the image?
Hi @JerryChang Yes, I used SDK Manager to install the image. Here’s what I get for the Jetpack version:
sudo apt-cache show nvidia-jetpack
[sudo] password for etlab:
Package: nvidia-jetpack
Version: 6.0-b52
Architecture: arm64
Maintainer: NVIDIA Corporation
Installed-Size: 194
Depends: nvidia-jetpack-runtime (= 6.0-b52), nvidia-jetpack-dev (= 6.0-b52)
Homepage: Jetson - Embedded AI Computing Platform | NVIDIA Developer
Priority: standard
Section: metapackages
Filename: pool/main/n/nvidia-jetpack/nvidia-jetpack_6.0-b52_arm64.deb
Size: 29294
SHA256: 01f3cfaed6f45ebabacbe5f2d4c3b74a296200ae928d68b97956470d54c4be98
SHA1: 950626b2b51381650e8ecb7e3b21f5e2e89cddb6
MD5sum: 1e58b6faa4b7a9695a1f5b0cb6035d85
Description: NVIDIA Jetpack Meta Package
Description-md5: ad1462289bdbc54909ae109d1d32c0a8
hello suwen.wang,
is it a developer preview version? if yes, please moving to JetPack 6.0/ l4t-r36.3 for confirmation.
BTW,
had you also ran apt-get install nvidia-jetpack or apt-get upgrade before? this might upgrade nvidia-l4t-gstreamer
Hi @JerryChang Thanks. After running both of the updating and upgrading commands, it is working better now. The version still shows 6.0-b52. How do I get it to 6.0-l4t-r36.3? Is there a single line command to do this?
Right now it no longer complains about nvarguscamerasrc. And it actually brings up a display window for the video. However, it gave me the following errors:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),framerate=30/1,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=(string)I420, width=640, height=480’ ! queue ! xvimagesink -e
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Pipeline is PREROLLED …
Setting pipeline to PLAYING …
New clock: GstSystemClock
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3840 x 2160 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 22.250000; Exposure Range min 13000, max 683709000;
GST_ARGUS: 1920 x 1080 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 22.250000; Exposure Range min 13000, max 683709000;
GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 1
Output Stream W = 1920 H = 1080
seconds to Run = 0
Frame Rate = 59.999999
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
ERROR: from element /GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0: TIMEOUT
Additional debug info:
Argus Error Status
nvbuf_utils: dmabuf_fd -1 mapped entry NOT found
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadExecute:694 Execution ended after 0:00:02.741355336
NvBufSurfaceFromFd Failed.
Setting pipeline to NULL …
Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, threadFunction:247 (propagating)
GST_ARGUS: Cleaning up
Freeing pipeline …
Hi @suwen.wang,
To upgrade to JP6.0, you’ll need to open the SDKmanager (update if you don’t have the latest version), then install JP6.0, and finally reflash your board.
Regarding your error, seems to be a timeout issue you can try adding the timeout property to the gst-launch command:
gst-launch-1.0 nvarguscamerasrc timeout=<SECONDS> ! ‘video/x-raw(memory:NVMM),framerate=30/1,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=(string)I420, width=640, height=480’ ! queue ! xvimagesink -e
FYI: Here is a wiki with some tools to visualize raw files. You could try to visualize the raw file you captured with v4l2-ctl command.
Best Regards,
Enrique Ramirez
Embedded SW Engineer at RidgeRun
Contact us: support@ridgerun.com
Developers wiki: https://developer.ridgerun.com
Website: www.ridgerun.com
hello suwen.wang,
this usually due to incorrect stream configuration, so that there’s failure reported for buffer setup.
please follow the suggest to have v4l2 standard IOCTL to verify your basic sensor streaming from low-level.
Hi @enrique.ramirez Thanks for the suggestions. The timeout seemed to be just a generic issue when the sensor is not responding properly. I tried the timeout option and it produced the same error as before.
Hi @JerryChang Here’s what I get when I check the sensor format:
v4l2-ctl --device /dev/video0 --list-formats-ext
ioctl: VIDIOC_ENUM_FMT
Type: Video Capture
[0]: 'RG10' (10-bit Bayer RGRG/GBGB)
Size: Discrete 3280x2464
Interval: Discrete 0.048s (21.000 fps)
Size: Discrete 3280x1848
Interval: Discrete 0.036s (28.000 fps)
Size: Discrete 1920x1080
Interval: Discrete 0.033s (30.000 fps)
Size: Discrete 1640x1232
Interval: Discrete 0.033s (30.000 fps)
Size: Discrete 1280x720
Interval: Discrete 0.017s (60.000 fps)
Is this normal?
hello suwen.wang,
--list-formats-ext it only check the driver for sensor capability,
please execute following in order to fetch the camera stream.
for instance,
$ v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100
Hi @JerryChang , OK, I ran the command and got:
v4l2-ctl -d /dev/video0 --set-fmt-video=width=1920,height=1080,pixelformat=RG10 --set-ctrl bypass_mode=0 --stream-mmap --stream-count=100
<<<<<<<<<<<<<<<<<<<<<<< 21.19 fps
<<<<<<<<<<<<<<<<<<<<< 21.19 fps
<<<<<<<<<<<<<<<<<<<<< 21.19 fps
<<<<<<<<<<<<<<<<<<<<< 21.19 fps
and got 21.19 fps even if I change the width and height to other values.
And the output I got from command:
gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM),framerate=2119/100,format=NV12’ ! nvvidconv ! ‘video/x-raw, format=(string)I420, width=640, height=480’ ! queue ! xvimagesink -e
gives:
GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 1
Output Stream W = 1920 H = 1080
seconds to Run = 0
Frame Rate = 59.999999
The frame rate is set to 59.99999. Is this the stream incompatibility you were referring to? Also, after I get the error message, the stream capture command no longer works. If I reboot the machine, the command would work again.
The other strange thing is that I have to plug the camera in cam1 port to see it as /dev/video0. If I plug it in the cam0 port, no camera shows up.
hello suwen.wang,
it looks some erroneous.
according to sensor format dumps, your 1920x1080 should streaming at 30-fps.
but, it’s outputting at 21-fps which seems sensor side used 3280x2464 sensor mode.
may I know what’s the complete failure logs.
anyways, please moving to the latest JP-6 release (i.e. JetPack 6.0) for verification.