nvcamera-daemon constantly crashing using onboard CSI camera on brand new jetpack install

jfcarp · March 11, 2018, 2:10am

Hi All,

Thought I would post here before taking the device back to have it replaced, as something is bugged out. The flashing of 3.2 seemed fine. When cloning the jetson-inference tutorial and running anything that uses the onboard camera, all that is output is a green screen, followed by an internal system error indicating nvcamera-daemon crashed. It keeps having over and over and Ive spend upwards of 40 hours flashing this damn thing, just for the same result. The last time i used 3.1 hoping that would help, but no same exact result. nvcamera-daemon just crashes.

Now i am far from an expert on this, (yet), but here are the facts that I know for 100% certain:

We purchased a tx2 at work, flashed it with the 3.2 dev version before prod came out.
jetson-inference tutorials ran fine
I got one at home to test outside of work
Flashed exactly the same as the work one
nvcamera-daemon crashed with SEGENV or segmentation faults over and over and over…

So im guessing the problem is either with this hardware i received or something else as these tutorials should just work, is there anything i can perhaps try before going crazy and tossing it out the window?

from journalctl -fu nvcamera-daemon:

Mar 11 02:00:24 tegra-ubuntu nvcamera-daemon[1881]: Started nvcamera daemon…
Mar 11 02:00:24 tegra-ubuntu nvcamera-daemon[1881]: nvcamera-daemon listening for clients to connect…
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: nvcamera-daemon started new client thread = 547668828640
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) USB Sensors : 0 CSI Sensors : 1
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) getSource successful
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: Available Sensor modes :
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: W= 2592 H= 1944 FR= 30.000000
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: W= 2592 H= 1458 FR= 30.000000
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: W= 1280 H= 720 FR= 120.000000
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) CreateSession Successful
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Shared Memory: mmap address= 0x7f6c514000
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) getSource successful
Mar 11 02:02:23 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Sensor Metadata: Available : 0 Sensor Metadata: W : 2592 Sensor Metadata: H : 0
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) New Resolution W = 2592 H = 1458
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 91
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 92
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 94
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 95
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 97
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 98
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 100
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 101
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 103
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 104
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 106
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 107
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 109
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 110
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 112
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 113
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 115
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 116
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_BAYER fd = 118
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: RECEIVED REGISTER_BUFFER_META fd = 119
Mar 11 02:02:24 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) REQ_NVCAM_ENABLE_METADATA Enabled=0
Mar 11 02:02:25 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Error in calling capture= 3 result= 5
Mar 11 02:02:25 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Error in calling capture= 3 result= 5
Mar 11 02:02:25 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Error in calling capture= 3 result= 5
…(hundreds of these line before finally crashing)…
Mar 11 02:02:42 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Error in calling capture= 3 result= 5
Mar 11 02:02:42 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Error in calling capture= 3 result= 5
Mar 11 02:02:42 tegra-ubuntu nvcamera-daemon[1881]: (547668828640) Closing Client Connection Thread: nbytes 0
Mar 11 02:02:47 tegra-ubuntu systemd[1]: nvcamera-daemon.service: Main process exited, code=killed, status=11/SEGV
Mar 11 02:02:49 tegra-ubuntu systemd[1]: nvcamera-daemon.service: Unit entered failed state.
Mar 11 02:02:49 tegra-ubuntu systemd[1]: nvcamera-daemon.service: Failed with result ‘signal’.
Mar 11 02:02:49 tegra-ubuntu systemd[1]: nvcamera-daemon.service: Service hold-off time over, scheduling restart.
Mar 11 02:02:49 tegra-ubuntu systemd[1]: Stopped nvcamera daemon.
Mar 11 02:02:49 tegra-ubuntu systemd[1]: Started nvcamera daemon.
Mar 11 02:02:49 tegra-ubuntu nvcamera-daemon[1982]: Started nvcamera daemon…
Mar 11 02:02:49 tegra-ubuntu nvcamera-daemon[1982]: nvcamera-daemon listening for clients to connect.

jfcarp · March 11, 2018, 2:19am

Also too add…

here is what the imagenet-camera outputs:

seems normal in the beginning although all that is seen is a green screen output, no display… but then indicates issues with the camera…

imagenet-camera: 60.44922% class #885 (velvet)
class 0111 - 0.105042 (nematode, nematode worm, roundworm)
class 0310 - 0.021927 (ant, emmet, pismire)
class 0794 - 0.029282 (shower curtain)
class 0885 - 0.604492 (velvet)
class 0911 - 0.013885 (wool, woolen, woollen)
class 0948 - 0.027710 (Granny Smith)
imagenet-camera: 60.44922% class #885 (velvet)
class 0111 - 0.105042 (nematode, nematode worm, roundworm)
class 0310 - 0.021927 (ant, emmet, pismire)
class 0794 - 0.029282 (shower curtain)
class 0885 - 0.604492 (velvet)
class 0911 - 0.013885 (wool, woolen, woollen)
class 0948 - 0.027710 (Granny Smith)
imagenet-camera: 60.44922% class #885 (velvet)
class 0111 - 0.105042 (nematode, nematode worm, roundworm)
class 0310 - 0.021927 (ant, emmet, pismire)
class 0794 - 0.029282 (shower curtain)
class 0885 - 0.604492 (velvet)
class 0911 - 0.013885 (wool, woolen, woollen)
class 0948 - 0.027710 (Granny Smith)
imagenet-camera: 60.44922% class #885 (velvet)

imagenet-camera: failed to capture frame
imagenet-camera: failed to convert from NV12 to RGBA
imageNet::Classify( 0x(nil), 1280, 720 ) → invalid parameters
[cuda] cudaNormalizeRGBA((float4*)imgRGBA, make_float2(0.0f, 255.0f), (float4*)imgRGBA, make_float2(0.0f, 1.0f), camera->GetWidth(), camera->GetHeight())
[cuda] invalid device pointer (error 17) (hex 0x11)
[cuda] /home/nvidia/jetson-inference/imagenet-camera/imagenet-camera.cpp:194

imagenet-camera: failed to capture frame
imagenet-camera: failed to convert from NV12 to RGBA
imageNet::Classify( 0x(nil), 1280, 720 ) → invalid parameters
[cuda] cudaNormalizeRGBA((float4*)imgRGBA, make_float2(0.0f, 255.0f), (float4*)imgRGBA, make_float2(0.0f, 1.0f), camera->GetWidth(), camera->GetHeight())
[cuda] invalid device pointer (error 17) (hex 0x11)
[cuda] /home/nvidia/jetson-inference/imagenet-camera/imagenet-camera.cpp:194
class 0111 - 0.105042 (nematode, nematode worm, roundworm)
class 0310 - 0.021927 (ant, emmet, pismire)
class 0794 - 0.029282 (shower curtain)
class 0885 - 0.604492 (velvet)
class 0911 - 0.013885 (wool, woolen, woollen)
class 0948 - 0.027710 (Granny Smith)
imagenet-camera: 60.44922% class #885 (velvet)

imagenet-camera: failed to capture frame
imagenet-camera: failed to convert from NV12 to RGBA
imageNet::Classify( 0x(nil), 1280, 720 ) → invalid parameters
[cuda] cudaNormalizeRGBA((float4*)imgRGBA, make_float2(0.0f, 255.0f), (float4*)imgRGBA, make_float2(0.0f, 1.0f), camera->GetWidth(), camera->GetHeight())
[cuda] invalid device pointer (error 17) (hex 0x11)
[cuda] /home/nvidia/jetson-inference/imagenet-camera/imagenet-camera.cpp:194

jfcarp · March 11, 2018, 3:04am

and the same goes for gst-camera, detectnet-camera, or anything else… i dont understand what i could possibly be missing. It must be messed up hardware.

gst-camera: recieved new frame CPU=0x0x103a00000 GPU=0x0x103a00000
gst-camera: recieved new frame CPU=0x0x104400000 GPU=0x0x104400000
gst-camera: recieved new frame CPU=0x0x104e00000 GPU=0x0x104e00000
gst-camera: recieved new frame CPU=0x0x105200000 GPU=0x0x105200000
gst-camera: recieved new frame CPU=0x0x105800000 GPU=0x0x105800000
gst-camera: recieved new frame CPU=0x0x103c00000 GPU=0x0x103c00000
gst-camera: recieved new frame CPU=0x0x104200000 GPU=0x0x104200000
gst-camera: recieved new frame CPU=0x0x104800000 GPU=0x0x104800000
gst-camera: recieved new frame CPU=0x0x104e00000 GPU=0x0x104e00000
gst-camera: recieved new frame CPU=0x0x105800000 GPU=0x0x105800000
gst-camera: recieved new frame CPU=0x0x104600000 GPU=0x0x104600000
gst-camera: recieved new frame CPU=0x0x104800000 GPU=0x0x104800000
gst-camera: recieved new frame CPU=0x0x105800000 GPU=0x0x105800000
gst-camera: recieved new frame CPU=0x0x104400000 GPU=0x0x104400000
gst-camera: recieved new frame CPU=0x0x105000000 GPU=0x0x105000000
gst-camera: recieved new frame CPU=0x0x104800000 GPU=0x0x104800000
gst-camera: recieved new frame CPU=0x0x105000000 GPU=0x0x105000000
gst-camera: recieved new frame CPU=0x0x104400000 GPU=0x0x104400000
gst-camera: recieved new frame CPU=0x0x104000000 GPU=0x0x104000000
gst-camera: recieved new frame CPU=0x0x104e00000 GPU=0x0x104e00000
gst-camera: recieved new frame CPU=0x0x105800000 GPU=0x0x105800000
gst-camera: recieved new frame CPU=0x0x104000000 GPU=0x0x104000000
gst-camera: recieved new frame CPU=0x0x104800000 GPU=0x0x104800000
gst-camera: recieved new frame CPU=0x0x105400000 GPU=0x0x105400000
gst-camera: recieved new frame CPU=0x0x103e00000 GPU=0x0x103e00000
gst-camera: recieved new frame CPU=0x0x105000000 GPU=0x0x105000000
gst-camera: recieved new frame CPU=0x0x103a00000 GPU=0x0x103a00000
gst-camera: recieved new frame CPU=0x0x104600000 GPU=0x0x104600000
gst-camera: recieved new frame CPU=0x0x105000000 GPU=0x0x105000000
gst-camera: recieved new frame CPU=0x0x103e00000 GPU=0x0x103e00000
gst-camera: recieved new frame CPU=0x0x104800000 GPU=0x0x104800000
gst-camera: recieved new frame CPU=0x0x105000000 GPU=0x0x105000000
gst-camera: recieved new frame CPU=0x0x105800000 GPU=0x0x105800000
Received error from camera daemon…exiting…
Socket read error. Camera Daemon stopped functioning…
[gstreamer] gstreamer decoder onEOS

gst-camera: failed to capture frame
gst-camera: failed to convert from NV12 to RGBA
[cuda] cudaNormalizeRGBA((float4*)imgRGBA, make_float2(0.0f, 255.0f), (float4*)imgRGBA, make_float2(0.0f, 1.0f), camera->GetWidth(), camera->GetHeight())
[cuda] invalid device pointer (error 17) (hex 0x11)
[cuda] /home/nvidia/jetson-inference/util/camera/gst-camera/gst-camera.cpp:136

gst-camera: failed to capture frame
gst-camera: failed to convert from NV12 to RGBA
[cuda] cudaNormalizeRGBA((float4*)imgRGBA, make_float2(0.0f, 255.0f), (float4*)imgRGBA, make_float2(0.0f, 1.0f), camera->GetWidth(), camera->GetHeight())
[cuda] invalid device pointer (error 17) (hex 0x11)
[cuda] /home/nvidia/jetson-inference/util/camera/gst-camera/gst-camera.cpp:136
XIO: fatal IO error 11 (Resource temporarily unavailable) on X server “:0”
after 1265 requests (1265 known processed) with 15 events remaining.

jfcarp · March 11, 2018, 2:13pm

Now oddly, stopping the service with systemctl indicates the service is not loaded, although systemctl status indicates the service is active… some obvious disconnects here. Nothing has still be installed or loaded outside of jetpack, so no idea where to go from here.

nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ sudo systemctl stop nvmcamera-daemon
Failed to stop nvmcamera-daemon.service: Unit nvmcamera-daemon.service not loaded.
nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ systemctl status nvcamera-daemon
● nvcamera-daemon.service - nvcamera daemon
Loaded: loaded (/etc/systemd/system/nvcamera-daemon.service; en
Active: active (running) since Sun 2018-03-11 14:07:59 UTC; 3mi
Process: 3234 ExecStopPost=/bin/sleep 2 (code=exited, status=0/S
Main PID: 3237 (nvcamera-daemon)
CGroup: /system.slice/nvcamera-daemon.service
└─3237 /usr/sbin/nvcamera-daemon

Mar 11 14:07:59 tegra-ubuntu systemd[1]: Started nvcamera daemon.
Mar 11 14:07:59 tegra-ubuntu nvcamera-daemon[3237]: Started nvcame
Mar 11 14:07:59 tegra-ubuntu nvcamera-daemon[3237]: nvcamera-daemo
nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ sudo systemctl stop nvmcamera-daemon
Failed to stop nvmcamera-daemon.service: Unit nvmcamera-daemon.service not loaded.

jfcarp · March 11, 2018, 2:23pm

With the exported enablement of logs from other forums (have tried everything any other forum has said btw, but same results…)…

nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ export enableCamScfLogs=1
nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ export enableCamPclLogs=1

nvidia@tegra-ubuntu:~/jetson-inference/build/aarch64/bin$ sudo /usr/sbin/nvcamera-daemon
PCLHW_DTParser
PCLHW_DTParser
LoadOverridesFile: looking for override file [/Calib/camera_override.isp] 1/16LoadOverridesFile: looking for override file [/data/nvcam/settings/camera_overrides.isp] 2/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/camera_overrides.isp] 3/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/camera_overrides.isp] 4/16LoadOverridesFile: looking for override file [/data/nvcam/camera_overrides.isp] 5/16LoadOverridesFile: looking for override file [/data/nvcam/settings/e3326_front_P5V27C.isp] 6/16LoadOverridesFile: looking for override file [/opt/nvidia/nvcam/settings/e3326_front_P5V27C.isp] 7/16LoadOverridesFile: looking for override file [/var/nvidia/nvcam/settings/e3326_front_P5V27C.isp] 8/16---- imager: No override file found. ----
PowerServiceCore:handleRequests: timePassed = 722
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceEvent.cpp, function wait(), line 59)
Error: Camera HwEvents wait, this may indicate a hardware timeout occured,abort current/incoming cc
launchCC abort cc 104 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 105 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 106 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 107 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 108 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 109 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 110 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
Error: waitCsiFrameStart timeout guid 0
VI Stream Id = 2 Virtual Channel = 0
**VI Debug Registers
VI_CSIMUX_STAT_FRAME_8 = 0x00000000
VI_CSIMUX_FRAME_STATUS_0 = 0x00000000
VI_CFG_INTERRUPT_STATUS_0 = 0x3f000000
VI_ISPBUFA_ERROR_0 = 0x00000000
VI_FMLITE_ERROR_0 = 0x00000000
VI_NOTIFY_ERROR_0 = 0x00000000

CSI Stream Id = 2 Brick Id = 1
**CSI Debug Registers
CILA_INTR_STATUS_CILA[0x20400] = 0x00000109
CILB_INTR_STATUS_CILB[0x20c00] = 0x00000000
INTR_STATUS[0x200a4] = 0x00000000
INTR_STATUS[0x200a4] = 0x00000000
ERR_INTR_STATUS[0x200ac] = 0x00000000
ERROR_STATUS2VI_VC0[0x20094] = 0x00000000
ERROR_STATUS2VI_VC1[0x20098] = 0x00000000
ERROR_STATUS2VI_VC2[0x2009c] = 0x00000000
ERROR_STATUS2VI_VC3[0x200a0] = 0x00000000

Error: waitCsiFrameStart Something went wrong with waiting on frame start
launchCC abort cc 111 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 112 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 113 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 114 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 115 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 116 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 117 session 0
(hundreds of these lines…)…
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 465 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 466 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 467 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 468 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 469 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
launchCC abort cc 470 session 0
SCF: Error Timeout: (propagating from src/api/Session.cpp, function capture(), line 830)
SCF: Error Timeout: ISP Stats timed out! (in src/services/capture/CaptureServiceDeviceIsp.cpp, function waitIspStatsFinished(), line 785)
waitForIdleLocked remaining request 101
SCF: Error Timeout: waitForIdle() timed out (in src/api/Session.cpp, function waitForIdleLocked(), line 916)
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDeviceIsp.cpp, function waitCompletion(), line 676)
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function pause(), line 884)
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function handleCancelSourceRequests(), line 955)
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDevice.cpp, function issueCaptures(), line 983)
SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread CaptureScheduler frameStart failed (in src/common/Utils.cpp, function workerThread(), line 131)
SCF: Error Timeout: ISP port 0 timed out! (in src/services/capture/CaptureServiceDeviceIsp.cpp, function waitIspFrameEnd(), line 702)
Error: waitCsiFrameStart timeout guid 0
VI Stream Id = 2 Virtual Channel = 0
**VI Debug Registers
VI_CSIMUX_STAT_FRAME_8 = 0x00000000
VI_CSIMUX_FRAME_STATUS_0 = 0x00000000
VI_CFG_INTERRUPT_STATUS_0 = 0x3f000000
VI_ISPBUFA_ERROR_0 = 0x00000000
VI_FMLITE_ERROR_0 = 0x00000000
VI_NOTIFY_ERROR_0 = 0x00000000

CSI Stream Id = 2 Brick Id = 1
**CSI Debug Registers
CILA_INTR_STATUS_CILA[0x20400] = 0x00000109
CILB_INTR_STATUS_CILB[0x20c00] = 0x00000000
INTR_STATUS[0x200a4] = 0x00000000
INTR_STATUS[0x200a4] = 0x00000000
ERR_INTR_STATUS[0x200ac] = 0x00000000
ERROR_STATUS2VI_VC0[0x20094] = 0x00000000
ERROR_STATUS2VI_VC1[0x20098] = 0x00000000
ERROR_STATUS2VI_VC2[0x2009c] = 0x00000000
ERROR_STATUS2VI_VC3[0x200a0] = 0x00000000

SCF: Error Timeout: ISP port 1 timed out! (in src/services/capture/CaptureServiceDeviceIsp.cpp, function waitIspFrameEnd(), line 725)
SCF: Error Timeout: NvRmSyncWait failed (in src/api/Buffer.cpp, function cpuWaitFences(), line 489)
SCF: Error Timeout: (propagating from src/api/Buffer.cpp, function unassignFromCapture(), line 256)
SCF: Error Timeout: (propagating from src/components/CaptureContainerImpl.cpp, function returnBuffer(), line 373)
SCF: Error Timeout: (propagating from src/components/CaptureContainerImpl.cpp, function returnApiBuffers(), line 505)
SCF: Error Timeout: ISP port 2 timed out! (in src/services/capture/CaptureServiceDeviceIsp.cpp, function waitIspFrameEnd(), line 736)
SCF: Error Timeout: (propagating from src/services/capture/CaptureServiceDeviceIsp.cpp, function waitIspFrameEnd(), line 743)
SCF: Error Timeout: (propagating from src/common/Utils.cpp, function workerThread(), line 114)
SCF: Error Timeout: Worker thread IspHw frameComplete failed (in src/common/Utils.cpp, function workerThread(), line 131)
Segmentation fault (core dumped)

This is accompanied by a pop up indicating sudo crashed, although it was actually the nvcamera-daemon as usual.

jfcarp · March 11, 2018, 2:49pm

Well, now I just ran an apt-get upgrade, which basically destroyed the device, as it can no longer be logged into, that is, something wrong with x windows or something, so gonna flash it again with 3.2 i guess… no wander nvidia doesnt sell this thing direct to consumer so they can deflect liability when it doesnt work.

jfcarp · March 11, 2018, 3:35pm

Also, everytime 3.2 is flashed to the device, it stops, saying cuda could not be installed, install these packages manaually and press enter (which is not seen on 3.1 or was it seen when i flashed the work device with the 3.2 dev)… then when installing them manually, the system indicates the packages are unauthenticated…

jfcarp · March 11, 2018, 4:06pm

Alright,

Flashed 3.2 to target tx2 device… other than the above note on cuda package being unathenticated and needing installed manually the process seemed to go properly.
On tx2, cloned jetson-inference
Installed cmake on tx2
ran cmake …/ and make
ran ./imagenet-camera googlenet

same exact results… a green screen is displayed with the same output as above… then it crashes…

Mar 11 15:30:44 tegra-ubuntu nvcamera-daemon[1161]: Started nvcamera daemon…
Mar 11 15:30:44 tegra-ubuntu nvcamera-daemon[1161]: nvcamera-daemon listening for clients to connect…
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: nvcamera-daemon started new client thread = 548054381024
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) USB Sensors : 0 CSI Sensors : 1
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) getSource successful
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: Available Sensor modes :
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: W= 2592 H= 1944 FR= 30.000000
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: W= 2592 H= 1458 FR= 30.000000
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: W= 1280 H= 720 FR= 120.000000
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) CreateSession Successful
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Shared Memory: mmap address= 0x7f98041000
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) getSource successful
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Sensor Metadata: Available : 0 Sensor Metadata: W : 5184 Sensor Metadata: H : 0
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) New Resolution W = 2592 H = 1458
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 84
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 86
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 88
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 89
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 92
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 93
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 94
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 95
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 97
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 98
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 100
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 101
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 103
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 104
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 106
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 107
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 109
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 110
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_BAYER fd = 112
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: RECEIVED REGISTER_BUFFER_META fd = 113
Mar 11 16:04:14 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) REQ_NVCAM_ENABLE_METADATA Enabled=0
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5
Mar 11 16:04:16 tegra-ubuntu nvcamera-daemon[1161]: (548054381024) Error in calling capture= 3 result= 5

So what else can possibly be wrong here unless i bought a defective board for $700? Anyone?

jfcarp · March 11, 2018, 4:24pm

Also to note, something more deep seeded must be wrong here… as shouldnt nvidia-smi be available as a command by installing jetpack? maybe not… who knows…

JerryChang · March 19, 2018, 9:04am

hello jfcarp,

besides green screen issue from imagenet-camera application, could you please also run camera preview with below commands to check there’s no hardware issues.

gst-launch-1.0 nvcamerasrc sensor-id=0 ! 'video/x-raw(memory:NVMM),width=1920, height=1080, framerate=30/1, format=NV12' ! nvoverlaysink -ev

jfcarp · March 29, 2018, 4:39am

No gst command worked either, ended up returning it as defective. But, way to try and get a point for an answer, guess thats what y’all care about.