# IMX477 and IM219 not working on AGX Orin **URL:** \ **Category:** Jetson AGX Orin\ **Tags:** hw, kernel, gstreamer, camera\ **Created:** [May 12, 2023, 3:25pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145 "2023-05-12T15:25:49Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![wiihoffmann](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wiihoffmann](https://forums.developer.nvidia.com/u/wiihoffmann)\ **Post date:** [May 12, 2023, 3:25pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/1 "2023-05-12T15:25:49Z")
I am currently trying to get both the IMX477 and IMX219 based Raspberry Pi cameras working with the [Auvidea J20 board](https://auvidea.eu/product/70723/). (Note that I am not trying to get the IMX477 and IMX219 working simultaneously, but rather I am trying to get separate drivers for the IMX477 and IMX219 working.) Ridgerun has developed drivers for the [J20 + IMX477 on AGX Orin](https://developer.ridgerun.com/wiki/index.php?title=NVIDIA_Jetson_Orin%2FVideo_Capture_and_Display%2FCameras%2FIMX477_J20), however, I cannot get these drivers to work properly. Without the ISP file in place, these drivers work to produce images of poor quality. However, as soon as I use the ISP file, something breaks and I cannot get any images from the camera. Attached is the gstreamer error I see when trying to open the camera with the ISP file in place. I have also attached the results of running V4l2-compliance with the ISP file in place, and with the ISP file removed. Interestingly, the drivers produced by Auvidea for the IMX219 + J20 fail similarly. For the IMX219, the drivers fail with the same gstreamer timeout error that the IMX477 fails with. However, the IMX219 also fails without the ISP file. I am hoping that someone has some insight as to what could be causing this failure, and could point me in the right direction to solve it and get the cameras working. It is very important that I can get either the IMX219 or IMX477 (ideally both) working with the J20 board on AGX Orin. If you require more information, I am more than happy to provide it! J20 + IMX477 error: ![J20 IMX477 error](https://global.discourse-cdn.com/nvidia/original/3X/b/f/bf83b8a1a27c2402f54b49a46e43f922c04a3c44.jpeg) J20 + IMX219 error: ![J20 IMX219 error](https://global.discourse-cdn.com/nvidia/original/3X/5/0/50b54d3f7c74a7f7b0ce635c42eb4ad500db3eee.jpeg) J20 + IMX477 v4l2-compliance (no ISP): ![imx477 v4l2 compliance - no ISP](https://global.discourse-cdn.com/nvidia/original/3X/c/6/c60decfe2041d26c5d8001e8a8d6e25a895a22b1.jpeg) J20 + IMX477 v4l2-compliance (with ISP): ![imx477 v4l2 compliance with ISP](https://global.discourse-cdn.com/nvidia/original/3X/f/c/fce212e5296480aefcd03e31a3bca85ed6b1beb3.jpeg) ---
**Author:** ![JerryChang](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jerrychang/32/14043_2.png) [@JerryChang](https://forums.developer.nvidia.com/u/JerryChang)\ **Post date:** [May 15, 2023, 3:02am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/3 "2023-05-15T03:02:36Z")
hello wiihoffmann, first of all, rbpcv2-imx219 and rbpcv3-imx477 are not supported on AGX Orin by default. you may port the sensor device tree from Orin NX series, or, it’s done by vendor’s driver package. please note that, there’s `lane_polarity` configuration, which only necessary for Orin NX series, you may setting them as `0` when bring-up those on AGX Orin. let’s also narrow down the issue. please see-also [Applications Using V4L2 IOCTL Directly](https://docs.nvidia.com/jetson/archives/r35.3.1/DeveloperGuide/text/SD/CameraDevelopment/CameraSoftwareDevelopmentSolution.html#applications-using-v4l2-ioctl-directly), by using V4L2 IOCTL to verify basic camera functionality. if the basic camera functionality works, please setup a terminal to enable Argus daemon LOGs, please gather the details when trying to open the camera with the ISP file in place. for example, ```auto $ sudo su # pkill nvargus-daemon # export enableCamScfLogs=5 # nvargus-daemon or.. # nvargus-daemon 2>&1 | tee argus-output.log ``` ---
**Author:** ![wiihoffmann](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wiihoffmann](https://forums.developer.nvidia.com/u/wiihoffmann)\ **Post date:** [May 17, 2023, 5:13pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/4 "2023-05-17T17:13:57Z")
Hi @JerryChang, The drivers for the IMX477 on the J20 board have been developed by RidgeRun and are publicly available from [this Github repo](https://github.com/RidgeRun/NVIDIA-Jetson-IMX477-RPIV3/tree/jetpack-5.0.2/patches_orin). The driver works without the included ISP file in place, but fails as soon as the ISP file is used. I have attached three log files from the nvargus-daemon to this post; one without using the ISP file, one with the ISP file, and one with the ISP file and nvargus-deamon launched with the `enableCamInfiniteTimeout=1` flag. I see various errors and warnings in these log files, but I lack experience debugging ISP/driver issues, and thus I don’t fully understand the errors. To my untrained eye, it looks like the ISP is having issues mapping the module to an ISP config string, causing the V4l2 device to become unavailable, and the camera to be unopenable. If you could take a look at the logs and provide me with your thoughts, I would greatly appreciate it. If you require any more information, I am more than happy to provide it. Thanks! [argus-log-IMX477-no-ISP.log](https://forums.developer.nvidia.com/uploads/short-url/5mgRSHrrlXGDx0Za31AbCqheSaU.log) (236.4 KB) [argus-log-IMX477-with-ISP.log](https://forums.developer.nvidia.com/uploads/short-url/3hAgi2aitNU1a4rl7d2MS89hJeP.log) (22.6 KB) [argus-log-IMX477-with-ISP-inf-timout.log](https://forums.developer.nvidia.com/uploads/short-url/qHKRUB1PXjiVDgEpn9pI6iXtGBu.log) (6.5 KB) ---
**Author:** ![JerryChang](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jerrychang/32/14043_2.png) [@JerryChang](https://forums.developer.nvidia.com/u/JerryChang)\ **Post date:** [May 18, 2023, 3:26am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/5 "2023-05-18T03:26:22Z")
> [@wiihoffmann](#): > > The driver works without the included ISP file in place, but fails as soon as the ISP file is used. hello wiihoffmann, the ISP file contain the tuning parameter settings to fine-tune the image quality. according to error logs, _argus-log-IMX477-with-ISP.log_ it shows errors related to `Sensor could not be opened`, and then follow-by timeout errors which caused camera app malfunction. there’s an unique identifier to distinguish the ISP files. could you please double check the sensor device tree settings for the `badge` property. or.. you may review the ISP files, to modify the string of `Part#` for testing. anyways, where did you get the ISP file, who shared this ISP file. is this ever validated? note, you cannot apply the same ISP to different platforms, or different BSPs. ---
**Author:** ![wiihoffmann](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wiihoffmann](https://forums.developer.nvidia.com/u/wiihoffmann)\ **Post date:** [May 18, 2023, 4:45pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/6 "2023-05-18T16:45:26Z")
Hi @JerryChang, Thank you for your insight on this issue. Looking at the device tree settings, I see that the `badge` property for the three cameras are set to `imx477_bottomleft_477IMX`, `imx477_centerleft_477IMX`, and `imx477_topleft_477IMX`. As there are only three cameras in use, should these names be changed to `imx477_bottom_477IMX`, `imx477_top_477IMX`, and `imx477_center_477IMX`? Could these names being incorrect be the reason for my issue, or are they just convention? As for the camera\_overrides.isp file, can you tell me what I should be changing the `Part#` string to? Looking at working ISP files I have for other cameras isn’t providing much insight as they all have an empty string for the part number. I obtained the ISP file from the same repository as the driver patch file, and is available [here](https://github.com/RidgeRun/NVIDIA-Jetson-IMX477-RPIV3/tree/jetpack-5.0.2). I am not sure if the ISP file has been validated, but I assume it would have been if it is being released with the driver. Is there any way to tell if the ISP file I am using has been compiled for, or is compatible with the jetson board I am using (Jetson AGX Orin, jetpack 5.0.2)? ---
**Author:** ![JerryChang](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jerrychang/32/14043_2.png) [@JerryChang](https://forums.developer.nvidia.com/u/JerryChang)\ **Post date:** [May 19, 2023, 6:26am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/8 "2023-05-19T06:26:10Z")
> [@wiihoffmann](#): > > (Jetson AGX Orin, jetpack 5.0.2)? hello wiihoffmann, there’re some camera software stack bugs, you may see-also [Release Notes (r35.3.1)](https://docs.nvidia.com/jetson/archives/r35.3.1/ReleaseNotes/Jetson_Linux_Release_Notes_r35.3.1.pdf). is it possible for moving to latest release version (i.e. l4t-r35.3.1) for confirmation? ---
**Author:** ![wiihoffmann](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wiihoffmann](https://forums.developer.nvidia.com/u/wiihoffmann)\ **Post date:** [May 19, 2023, 7:31pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/9 "2023-05-19T19:31:21Z")
Hi @JerryChang, I don’t have drivers for the latest release version (r35.3.1), so moving to that release could be a rather time consuming venture. I would have to port the drivers myself, and troubleshoot that port while knowing that the driver may very well be faulty. What are the odds that moving to the latest release solves the problems I am seeing? If you think it will likely solve the problem, I will work to port the driver to the latest release version. Are there any other tests we can do to determine what the issue may be? ---
**Author:** ![JerryChang](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jerrychang/32/14043_2.png) [@JerryChang](https://forums.developer.nvidia.com/u/JerryChang)\ **Post date:** [May 22, 2023, 3:08am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/10 "2023-05-22T03:08:53Z")
hello wiihoffmann, can you root-cause the issue is happened only with ISP override file applied? once it’s without ISP override file, can you confirm the sensor functionality works normally? hence… let’s have some tests before you porting drivers to JP-5.1.1/ l4t-r35.3.1 for example, (1) please check you’ve clean all the cache files before sensor apply ISP. i.e. `/var/nvidia/nvcam/settings/*.bin` (2) where did you locate the ISP files. the path in comment messages looks incorrect. please put the files under… `/var/nvidia/nvcam/settings/camera_overrides.isp` (3) I’ve went through [github, camera\_overrides.isp](https://github.com/RidgeRun/NVIDIA-Jetson-IMX477-RPIV3/blob/jetpack-5.0.2/li-camera-calibration-files/camera_overrides.isp) very quickly. you may revise ISP as following for some furthre testing… (3.1) disable LSC… `lensShading.correction_type.enableLSC = FALSE;` (3.2) hacking the control points as 1… `lensShading.ctrlPointsCount = 1; ` (3.3) please double check your sensor device tree settings, the active dimension should be the same as… `lensShading.imageHeight = 3040;`, and `lensShading.imageWidth = 4056; ` moreover, it’s suggest to moving forward to the latest Jetpack release. you may also ping vendors for the latest driver, or patches to adapt the drivers with r35.3.1. there’re developer guides for your reference, for example, [Camera Driver Porting](https://docs.nvidia.com/jetson/archives/r35.3.1/DeveloperGuide/text/SD/CameraDevelopment/CameraDriverPorting.html), and [Sensor Software Driver Programming](https://docs.nvidia.com/jetson/archives/r35.3.1/DeveloperGuide/text/SD/CameraDevelopment/SensorSoftwareDriverProgramming.html). ---
**Author:** ![wiihoffmann](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@wiihoffmann](https://forums.developer.nvidia.com/u/wiihoffmann)\ **Post date:** [May 23, 2023, 4:28pm UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/11 "2023-05-23T16:28:30Z")
Hello @JerryChang, Disabling LSC and setting `lensShading.ctrlPointsCount = 1` has done the trick! I am now able to see a clear image from the camera, and with the proper colors. Thank you so much for your help! I now need to add a couple other resolution modes to the sensor driver, but I should be able to pull from other IMX477 drivers to help make this happen. ---
**Author:** ![JerryChang](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jerrychang/32/14043_2.png) [@JerryChang](https://forums.developer.nvidia.com/u/JerryChang)\ **Post date:** [May 24, 2023, 2:15am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/12 "2023-05-24T02:15:48Z")
> [@wiihoffmann](#): > > Disabling LSC and setting `lensShading.ctrlPointsCount = 1` has done the trick! I hello wiihoffmann, FYI, that’s known issue, and it’s fixed as mentioned in [Release Notes (r35.3.1)](https://docs.nvidia.com/jetson/archives/r35.3.1/ReleaseNotes/Jetson_Linux_Release_Notes_r35.3.1.pdf). re-cap as below.. ```auto [1.2. What’s New] Camera Support for Multi-Point Lens Shading Correction (LSC) on Orin. ``` ---
**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\ **Post date:** [June 13, 2023, 2:41am UTC](https://forums.developer.nvidia.com/t/imx477-and-im219-not-working-on-agx-orin/253145/14 "2023-06-13T02:41:42Z")
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.