Openpilot is a L2+ ADAS system meaning it provides advanced LCA (Lane Centering Assist)、LDW (Lane Departure Warning)、ACC (Adaptive Cruise Control) and Driver Monitor for support cars.
The videos doesn’t really showcase everything due to my car’s limitation, but if you search “openpilot” you will see lots of other videos (such as https://www.youtube.com/watch?v=3Y67XKPmtY8)
I noticed that the steering happens automatically. Is that correct? Also, what happens when you clicked a couple of times on the screen and the colour for LCA changed between green & red?
First of all please keep it in mind the video example is running a customised version of openpilot. (adds tons of features)
In the stock openpilot, it has 2 mode you can choose from, lane line or laneless.
The lane line mode uses lane lines to predict drive path. (green)
The laneless mode is end to end drive path prediction. (red)
with the customised version you can change the mode on the fly, and there is an “AUTO” mode where it switch to laneless mode automatically when lane line prediction is lower than certain threshold.
laneless mode is better at predicting drive path when there is no lane line marks.
Thanks for your comment! I’m no expert on this but I have explicitly set to use CUDAExecutionProvider if it’s available. (and it does set to CUDAExecutionProvider :) )
if you only have a white panda then you probably need a giraffe so it can be set in between the ADAS CAMERA and CAR to intercept and modify the control messages.
you can still do it without a giraffe but you will need to figure out the wiring yourself.
The stock openpilot no longer supports white panda so you will need to modify selfdrive/boardd/panda.cc to bypass checking, I’ve already done it in the xnxpilot but I only tested in on bench so can’t guarantee anything.
Any camera will do I suppose as long as it’s 1080P or above. I’ve tried IMX219 and IMX477 but I ended up keeping IMX477 because of its lens. The one on IMX219 doesn’t have enough FoV (I think) and causing lots of calibration issues.
Hi @ricklan_nvidia , thanks for your great work
Now I am trying to do port xnxpilot on Jetson Orin Nano as client to connect to a Carla server via network, is that possible?
Thanks