Yes, as I said, CSI cameras are generally a better option if you want low latency.
There are multiple reasons for this, including that “webcams” often run at low frame rates (like 30 fps) and often run at USB 2.0 speeds, which cause transmission of each frame to itself take a lot of time.
I have generally found less buffering and latency in CSI camera setups, although of course the specifics still matter.
Go for lower latency and higher frame rate to reduce latency, btw. Trying to do real-time analytics with a moving camera that captures 4k at 30 Hz is not helpful, both because of latency, and because of the excessive image skew you get from the rolling shutter during that time. Aim for 120 Hz if you can. Frame rate is more important than resolution, most of the time!