Nvidia official docker images issue on L40 S model without --priviliged option

We are using nvidia official docker images from below link on L40 S model server which is not working without --priviliged mode.

If I run below command , it works fine.
docker run --privileged --gpus all -it --rm -v /root/trt:/workspace/trt nvcr.io/nvidia/tensorrt:24.01-py3

but if I run same without privileged it throws below error on L40 Smodel server .
"ERROR: The NVIDIA Driver is present, but CUDA failed to initialize. GPU functionality will not be available.
[[ OS call failed or operation not supported on this OS (error 304) ]]

root@aa26b7e3f97b:/workspace#"

Please let us know why it throws above error without --privileged mode why it does not throws with --privileged mode and what is the difference here.