Thanks for your information.
With the 3 config params changed in default tegra_defconfig iam able to solve this error
“Internal error: Accessing user space memory outside uaccess.h routines: 96000005 [#1] PREEMPT SMP”.
CONFIG_ARM64_SW_TTBR0_PAN is not set
CONFIG_ARM64_LSE_ATOMICS is not set
CONFIG_ARM64_UAO is not set
If we enable this then what driver code need to be modified i will check later.