NVCC and sysroot flag

I cross compile code for Xavier (aarch64) from x86 linux system. the nvcc linker search the libararies in the host root path (/) instead the target path (i have the target file system copy to folder in my host).
I tries to use the --sysroot flag but it is not working.
Please help!!!