Kernel module spi_sync latency

Could you apply the patch in the following thread to check if it could help in your case?
Orin NX SPI delay between transfers - #21 by KevinFFF