Public key authentication has been available since Nsight Systems 2021.5.
There is a known issue when connecting from Windows to Linux. The issue will be fixed in Nsight Systems 2022.5, and for a workaround please see this forum post: How to use Nvidia Nsight Systems remote session using SSH - #6 by mpopov