That’s rather odd - the rl-pytorch library is included in the Isaac Gym files you downloaded, and the setup.py file should be automatically installing that as a file-based dependancy.
You can try manually installing rl-pytorch by navigating to rlgpu/rl-pytorch and running pip install -e . from there.