How can I speed up depth rendering?

After adding depth (16x16 resolution) in Issacgym, the training speed slowed down by 50x. Is there something wrong with how I’m using it here?