It is an issue with the 50 series hardware and driver and the RTX Renderer, at this time. We have added a fix for this in kit 106.5.3, which should be in the next release of Isaac Sim. Right now Isaac Sim 4.5 is based on kit 106.5.0.
Your alternative NOW, is to switch to Kit 107.0.3 of Composer available on Git / GitHub
