RTSP Stream from Virtual Camera

Hello All,

I have created a warehouse scene where I have installed a virtual camera. My only goal initially is to output an RTSP stream which can be viewed directly on VLC or any other streaming platform. For that I just need to generate a legitimate RTSP Link. I followed the following steps using replicator agent:

import omni.replicator.core as rep

render_products = []

render_products.append(rep.create.render_product('/World/Camera', resolution=(1024,1024)))

writer = rep.WriterRegistry.get("RTSPWriter")

writer.initialize(device=0, annotator="rgb", output_dir="rtsp://<my_rtsp_server_IP>:8554/RTSPWriter")
writer.attach(render_products)

print("published")

When I run this script using the IP of my RTSP server, the script runs successfully without any errors. However, when I check for the published topic pertaining to RTSPWriter on my RTSP server (MediaMTX), I cannot find any trace of it. I am also not able to view the stream anywhere (e.g. VLC). I have the following questions:

  • Do I also need to pass the output from Isaac Sim to FFMPEG?
  • Is there a possible problem with the firewall or authentication settings in the RTSP server?
  • Is there any other way to output a virtual camera stream from Isaac Sim? Is there any other protocol except RTSP?

Thanks

Please follow these instructions before using the RTSPWriter. Let us know if you still have issues afterwards.