Issue with Digital Twin for Fluid Simulation blueprint - GUI without graphics

Omniverse Core Platform
1

I am getting the same issue on any browser, the GUI comes up on my local IP address port 5273, but it is not populated with images. We are running on Ubuntu, docker deployment with 4 x L40S.

Image
Image1444×743 16 KB

Although everything seems to deploy, there are still some suspicious things in the ZMQ service logs.

Here are more details -

docker processes:

CONTAINER ID   IMAGE                                             COMMAND                  CREATED          STATUS          PORTS                                     NAMES
f974fd0e13c7   nvcr.io/nim/nvidia/domino-automotive-aero:1.0.0   "/bin/bash -c $SERVE…"   18 minutes ago   Up 18 minutes                                             digital-twins-for-fluid-simulation-aeronim-1
dc90306769fa   rtdt-kit-app:latest                               "./startup.sh"           18 minutes ago   Up 5 minutes                                              digital-twins-for-fluid-simulation-kit-1
0834a737a934   rtdt-web-app:latest                               "/docker-entrypoint.…"   18 minutes ago   Up 18 minutes   0.0.0.0:5273->80/tcp, [::]:5273->80/tcp   digital-twins-for-fluid-simulation-web-1
716b7a4e15ac   rtdt-zmq-service:latest                           "./run_zmq_services.…"   18 minutes ago   Up 8 minutes                                              digital-twins-for-fluid-simulation-zmq-1

logs for aero nim:


INFO:__main__:
INFO:__main__:I0724 00:11:36.082379 363 grpc_server.cc:2463] "Started GRPCInferenceService at 0.0.0.0:8001"
INFO:__main__:I0724 00:11:36.082571 363 http_server.cc:4695] "Started HTTPService at 0.0.0.0:8080"
INFO:__main__:I0724 00:11:36.164817 363 http_server.cc:358] "Started Metrics Service at 0.0.0.0:8002"

logs for RTDT kit:


2025-07-24 00:25:15 [14,772ms] [Info] [omni.usd] [MBVH]: raytracingMotion/enable: OFF, for indexForEngineInstance: 0
2025-07-24 00:25:15 [14,772ms] [Warning] [omni.kit.widget.viewport.widget] render_settings_changed called when omni.usd.UsdContext "" had no stage
2025-07-24 00:28:07 [187,230ms] [Info] [carb.livestream-rtc.plugin] NetStreamServer::onSignalingHeaders numHeaders: 12
main: thread_init: already added for thread
2025-07-24 00:28:07 [187,292ms] [Info] [carb.livestream-rtc.plugin] Stream server: connected stream 0x16bee960 on connection 0x7fe94c0117b0
2025-07-24 00:28:08 [187,778ms] [Info] [carb.livestream-rtc.plugin] onClientEventRaised: NVST_CCE_CONNECTED
2025-07-24 00:28:08 [187,778ms] [Info] [carb.livestream-rtc.plugin] Stream Server: stream1 0x7fe94c04c000 (type 4) started
2025-07-24 00:28:08 [187,778ms] [Info] [carb.livestream-rtc.plugin] Stream Server: stream2 0x7fe94c033950 (type 2) started
2025-07-24 00:28:08 [187,778ms] [Info] [carb.livestream-rtc.plugin] Stream Server: stream0 0x7fe94c0117b0 (type 1) started
2025-07-24 00:28:08 [187,778ms] [Info] [carb.livestream-rtc.plugin] All Streams connected.
2025-07-24 00:28:18 [197,661ms] [Info] [carb] Initializing plugin: carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:18 [197,665ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2025-07-24 00:28:18 [197,665ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:18 [197,671ms] [Info] [carb] Initializing plugin: carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:18 [197,671ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2025-07-24 00:28:18 [197,671ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:19 [198,819ms] [Info] [carb] Initializing plugin: carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:19 [198,819ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2025-07-24 00:28:19 [198,819ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:19 [198,820ms] [Info] [carb] Initializing plugin: carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)
2025-07-24 00:28:19 [198,821ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2025-07-24 00:28:19 [198,821ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.5]) (impl: carb.windowing-glfw.plugin)

logs for web application:


172.16.5.36 - - [24/Jul/2025:00:28:14 +0000] "GET /assets/cam04-DK4QaKqo.png HTTP/1.1" 304 0 "http://172.16.17.22:5273/?server=172.16.17.22&width=1920&height=1080&fps=60" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
172.16.5.36 - - [24/Jul/2025:00:28:14 +0000] "GET /assets/cam05-CIMwM4G0.png HTTP/1.1" 304 0 "http://172.16.17.22:5273/?server=172.16.17.22&width=1920&height=1080&fps=60" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
172.16.5.36 - - [24/Jul/2025:00:28:14 +0000] "GET /assets/cam06-B8Cx9gpC.png HTTP/1.1" 304 0 "http://172.16.17.22:5273/?server=172.16.17.22&width=1920&height=1080&fps=60" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"
172.16.5.36 - - [24/Jul/2025:00:28:14 +0000] "GET /assets/cam07-BAS1MMwd.png HTTP/1.1" 304 0 "http://172.16.17.22:5273/?server=172.16.17.22&width=1920&height=1080&fps=60" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36" "-"

logs for rtdt-zmq service:

Client has connected to tcp://*:5555...
Waiting for a config request...
Config request received...
Waiting for a config request...
Requesting config:  {'config': 25, 'id': 500, 'multip': 1.0, 'timestamp': 1753316472357783}
STARTING TRITION INFERENCE
Traceback (most recent call last):
  File "/workspace/service_network/main.py", line 71, in <module>
    asyncio.run(service_zmq.run(zmq_port, zmq_dir=zmq_tmp_dir))
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.10/site-packages/inference_service/service_zmq.py", line 121, in run
    await asyncio.gather(self._receive_config_requests(config_queue, context, address),
  File "/usr/local/lib/python3.10/site-packages/inference_service/service_zmq.py", line 66, in _receive_data
    file_index = self._request_data(config_request)
  File "/usr/local/lib/python3.10/site-packages/inference_service/service.py", line 219, in _request_data
    self._get_data_from_script(config_request)
  File "/usr/local/lib/python3.10/site-packages/inference_service/service.py", line 102, in _get_data_from_script
    triton_data = self.triton_inference(stl_path, stream_velocity, sample_points)
  File "/usr/local/lib/python3.10/site-packages/inference_service/service.py", line 288, in triton_inference
    vertices = stl_mesh.vertices.astype(np.float32)  # Nx3
AttributeError: 'Scene' object has no attribute 'vertices'
Starting service...
Current config: unnormalize dataset: False
                num_points: 1,255,000
                communication library: ZMQ
                config request port: 5555
                zmpq protocol: tcp
                tmp dir:
Data fields: ['coordinates', 'velocity', 'pressure', 'sdf', 'sdf_bounds']
Waiting for a config request...
Created publisher sockets on ports 5556 - 5560
Waiting for a config...

Thanks for any help!!

2

Just off the top of my head, and I will look into this more later, have you made sure you container either contains those graphic files LOCALLY inside the container OR it can access those graphics on your source drive, with correct access permissions and correct pathing? Have you successfully tested this outside a container, just as a local stream from a normal omniverse kit app ?

3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.