Cosmos World Transfer 2.5 – lighting-only variation gives heavy color tint + sometimes geometry drift (minimal repro)

Omniverse Synthetic Data Generation (SDG)
1

Hello!

Please download the video files from here:

Setup

  • Windows 11 + WSL2 (Ubuntu 24.04) + Docker Desktop (GPU enabled)

  • Cosmos Transfer 2.5 container runs fine (--gpus all, nvidia-smi works)

Input
Isaac Sim clip with:

  • RGB video: /data/inputs/forklift_clips/clip_0000/rgb.mp4

  • Edges control: /data/inputs/forklift_clips/clip_0000/edges.mp4

Spec (edge control)
/workspace/specs/forklift_light_480.json

{
“name”: “forklift_light_480”,
“video_path”: “/data/inputs/forklift_clips/clip_0000/rgb.mp4”,
“edge”: {
“control_path”: “/data/inputs/forklift_clips/clip_0000/edges.mp4”,
“control_weight”: 1.0
}
}

Note: trying control_weight > 1.0 fails validation (<=1).

**One command to reproduce
**
OUT=“/data/outputs/forklift_light_minrepro_$(date +%Y%m%d_%H%M%S)”
mkdir -p “$OUT”

python examples/inference.py
-i /workspace/specs/forklift_light_480.json
-o “$OUT”
–prompt “Same exact warehouse scene and layout as the input video. Preserve geometry, walls, openings, racks, floor markings, and camera motion exactly. Only change the interior lighting: cool white industrial fluorescent lighting, slightly dimmer exposure, realistic shadows and reflections, natural colors. No weather effects.”
–negative-prompt “new door, doorway, window, opening, extra entrance, changed architecture, changed layout, moved wall, added room, removed wall, structural change, new objects, missing objects, text, watermark, logo, subtitles, cartoon, low quality, blurry, artifacts”
–seed 2026
–max-frames 480

Outputs

  • forklift_light_480.mp4 (generated)

  • forklift_light_480_control_edge.mp4 (control visualization)

Expected

  • Same scene + geometry + camera motion as input Isaac Sim RGB.

  • Only a realistic lighting change (exposure/color temperature/shadows), no stylization.

Actual

  • Output often looks like a global stylized color overlay (strong pink/orange/yellow tint), and lighting changes appear unnatural.

  • In earlier similar runs, I also saw geometry drift (e.g., added/changed doors/openings), despite “preserve layout” prompt + negative prompt + max control weight.

Question

  • Is this expected with the edge-controlled pipeline?

  • What’s the recommended way/spec/settings to get photoreal RGB lighting/weather variations while preserving geometry (e.g., different control type like depth/segmentation, combining controls, additional fidelity/identity parameters)?