When I run the following command :
python train.py capture_video=True capture_video_freq=1500 capture_video_len=100 force_render=False
It doesn’t give me a video. It only outputs this:
{“step_id”: 5000, “episode_id”: 8, “content_type”: “video/mp4”, “empty”: true, “broken”: true}
Why and how i can get a video?
More info on the errors:
/home/aliemre/anaconda3/envs/eureka/lib/python3.8/site-packages/gym/wrappers/monitoring/video_recorder.py:165: UserWarning: e[33mWARN: Env returned None on render(). Disabling further rendering for video recorder by marking as disabled: path=/home/aliemre/Eureka/eureka/outputs/eureka/2023-12-12_18-49-37/policy-2023-12-12_18-54-52/videos/AntGPT_2023-12-12_18-54-53/rl-video-step-10000.mp4 metadata_path=/home/aliemre/Eureka/eureka/outputs/eureka/2023-12-12_18-49-37/policy-2023-12-12_18-54-52/videos/AntGPT_2023-12-12_18-54-53/rl-video-step-10000.meta.jsone[0m
logger.warn(
/home/aliemre/anaconda3/envs/eureka/lib/python3.8/site-packages/gym/wrappers/monitoring/video_recorder.py:43: DeprecationWarning: e[33mWARN: env.metadata["render.modes"] is marked as deprecated and will be replaced with env.metadata[“render_modes”]see https://github.com/openai/gym/pull/2654 for more detailse[0m logger.deprecation( /home/aliemre/anaconda3/envs/eureka/lib/python3.8/site-packages/gym/wrappers/monitoring/video_recorder.py:115: DeprecationWarning: e[33mWARN:env.metadata[“video.frames_per_second”] is marked as deprecated and will be replaced with env.metadata["render_fps"] see Rename render modes/fps by trigaten · Pull Request #2654 · openai/gym · GitHub for more detailse[0m
logger.deprecation(
/home/aliemre/anaconda3/envs/eureka/lib/python3.8/site-packages/gym/wrappers/monitoring/video_recorder.py:165: UserWarning: e[33mWARN: Env returned None on render(). Disabling further rendering for video recorder by marking as disabled: path=/home/aliemre/Eureka/eureka/outputs/eureka/2023-12-12_18-49-37/policy-2023-12-12_18-54-52/videos/AntGPT_2023-12-12_18-54-53/rl-video-step-5000.mp4 metadata_path=/home/aliemre/Eureka/eureka/outputs/eureka/2023-12-12_18-49-37/policy-2023-12-12_18-54-52/videos/AntGPT_2023-12-12_18-54-53/rl-video-step-5000.meta.jsone[0m
logger.warn(
1 Like
here is more information on my process.
I’m getting visual outputs when i run the command using headless mode equals false. Everything seems great and i can visually see the agents training. However, i still cant capture videos. I need to capture videos for an iterative feedback mechanism, thus i need to capture videos and store them in each training. Here is the latest errors i get (I deleted the unimportant parts of the output) :
me/aliemre/Desktop/Isaacgymmain/Eureka/eureka/outputs/eureka/2023-12-20_17-08-29/policy-2023-12-20_17-09-49/runs/CartpoleGPT-2023-12-20_17-09-50/nn/last_CartpoleGPT_ep_3000.pth
Importing module ‘gym_38’ (/home/aliemre/Desktop/Isaacgymmain/isaacgym/python/isaacgym/_bindings/linux-x86_64/gym_38.so)
Setting GYM_USD_PLUG_INFO_PATH to /home/aliemre/Desktop/Isaacgymmain/isaacgym/python/isaacgym/_bindings/linux-x86_64/usd/plugInfo.json
PyTorch version 2.0.0+cu117
Device count 1
/home/aliemre/Desktop/Isaacgymmain/isaacgym/python/isaacgym/_bindings/src/gymtorch
Using /home/aliemre/.cache/torch_extensions/py38_cu117 as PyTorch extensions root…
Emitting ninja build file /home/aliemre/.cache/torch_extensions/py38_cu117/gymtorch/build.ninja…
Building extension module gymtorch…
Allowing ninja to set a default number of workers… (overridable by setting the environment variable MAX_JOBS=N)
ninja: no work to do.
Loading extension module gymtorch…
AtatürkATATÜRK ARTrükt
2023-12-20 18:11:24,856 - INFO - logger - logger initialized
:3: DeprecationWarning: invalid escape sequence *
Error: FBX library failed to load - importing FBX data will not succeed. Message: No module named ‘fbx’
FBX tools must be installed from Help
train.py:75: UserWarning:
The version_base parameter is not specified.
Please specify a compatability version level, or None.
Will assume defaults for version 1.1
@hydra.main(config_name=“config”, config_path=“./cfg”)
/home/aliemre/anaconda3/envs/newenv/lib/python3.8/site-packages/hydra/_internal/defaults_list.py:415: UserWarning: In config: Invalid overriding of hydra/job_logging:
Default list overrides requires ‘override’ keyword.
See Defaults List Overrides | Hydra for more information.
deprecation_warning(msg)
/home/aliemre/anaconda3/envs/newenv/lib/python3.8/site-packages/hydra/_internal/hydra.py:119: UserWarning: Future Hydra versions will no longer change working directory at job runtime by default.
See Changes to job's runtime working directory | Hydra for more information.
ret = run_job(
/home/aliemre/anaconda3/envs/newenv/lib/python3.8/site-packages/torch/utils/tensorboard/init.py:4: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
if not hasattr(tensorboard, “version”) or LooseVersion(
Setting seed: 42
Network Directory: /home/aliemre/Desktop/Isaacgymmain/Eureka/isaacgymenvs/isaacgymenvs/outputs/train/2023-12-20_18-11-25/runs/Cartpole-2023-12-20_18-11-25/nn
Tensorboard Directory: /home/aliemre/Desktop/Isaacgymmain/Eureka/isaacgymenvs/isaacgymenvs/outputs/train/2023-12-20_18-11-25/runs/Cartpole-2023-12-20_18-11-25/summaries
self.seed = 42
Started to train
[Warning] [carb.gym.plugin] useGpu is set, forcing single scene (0 subscenes)
Not connected to PVD
+++ Using GPU PhysX
Physics Engine: PhysX
Physics Device: cuda:0
GPU Pipeline: enabled
Headless mode: True
Box(-1.0, 1.0, (1,), float32) Box(-inf, inf, (4,), float32)
current training device: cuda:0
build mlp: 4
RunningMeanStd: (1,)
RunningMeanStd: (4,)
=> loading checkpoint ‘/home/aliemre/Desktop/Isaacgymmain/Eureka/eureka/outputs/eureka/2023-12-20_17-08-29/policy-2023-12-20_17-09-49/runs/CartpoleGPT-2023-12-20_17-09-50/nn/last_CartpoleGPT_ep_3000.pth’
fps step: 23402 fps step and policy inference: 14477 fps total: 13875 epoch: 1/100 frames: 24576000
…
fps step: 195091 fps step and policy inference: 135033 fps total: 99690 epoch: 93/100 frames: 25329664
/home/aliemre/anaconda3/envs/newenv/lib/python3.8/site-packages/gym/wrappers/monitoring/video_recorder.py:166: UserWarning: WARN: Env returned None on render(). Disabling further rendering for video recorder by marking as disabled: path=/home/aliemre/Desktop/Isaacgymmain/Eureka/isaacgymenvs/isaacgymenvs/outputs/train/2023-12-20_18-11-25/videos/Cartpole_2023-12-20_18-11-25/rl-video-step-1500.mp4 metadata_path=/home/aliemre/Desktop/Isaacgymmain/Eureka/isaacgymenvs/isaacgymenvs/outputs/train/2023-12-20_18-11-25/videos/Cartpole_2023-12-20_18-11-25/rl-video-step-1500.meta.json
logger.warn(
fps step: 185372 fps step and policy inference: 127274 fps total: 94678 epoch: 94/100 frames: 25337856
fps step: 169536 fps step and policy inference: 114191 fps total: 83312 epoch: 100/100 frames: 25387008
=> saving checkpoint ‘runs/Cartpole-2023-12-20_18-11-25/nn/last_Cartpole_ep_100.pth’
MAX EPOCHS NUM!
Totally same question. Expected for a resolution…