Gym cuda error: running out of memory

Hi @jimingre

You can reduce the number of environments to create by using the --num_envs NUM_ENVS argument . This will reduce the memory allocated.

Example:

python train.py --task Anymal --num_envs 512

To make the change persistent you can edit the variable numEnvs in configuration files (.yaml) in PATH_TO_ISAAC_GYM/python/rlgpu/cfg folder.