Gym cuda error: running out of memory

Hi @jimingre

You are getting this exception (in rl_games) because the batch_size is not a multiple of minibatch_size.

I checked the values for 100, 512 and 1024 (default) environments for the Ant tasks:

  • 1024 environments (default) [yes]
    batch_size = 16384
    minibatch_size = 8192

  • 512 environments (minimum amount of environment to match the condition) [yes]
    batch_size = 8192
    minibatch_size = 8192

  • 100 environments [no]
    batch_size = 1600
    minibatch_size = 8192

Solutions:

  1. try with 512 environments

  2. no idea (I have not explored rl_games in depth). So, you can open a new issue in rl_games repository 😅

Note: to test your error I had to install rl_games from pip (pip install rl-games==1.0.2) because the direct installation form GitHub (latest version) gives some errors related to the configuration before reaching the assert line 🤷‍♂️

2 Likes