I get the same error as well, when changing num_envs and running any RL example.
I am on a completely fresh install of Ubuntu 20.04, so I don’t really understand what’s wrong.
As for the batch_size and minibatch_size, check out this thread, maybe this works for you?: Gym cuda error: running out of memory - #4 by toni.sm
-Anton