Based on Custom RL Example using Stable Baselines , multiple envs wrong!

Hi @2456496590

For the Custom RL example applied to multiple environments, this post may help: