Based on Custom RL Example using Stable Baselines , multiple envs wrong!

I followed the tutorial Custom RL Example using Stable Baselines to build my environment,but it doesn’t work. I copied the code and ran the cartpole example. When num_envs is 1, it can run, but when I change num_envs, it reports an error. My world contains multiple envs, but when wrapping the env, I check the vecenc, it seems that i only have one environment, and the output actions returned is one-dimensional


Hi @2456496590

For the Custom RL example applied to multiple environments, this post may help: