To force the CPU PhysX back end, use --device=CPU you can also use --ppo_device=CPU if you want to force network inference to also happen on the CPU.
Note that you’re unlikely to see too much of a tangible difference with a problem as simple as ants. The ShadowHand example will show a much more pronounced training performance difference.