Consumed gpu memory keeps increasing when using omni.anim.people

I am using isaac sim for a reinforcement learning task in a custom environment, specifically to train a mobile robot to avoid people, so I use the omni.anim.people extension to deploy people in the environment, but I found that during the training process The consumption of gpu memory continues to increase, and the consumption of gpu memory becomes faster as the number of people deployed increases. When there are no people, I can easily train 600k timesteps with my 3060 12G, but after adding three people into it , I can only train about 30k gpu memory will be full. And I found that the cause of this problem is the animation graph. If I directly add the action to SkelRoot (Skeleton), there will be no such problem. How can I solve it?