Isaac orbit load different usd_path and set different scale to different RL envs

I use Isaac Orbit for reinforcement learning training and need each environment to have a different target object with varying scales. I have 1,000 objects, and my current approach is to load them all. However, when I open up to 2,048 environments, I encounter issues with physx gpu_found_lost_aggregate_pairs_capacity and gpu_max_rigid_patch_count buffer overflow. I would like to know how to load only one object per environment, instead of all 1,000 objects, while still being able to set different scales for each environment’s object.