Hello NVIDIA Support Team,
I am writing to request a critical rate limit increase for my account: rihansaifi4849@gmail.com.
Current Limit: 40 RPM Requested Limit: Minimum 200 RPM for basic testing
Project Context: I am developing a production-level Autonomous AI Operating System (VISION) built on a Tokio-based multi-agent swarm.
Technical Justification:
-
Architecture: 25 specialized agents running in parallel orchestration.
-
The Math: Each agent requires 5-8 LLM calls to resolve a single task. At 40 RPM, a 25-agent swarm provides only 1.6 calls per agent/minute.
-
Impact: This is causing constant 429 errors, downstream timing failures, and infinite retry loops that are overheating my local hardware.
-
Models: I am standardized on
meta/llama-3.1-405b-instructandgoogle/gemma-2-27b-it.
I have built my entire pipeline around NIM’s high-performance inference. This increase is necessary to allow my swarm to run without starvation.
Thank you for your assistance!