Subject: Request for API Rate Limit Increase (40 → 200 RPM) – Internal Beta Testing, Alibaba Wukong BU

AI & Data Science NVIDIA NIM Access/Accounts
1

Body:
Hi NVIDIA NIM Team,

I hope this message finds you well. My name is Joshua, and I am an internal beta tester at Alibaba Group’s Wukong Business Unit. We are currently evaluating NVIDIA NIM for potential enterprise workflow integrations, and my role focuses on validating real-world usage scenarios, prompt chains, and cross-platform compatibility.

Current Limit: 40 RPM
Requested Limit: 200 RPM

Testing Context & Reason for Increase:
During my beta testing, I simulate typical enterprise user workflows (e.g., multi-step prompt sequences, agent handoffs, and template iterations). The default 40 RPM limit frequently triggers 429 Too Many Requests errors during normal testing cycles, which artificially breaks the workflow and makes it difficult to assess NIM’s stability and response quality in practical scenarios. A 200 RPM threshold would allow me to:

  • Run uninterrupted scenario validations without manual throttling
  • Test prompt chains and workflow logic as they would behave in real deployments
  • Capture more accurate usage patterns for internal feedback

Feedback Commitment:
I will regularly share my usage logs, workflow friction points, prompt/response quality notes, and integration observations through the beta feedback channels. My goal is to provide practical, scenario-driven insights that align with NIM’s product validation objectives.

Account Information:

  • Registered Email: josh.chiang.cn@gmail.com
  • API Key Prefix (first 8 chars, optional): nvapi-oNzFMZ
  • Primary Models Tested: [z-ai/glm5, qwen/qwen3.5-397b-a17b, moonshotai/kimi-k2.5, minimaxai/minimax-m2.5]

Thank you for your support and for maintaining such a valuable developer platform. I look forward to your response and am happy to provide additional context if needed.

Best regards,
Joshua Chiang

4

i think that you don’t understud that is free test plan …. it’s not fair use to request 200 rpm … if you planed to used it in entreprise workflow you should think about purchase some cloud hardware like nvidia allready purpose.

in fact current 40 rpm is allready enougth to test model and they don’t need to upgrade that because api is allready dying every day because too much people are on it, so if you need more power you have to take a look at Brev.dev Console that allready exist and will help you and nvidia

hope that you understud FREE TESTING is not made for enterprise usage

5

Hi

Thank you for your prompt and clear response. I completely understand that the free testing tier is designed for individual exploration, and I appreciate the transparency about current API capacity.

I will continue to optimize my testing workflow within the 40 RPM limit, and explore the Brev.dev Console option for higher-throughput scenarios. If our internal validation progresses to a production evaluation phase, I will reach out through the appropriate commercial channels.

Thanks again for maintaining such a valuable platform for the developer community.

Best regards,

6

Hi there,

Thanks for the detailed request.

I can elevate this internally to the team, as many others have had similar requests, but we cannot approve rate-limit increases directly from the forum.

I know that’s not the answer you are looking for, but I will do my best to ensure forum posters are heard in the decision-making process.

Thanks,

Aharpster