I was testing out AI models available on NIM i tested few for example GPT OSS120B, gemma3 etc but all the models giving max token limit to 4096, can i increase it somehow for testing?
bozoweed
2
juste do not add max_token to the body
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
|
NIM API Rate Limit Upgrade Request 40 - 200 rpm
Access/Accounts
ai-training
,
ai
,
generative_ai
,
nim
,
ai-model-training
,
llama
,
agentic-ai
,
nemotron
,
nemoclaw
|
0 | 114 | May 22, 2026 | |
| Request for Rate Limit Increase for NIM API | 1 | 212 | April 16, 2026 | |
| NVIDIA NIM | 0 | 69 | August 10, 2026 | |
| Request to enable Public API Endpoints for personal organization | 0 | 58 | April 25, 2026 | |
| Request the 'Public API Endpoints' permission for my Personal Organization account | 1 | 125 | May 22, 2026 | |
| Request for NIM API rate limit increase (40 → 200 RPM) — getting started with multi-model exploration | 0 | 60 | May 25, 2026 | |
| Request to enable "Public API Endpoints" for my personal organization | 0 | 62 | June 22, 2026 | |
| Request Public API Endpoints access for my API key | 1 | 164 | June 9, 2026 | |
| Request for NVIDIA NIM API Rate Limit Increase (40 → 200 RPM) - Personal Agent Development | 1 | 119 | August 21, 2026 | |
| Request for NIM API rate limit request increase (40 - 200 RPM) | 3 | 148 | August 18, 2026 |