Rate limits & errors

Plan limits

Limits attach to your organization, not to individual API keys — every key in a workspace draws from the same pool, so creating more keys never raises a limit. There are two axes: concurrent streams and characters per calendar month. Plans and prices are on the pricing page; your workspace’s exact limits are shown in the console settings.

• Concurrent streams: in-flight requests at once, across every key in the workspace. Each open connection (including a WebSocket) holds one slot; slots free on completion, and a crashed connection’s slot self-frees on a short TTL.
• Characters per month: summed input length over the calendar month (UTC), per organization.

Handling 429s

When a limit is hit you get 429 with a machine-readable status and, where applicable, a Retry-After header (seconds). Successful responses also carry your remaining budget:

Back off and retry on rate_limit_exceeded and too_many_concurrent_requests (retry after ~1 s for concurrency). Treat insufficient_quota as terminal until the month rolls over or your plan changes; don’t retry-storm it.

Error catalogue

All errors share one shape, so a single handler covers them: { "detail": { "status": "...", "message": "..." } }.

{
  "detail": {
    "status": "rate_limit_exceeded",
    "message": "Request rate limit exceeded."
  }
}