---
title: What rate limits apply with Scaleway Generative APIs - Serverless?
description: Find our service limits in tokens per minute and queries per minute
tags: generative-apis-serverless ai-data rate-limits
dates:
  validation: 2026-04-24
  posted: 2024-08-27
---

## What are the limits?

Any model served through Scaleway Generative APIs - Serverless gets rate limited based on:
- Tokens per minute (total input and output tokens)
- Queries per minute (HTTP requests)
- Concurrent requests (total simultaneous HTTP sessions)

Base limits apply if you registered a valid payment method, and they are increased automatically if you also [verify your identity](/account/how-to/verify-identity/).

Exact limit values are detailed in [Organization quotas for Generative APIs - Serverless](/organizations-and-projects/additional-content/organization-quotas/#generative-apis---serverless).
These values apply to your Organization, and are shared by all Projects within your Organization.

## How can I increase the rate limits?

We actively monitor usage and will improve rates based on feedback.
If you need to increase your rate limits:
- [Verify your identity](/account/how-to/verify-identity/) to automatically increase your rate limit as described below.
- Use the [Batches API](https://console.scaleway.com/generative-api/batches) for non-real-time workloads. Requests performed through the Batches API do not have a rate limit and are billed with a [-50% discount compared to standard model prices](https://www.scaleway.com/en/pricing/model-as-a-service/#generative-apis).
- Use [Generative APIs- Dedicated Deployment](https://console.scaleway.com/generative-api/deployments), which provides dedicated capacity and does not enforce rate limits (you remain limited by the total provisioned capacity).
- Contact your existing Scaleway account manager or our Sales team to discuss volume commitment for specific models that will allow us to increase your quota proportionally.

## Why do we set rate limits?

These limits safeguard against abuse or misuse of Scaleway Generative APIs - Serverless, helping to ensure fair access to the API with consistent performance.

## How can I monitor rate limits?

Rate limit information is provided in HTTP response headers:

| Header field | Example value | Description |
|--------------------------|:-------------------------:|:-------------------------------------------------------------:|
| x-ratelimit-limit-requests       | 600              | Maximum number of requests allowed over a minute.                         |
| x-ratelimit-remaining-requests       | 599              | Remaining number of requests allowed before reaching rate limit over a minute.           |
| x-ratelimit-reset-requests       | 250ms              | Time until rate limit request usage resets to its initial value.          |
| x-ratelimit-limit-tokens       | 1000000              | Maximum number of tokens (input and output) allowed over a minute.               |
| x-ratelimit-remaining-tokens     | 999976              | Remaining number of tokens allowed before reaching rate limit over a minute.           |
| x-ratelimit-reset-tokens      | 35ms              | Time until rate limit token usage resets to its initial value.  |

You can see these headers by performing the following HTTP request, using the `curl -i` option:

```bash
curl -i https://api.scaleway.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $SCW_SECRET_KEY" \
  -d '{
    "model": "mistral-small-3.2-24b-instruct-2506",
    "messages": [
      {
        "role": "system",
        "content": "You are a helpful assistant."
      },
      {
        "role": "user",
        "content": "Hello!"
      }
    ]
  }'
```

