NavigationContentFooter

Managed Inference

Dive into seamless language processing with our easy-to-use LLM endpoints. Perfect for everything from data analysis to creative tasks, all with clear pricing.

Managed Inference Quickstart

Getting Started

Quickstart

Learn how to create, connect to, and delete a Managed Inference endpoint in a few steps.

View Quickstart

Concepts

Core concepts that give you a better understanding of Scaleway Managed Inference.

View Concepts

How-tos

Check our guides about creating and managing Managed Inference endpoints.

View How-tos

Additional content

Guides to help you choose a Managed Inference endpoint, understand pricing and advanced configuration.

View additional content
Managed Inference API

Learn how to create and manage your Scaleway Managed Inference endpoints through the API.

Go to Managed Inference API

Changelog

  • Managed Inference

    Changed

    New public endpoints

    All new public endpoints for Managed Inference deployments will be using the scaleway.com domain. Legacy endpoints in scw.cloud will remain functional until the deployment gets deleted.

  • Managed Inference

    Added

    Analyze images with Mistral vision language model

    You can now deploy your own secure Pixtral-12b-2409 model with Scaleway Managed Inference.

    With a privacy-focused, fully managed stack, this solution opens up new possibilities for applications that require both textual and visual understanding, knowing your images remain safe.

    Read our dedicated documentation to get started with Pixtral.

  • Managed Inference

    Added

    JSON mode and structured outputs

    All AI models can now reliably generate JSON output when required. The Chat Completions API supports the response_format parameter, which can be set to either json_object or json_schema, following OpenAI's specifications exactly.

    Refer to our documentation for code examples, including usage with Pydantic models or manual schema definitions.

View the full changelog
Questions?

Visit our Help Center and find the answers to your most frequent questions.

Visit Help Center
Docs APIScaleway consoleDedibox consoleScaleway LearningScaleway.comPricingBlogCarreer
© 2023-2024 – Scaleway