How to monitor a Managed Inference deployment

Reviewed on March 19, 2025

This documentation page shows you how to monitor your Managed Inference deployment with Cockpit.

Before you start

To complete the actions presented below, you must have:

• A Scaleway account logged into the console
• A Managed Inference deployment
• Owner status or IAM permissions allowing you to perform actions in the intended Organization

How to monitor your LLM dashboard

1. Click Managed Inference in the AI section of the Scaleway console side menu. A list of your deployments displays.
2. From the drop-down menu, select the geographical region you want to manage.
3. Click a deployment name or more icon > More info to access the deployment dashboard.
4. Click the Monitoring tab of your deployment. The Cockpit overview displays.
5. Click Open Grafana metrics dashboard to open your Cockpit's Grafana interface.
6. Authenticate with your Grafana credentials. The Grafana dashboard displays.
7. Select your Managed Inference dashboard from the list of your preconfigured dashboards to visualize your metrics.