How to monitor a Managed Inference deployment
This documentation page shows you how to monitor your Managed Inference deployment with Cockpit.
Before you start
To complete the actions presented below, you must have:
- A Scaleway account logged into the console
- A Managed Inference deployment
- Owner status or IAM permissions allowing you to perform actions in the intended Organization
How to monitor your LLM dashboard
- Click Managed Inference in the AI section of the Scaleway console side menu. A list of your deployments displays.
- From the drop-down menu, select the geographical region you want to manage.
- Click a deployment name or more icon > More info to access the deployment dashboard.
- Click the Monitoring tab of your deployment. The Cockpit overview displays.
- Click Open Grafana metrics dashboard to open your Cockpit's Grafana interface.
- Authenticate with your Grafana credentials. The Grafana dashboard displays.
- Select your Managed Inference dashboard from the list of your preconfigured dashboards to visualize your metrics.
See Also
Still need help?Create a support ticket