Skip to navigationSkip to main contentSkip to footerScaleway DocsSparklesIconAsk our AI
SparklesIconAsk our AI

How to monitor a dedicated Generative APIs deployment

This documentation page shows you how to monitor your dedicated Generative APIs deployment with Cockpit.

Before you start

To complete the actions presented below, you must have:

LightBulbIcon

IAM permissions required

You will need either of the following IAM permissions to access your Cockpit's Grafana:

  • ObservabilityFullAccess: Full access to Cockpit
  • ObservabilityGrafanaEditor: Editor access to Cockpit's Grafana, read-only access to all other Cockpit features
  • ObservabilityReadOnly: Read access to Cockpit

How to monitor your LLM dashboard

  1. Click Generative APIs in the AI section of the side menu in the Scaleway console to access the dashboard. The list of models displays.
  2. Select the Deployments tab.
  3. From the drop-down menu, select the geographical region you want to manage.
  4. Click a deployment name to access the deployment's dashboard.
  5. Click the Monitoring tab of your deployment. The Cockpit overview displays.
  6. Click Open Grafana metrics dashboard to open your Cockpit's Grafana interface.
  7. Log in to Grafana.
  8. Select your Generative APIs dashboard from the list of your preconfigured dashboards to visualize your metrics.
SearchIcon
No Results