How to create a Cluster for Apache Kafka®
This page shows you how to create a Cluster for Apache Kafka® via the Scaleway console.
Before you start
To complete the actions presented below, you must have:
- A Scaleway account logged into the console
- Owner status or IAM permissions allowing you to perform actions in the intended Organization
How to create a Cluster for Apache Kafka®
-
Click Apache Kafka® in the Data and Analytics section of the console side menu. The Clusters for Apache Kafka®a product page displays.
-
Click Create cluster. The creation wizard displays.
-
Select a region for the cluster.
-
Select a Kafka® version to run on the cluster.
-
Select an Availability Zone (AZ) configuration for the cluster:
- Multi-AZ: Select this configuration to create a highly available Apache Kafka® cluster. Data can be partitioned and replicated across three nodes (brokers) for maximum fault tolerance and availability. Currently, the multi-AZ offers replicate three nodes over two Availability Zones.
- Single-AZ: Select this configuration to provision an Apache Kafka® cluster in a single AZ without compromising on fault-tolerance and replication.
-
Select a node type. Choose between dedicated or shared nodes, depending on your workload requirements and use case. For shared nodes, various types are available, each offering different cost-performance ratios.
-
Select the number of nodes (brokers) you want in the cluster.
- Allowed number of nodes: 1 - 30, in multiples of 3 (except for a single‑node option).
- For highly‑available clusters enabling data replication: use at least 3 nodes.
- For testing and development: 1 node is sufficient.
-
Choose the storage capacity to define how much Block Storage to provision for each node.
-
Configure network connectivity. Currently, connectivity to clusters is facilitated exclusively through Private Networks. Select a Private Network from the dropdown list to attach your cluster to.
-
Create credentials by defining a username and password. These will be used when connecting to your cluster. Currently, only one user can be created per cluster, and the username is not modifiable after creation (though the password can be changed).
-
Enter a name, and (optionally), tags to identify your cluster.
-
Check the estimated cost summary, then click Create cluster.
Your cluster is created, and you are taken to its Overview page in the console.