DataCater with Confluent Cloud

Confluent Cloud is a managed Apache Kafka offering by Confluent. This section describes how to connect DataCater to it.
Please make sure that you have created an Apache Kafka cluster in your Confluent Cloud account.
In Confluent Cloud, navigate to Cluster Overview and click API Keys. Create a new key and note its Key and Secret:
When creating a stream in DataCater, please fill the following configuration options:
name: Name of your Apache Kafka topic. If the topic does not yet exist, DataCater will try to create it.
bootstrap.servers: Bootstrap server of your Confluent Cloud Kafka cluster, can be found under Cluster Overview > Cluster Settings.
security.protocol: SASL_SSL
sasl.jaas.config: 
org.apache.kafka.common.security.plain.PlainLoginModule   required username='$YOUR_API_KEY'   password='$YOUR_API_SECRET';
sasl.mechanism: PLAIN
An API call for creating a stream that connects to Confluent Cloud could look as follows:
$ curl http://localhost:8080/api/v1/streams \
  -H'Authorization: Bearer YOUR_TOKEN' \
  -XPOST \
  -H'Content-Type:application/json' -d'{"name":"commits","spec":{"kafka":{"topic":{"config":{}},"bootstrap.servers":"pkc-75m1o.europe-west3.gcp.confluent.cloud:9092","security.protocol":"SASL_SSL","sasl.mechanism":"PLAIN","sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule   required username='$YOUR_API_KEY'   password='$YOUR_API_SECRET';"},"kind":"KAFKA"}}'
DataCater with Aiven for Apache Kafka
Building a pipeline
Last modified 5mo ago