DataCater with Confluent Cloud

Confluent Cloud is a managed Apache Kafka offering by Confluent. This section describes how to connect DataCater to it.
Please make sure that you have created an Apache Kafka cluster in your Confluent Cloud account.
In Confluent Cloud, navigate to Cluster Overview and click API Keys. Create a new key and note its Key and Secret:
When creating a stream in DataCater, please fill the following configuration options:
  • name: Name of your Apache Kafka topic. If the topic does not yet exist, DataCater will try to create it.
  • bootstrap.servers: Bootstrap server of your Confluent Cloud Kafka cluster, can be found under Cluster Overview > Cluster Settings.
  • security.protocol: SASL_SSL
  • sasl.jaas.config: required username='$YOUR_API_KEY' password='$YOUR_API_SECRET';
  • sasl.mechanism: PLAIN
An API call for creating a stream that connects to Confluent Cloud could look as follows:
$ curl http://localhost:8080/api/v1/streams \
-H'Authorization: Bearer YOUR_TOKEN' \
-H'Content-Type:application/json' -d'{"name":"commits","spec":{"kafka":{"topic":{"config":{}},"bootstrap.servers":"","security.protocol":"SASL_SSL","sasl.mechanism":"PLAIN","sasl.jaas.config":" required username='$YOUR_API_KEY' password='$YOUR_API_SECRET';"},"kind":"KAFKA"}}'