DataCater with Aiven for Apache Kafka

Aiven for Apache Kafka is a managed Apache Kafka offering by Aiven. This section describes how to connect DataCater to it.
Please make sure that you have created an Apache Kafka service in your Aiven console.
On the overview page of your Kafka service, scroll down to Advanced configuration and make sure that kafka_authentication_methods.certificate is disabled and kafka_authentication_methods.sasl is enabled:
Note the Service URI, the user, the password, and the content of the CA Certificate.
When creating a stream in DataCater, please fill the following configuration options:
name: Name of your Apache Kafka topic. If the topic does not yet exist, DataCater will try to create it.
bootstrap.servers: Name of the service URI.
security.protocol: SASL_SSL
sasl.jaas.config: 
org.apache.kafka.common.security.plain.PlainLoginModule   required username='$YOUR_USERNAME'   password='$YOUR_PASSWORD';
sasl.mechanism: PLAIN
ssl.truststore.type: PEM
ssl.truststore.certificates: The content of the CA certificate (ca.pem).
An API call for creating a stream that connects to Aiven for Apache Kafka could look as follows:
$ curl http://localhost:8080/api/v1/streams/ \
  -H'Authorization: Bearer YOUR_TOKEN' \
  -XPOST \
  -H'Content-Type:application/json' \
  -d'{"spec":{"kind":"KAFKA","kafka":{"topic":{"config":{}},"bootstrap.servers":"kafka-2d4c6213-datacater-c735.aivencloud.com:14186","security.protocol":"SASL_SSL","sasl.jaas.config":"org.apache.kafka.common.security.plain.PlainLoginModule   required username='$YOUR_USERNAME'   password='$YOUR_PASSWORD';","sasl.mechanism":"PLAIN","ssl.truststore.type":"PEM","ssl.truststore.certificates":"-----BEGIN CERTIFICATE----- MIIEQTCCAqmgAwIBAgIUXvYydLpbo7XiigVZnH+9V8hLb6owDQYJKoZIhvcNAQEMBQAwOjE4MDYGA1UEAwwvYzg2ZmE0YzItNzk5Ny00ZDc0LWIzMWItNjlhZjFkYjFlOGYyIFByb2plY3QgQ0EwHhcNMjEwOTI4MDMzMTQxWhcNMzEwOTI2MDMzMTQxWjA6MTgwNgYDVQQDDC9jODZmYTRjMi03OTk3LTRkNzQtYjMxYi02OWFmMWRiMWU4ZjIgUHJvamVjdCBDQTCCAaIwDQYJKoZIhvcNAQEBBQADggGPADCCAYoCggGBALrx7SIeVUe7MFKTW+Jrdv2yTFQmTsvftJX0ne54frMFqVDQG9TwRMOZVIKq2CQdd7ZNfevMyOTR0mQBeRUC+NW8EeSugNsF35qgic+sOa9+834KhIYyc73kfG7lIksZw7cLTAGQO3py2bY9YelUyZQ0xiu7hJf1m/0zviXn07lGRltR+RNzCqVGWdic/aYI8PfbS9T6ABAJeT/+BonF5DkdGibwD6rtXgMCLoizuzcdtop/uUA9dW7LE0ClmwYW14TwHAod6oBPcw+8OlqhyX1elrqGQywzCP58weWY3bVUsoDciuvEDC0N/COToCfIDXl4y36TtAQHhRNExhujnNVyc4tQmxWmm5hS9gx3woQ03ISq6TNI+oDKlaU18yq7AXod37HEmflFkB9QwbQ2hSTzaH48saWtijEvBtKpub4wbi2SDalfj2mxB1tvzf/bMbPcQx8+r28lauECKbbamYm/3O5JBxbLSwnEPXOhLBr/c/jcMdnidRkmb+kLie4ddQIDAQABoz8wPTAdBgNVHQ4EFgQUeMlr+M5QpqY8lUmt5kW3NNotrN0wDwYDVR0TBAgwBgEB/wIBADALBgNVHQ8EBAMCAQYwDQYJKoZIhvcNAQEMBQADggGBAGEZIwQfXuvZgMveYSLg+nzx9Q3P11DL8/X4DMw6FF4mK/lcWfib3HGh+M3fJyomMl8h97TA5XX+aZgBgVtcp/JTT5QvpzU3SEnlog+PeOpbh/iUHcKRaKUEVvIbcUnsBmUJ1ghZokDI2hI3mClivtaFptsqHFjV9bX6jXbB3REBIrqxQUmlvGdwJOYdsJd7/ZfYU+C36SOm/4LGV/Wf0zTT5gnkUcuvrGvMJXtzxJmv2luUy2cMUK91trC8ciz/hL7znUYn1fwHfCSbU8NTRynClUpvzqsHjQaKDBehm9oF8baFuDPiWe6ZdmRNU/r7SeesSWiFmO6GAsbU3fhFWDdEkeA0AHF97gPw5jQUHIY+G9jWpwKpK0pRHRCQkvHfd6ah+mJ3B9Q+g6twdefyA6pCVzrQjO42lBBPxxp0glCYpSM/KHMkNSxd1lvj0HNSkvRCUbSHxEA3IyaiSb+5Sny+LkQPvz37rWDS+KanH+uUHnlwYmxjmfpEyNh5on7nNA== -----END CERTIFICATE-----"}},"name":"customers"}'
Integrating DataCater with Apache Kafka
DataCater with Confluent Cloud
Last modified 5mo ago