DataStax Enterprise and Apache Kafka are designed specifically to fit the needs of modern, next-generation businesses. With DataStax Enterprise (DSE) providing the blazing fast, highly-available hybrid cloud data layer and Apache Kafka™ detangling the web of complex architectures via its distributed streaming attributes, these two form a perfect match for event-driven enterprise architectures.
This Quick Reference Guide contains tips and commands for working with the DataStax Apache Kafka “sink” Connector. This connector automatically ingests data from Kafka to a DataStax Distribution of Apache Cassandra or DataStax Enterprise (DSE) database, and supports all Kafka message formats, including JSON and Avro.
Moves data fast by incorporating the best practices of writing data to Apache Cassandra leveraging partition awareness and asynchronous pipelines.
Built in the standard Kafka Connect framework that allows connector instances to scale horizontally to meet the needs of the workload.
Uses the most recent version of the DataStax Java Driver and sports all of the DataStax Advanced Security features including LDAP, Active Directory, Kerberos and SSL encrypted channels.
Lets you pick the individual fields in Kafka messages that should be mapped to DataStax columns. Whether it’s JSON or Avro the connector allows for mapping many Kafka topics to many DataStax tables, playing nicely into the common denormalization patterns.