Cassandra and Kafka

Cassandra and Kafka are used together frequently in microservice architectures. This Skill Page will teach you commons patterns for integrating Kafka and Cassandra.

Get Started
Introduction

Introduction

If your development organization embraces the benefits of microservices architecture, you are aware of Kafka’s durable logs for immutable events that allow your microservices to function independently and asynchronously. Sometimes these microservices need to access a system of record such as Apache Cassandra™. Apache Kafka embodies many of the same distributed systems values as Cassandra — for example, scalability and high availability, and therefore Cassandra and Kafka are technologies that complement each other well.

Next Concept: Kafka as Event Fabric

Kafka as an Event Fabric

Think of Kafka as an event fabric between microservices. A service consumes events from a Kafka stream and performs computations on the events. New Kafka events are produced, and/or data is written to Cassandra. Also, the service may use data from Cassandra as part of the event processing.

Next Concept: Cassandra as Sink
Kafka as an Event Fabric
Cassandra as a Sink For Kafka

Cassandra as a Sink For Kafka

Cassandra is often used with Kafka for long term storage and serving application APIs. Using the DataStax Kafka Connector, data can be automatically ingested from Kafka topics to Cassandra tables.

Next Concept: Kafa Connector

DataStax’s Kafka Connector

DataStax Apache Kafka Connector is installed in the Kafka Connect framework, and synchronizes records from a Kafka topic with table rows in Cassandra/DSE. Running the connector in this framework enables multiple DataStax connector instances to share the load and to scale horizontally when run in Distributed Mode.

Next Concept: Cassandra and CDC
DataStax’s Kafka Connector
Cassandra and CDC

Cassandra and CDC

The reverse is also possible - Enabling CDC (Data Capture Change) on your cluster allows you to stream data out of Cassandra. Use the Kafka Connect framework to perform CDC from Cassandra via plugins. Currently we are working on a way to make this easier.

Next: Skill Building

Skill Building

Try The DataStax Kafka Connector - our Connector allows you to scale your databases horizontally quickly, and easily. Give it a try!

Continue Your Journey

Download Kafka Connector

Download Kafka Connector

Get your hands on the connector and start moving data from Kafka to Cassandra.

Get the Download
Kafka on DataStax Examples

Kafka on DataStax Examples

Check out our Examples of using the DataStax Apache Kafka Connector.

See Examples
DDS: Kafka and Cassandra

Podcast: Kafka and Cassandra

Tim Berglund answers your most common questions about Kafka and Cassandra.

Watch Now

More Resources

Material related to Kafka

DataStax Apache Kafka Connector Documentation
Kafka

DataStax Apache Kafka Connector Documentation

Synchronize records from a Kafka topic with table rows supported databases.

See the docs
DDS: Introducing DataStax Apache Kafka Connector in SDE 6.7 with Chris Splinter
Kafka

Podcast: Introducing DataStax Apache Kafka Connector in SDE 6.7 with Chris Splinter

DataStax Apache Kafka™ Connector is one of the new and long awaited…

Watch Now
DSA: DataStax Apache Kafka™ Connector
Kafka

DSA: DataStax Apache Kafka™ Connector

Learn how to use the DataStax Apache Kafka™ Connector

Start Learning