Yelp has built a robust stream processing ecosystem called Data Pipeline. As part of this system we created a Cassandra Source Connector, which streams data updates made to Cassandra into Kafka in real time. We use Cassandra CDC and leverage the stateful stream processing of Apache Flink to produce a Kafka stream containing the full content of each modified row, as well as its previous value.
Back to Resources
Datastax Accelerate 2019 Streaming Cassandra into Kafka
Speakers
Andrew Prudhomme
Distributed Systems Engineer at Yelp
Abrar Sheikh
Data Engineer at Yelp
You May Also Like:
Blog
Solving IoT Data Management Challenges with Apache Cassandra
In many ways, the IoT era is already here. But at the same time, we’re nowhere near experiencing the true potential of IoT. To illustrate, one recent study found that global IoT…
Learn More
Webinar
Evolving Datacenters Without Complexity
Today, many enterprise IT organizations are implementing hybrid and multi-cloud solutions to bring the most advanced features and capabilities into their operations. It’s a move…
Learn More
Blog
Simplifying DataStax Enterprise Deployments with Kubernetes for Containerized Workflows
Available today in DataStax Labs, the DataStax Enterprise Kubernetes Operator simplifies the deployment and management of DataStax Enterprise (DSE) clusters on the Kubernetes…
Learn More