Yelp has built a robust stream processing ecosystem called Data Pipeline. As part of this system we created a Cassandra Source Connector, which streams data updates made to Cassandra into Kafka in real time. We use Cassandra CDC and leverage the stateful stream processing of Apache Flink to produce a Kafka stream containing the full content of each modified row, as well as its previous value.
Speakers
Andrew Prudhomme
Distributed Systems Engineer at Yelp
Abrar Sheikh
Data Engineer at Yelp
You May Also Like:
Blog
Locstat Uses DataStax For Graph-Powered IoT Event Processing
Locstat is a software company headquartered in Cape Town, South Africa that builds a graph-powered AI and event-processing solution to enable real-time analysis and visualization…
Learn More
Webinar
Best Practices for Migrating from a Relational Data Platform to Apache Cassandra™
How do you know when it’s time to move the critical workloads that run your enterprise from a relational database to a NoSQL Cassandra database? Join us on February 5 at 11 a.m.…
Learn More
Blog
Introducing the DataStax Premium Support Program
We get it. Database management can be hard—especially in a cloud world with zettabytes of data points. Managing your NoSQL database can get complicated really fast. At DataStax…
Learn More