Adrian Cockcroft of Netflix to speak at Cassandra SF 2011
We wanted use cases to be a major focus of this year’s Cassandra SF, and one of the most asked about use cases is the deployment at Netflix. We approached Adrian Cockcroft, Cloud Architect at Netflix, and he agreed to speak on the process of moving from Oracle.
In our initial move of the Netflix streaming service to the cloud, we made copies of data and synchronized changes back to Oracle in the datacenter. This year Netflix is making the cloud the master copy, and phasing out Oracle as a data store. At the same time we are moving from our initial memcached / SimpleDB based back-end to Apache Cassandra with data replicated to AWS availability zones, and supporting a global business with asynchronous cross region replication. We have implemented full and incremental backup and restore to S3, and integration with our existing Business Intelligence back-end. We already use Hadoop, and are currently investigating Brisk. Netflix chose Apache Cassandra because it’s flexible operational model fits our need for highly available and globally distributed data sources. We have also engaged in the Apache development process, contributing fixes and new features such as off-heap row cache and incremental backup hooks, and find that it integrates well with our primarily Java based development environment.
Over the last three years Adrian Cockcroft has managed and architected development of personalization algorithms for the Netflix web site and TV based devices, refactoring code into middle tier services, and development of a new personalization platform optimized for the cloud. He recently moved to the Cloud Systems group, with a focus on performance monitoring and analysis tools.
Adrian is probably best known as the author of several books while a Distinguished Engineer at Sun Microsystems: Sun Performance and Tuning; Resource Management; and Capacity Planning for Web Services. He was also a founding member of eBay Research Labs, where he contributed to the Skype Java API and built mobile application prototypes.
Additional details and RSVP for Cassandra SF at Eventbrite: