Jeffrey Carpenter

Setting the right pace of change for a technology can be a tricky thing. If it's changing too fast, it can cause churn and confusion for users as they try to keep up. On the other hand, if a technology is not actively demonstrating at least some level of change, it gets stagnant and loses momentum.&nbsp;
We all evaluate open source projects according to the pace of change. Whether we like to admit it, there&rsquo;s an assurance that comes from seeing that the latest commit on the Git repo occurred in the past few days instead of months or years ago. We use this as a proxy for evaluating the health of a project and its community.
I&rsquo;ve been thinking about this pace of change lately as I had the opportunity to revisit my work on Cassandra: The Definitive Guide for O&rsquo;Reilly to create a <a href="https://dtsx.io/3HY4SPf">revised third edition</a> of the book. I&rsquo;d like to share a few interesting things here that I observed in that process.
<h2>A brief history of innovation on the Cassandra project</h2>
Apache CassandraⓇ is a project that has had periods of change that were too fast and times of slow progress that caused concern, but is now approaching a great equilibrium.
<h3>Too fast</h3>
When Eben Hewitt first approached me in 2014 about updating the Cassandra book he had first written in 2010, he joked that O&rsquo;Reilly should stop selling that first edition because of how out of date it was and how much Cassandra had changed. This turned out to be true &ndash; the addition of the Cassandra Query Language (CQL) and resulting architecture changes had a major impact on what it looked like to use and maintain Cassandra. As a result, that second edition (released in 2015) was a major rewrite.&nbsp;
<h3>Too slow</h3>
When I had the chance to work on the third edition (released in 2020), the experience was quite different. The pace of change on the Cassandra project had slowed. On the plus side, this was an indicator that the project had reached a level of stability and maturity. On the minus side, it also showed a slowing pace of innovation and progress. The 4.0 release was in beta for a long time, longer than I expected. My attempt to time the third edition to coincide with the release of Cassandra 4.0 missed the mark as the book actually beat the 4.0 GA release by a full year!
<h3>Just right!</h3>
In working on the revised third edition that&rsquo;s just been released, I had the pleasant experience of observing a great balance that has emerged in the Cassandra community. The pace of innovation on the core project is just right. Instead of features that make major API and functionality changes, the project is focused on features that enable ease of use and developer productivity. Probably the most important signs, though, are the developments in the community surrounding the project itself.
<h2>A vibrant community driving Cassandra&rsquo;s future</h2>
Over the past couple of years, the Cassandra community has been revitalized in some major ways.
<h3>Innovation on the core through CEPs</h3>
The first is the introduction of the Cassandra Enhancement Proposal (CEP) process. Drawing inspiration from improvement processes in other communities, the Cassandra community now has a well-defined and well-executed process for proposing, discussing, and approving new ideas before engineers invest time in making changes. There are many of these proposals in progress. Here&rsquo;s a few that I find especially interesting for application developers:
<ul>
<li aria-level="1"><a href="https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-3%3A+Guardrails">CEP-3: Guardrails</a> will make it easier for administrators to place limitations on usage patterns that would degrade performance and stability of Cassandra clusters.&nbsp;</li>
<li aria-level="1"><a href="https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-15%3A+General+Purpose+Transactions">CEP-15: General Purpose Transactions</a> will provide a new transaction capability based on the Accord protocol that will provide transactions across multiple tables, a long requested feature.&nbsp;&nbsp;</li>
<li aria-level="1"><a href="https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-7%3A+Storage+Attached+Index">CEP-7: Storage Attached Index</a> will add a new secondary index implementation that allows indexing of multiple columns while maintaining performance.</li>
</ul>
<h3>Innovation at the ecosystem edge</h3>
It&rsquo;s not only within the Apache project that innovation occurs within the Cassandra community. Projects like <a href="http://cassandra-reaper.io/">Cassandra Reaper</a> and <a href="https://github.com/thelastpickle/cassandra-medusa">Cassandra Medusa</a> are great tools for operating Cassandra that emerged out of collaboration between Spotify and The Last Pickle.&nbsp;
More recently a number of organizations have been deploying Cassandra on Kubernetes and building their own operators. Many of these organizations shared ideas and best practices, resulting in a lot of momentum behind the <a href="https://k8ssandra.io/blog/articles/feature-deep-dive/a-recap-of-cass-operator-in-2021-and-whats-coming-next/">open-source operator</a> started by <a href="https://dtsx.io/36aL4eo">DataStax</a> that is now part of the K8ssandra project.&nbsp;
K8ssandra is itself an example of a project that pulls many of these threads together, knitting <a href="https://dtsx.io/3pRCUOM">Cass Operator</a>, <a href="http://cassandra-reaper.io/">Reaper</a>, <a href="https://github.com/thelastpickle/cassandra-medusa">Medusa</a>, <a href="https://prometheus.io/docs/introduction/overview/">Prometheus</a>, and the <a href="https://dtsx.io/3sYdKjG">Stargate</a> data gateway into an integrated stack for running Cassandra on Kubernetes as easily as possible.&nbsp;
<h3>Communication for all</h3>
The Cassandra website has undergone a full refresh within the past year and features a continual feed of new content on the <a href="https://cassandra.apache.org/_/blog.html">blog</a>. For those that are active in the community (or want to be), the regular &ldquo;<a href="https://cassandra.apache.org/_/blog/Apache-Cassandra-Changelog-12-February-2022.html">Changelog</a>&rdquo; posts are especially useful summaries of what&rsquo;s going on in the project.
<h3>Non-code contributors</h3>
Cassandra has long been a project that demanded a lot of technical expertise to work with the core engine, and the path to becoming a committer has been reserved for those with a pretty narrow set of specific skills in server-side Java development. I&rsquo;m super excited to see how the project has recently begun to recognize committers like Lorina Poland, Erick Ramirez, and Anthony Grasso, whose primary contributions have been in the area of documentation and helping new users.&nbsp;
Download the newest edition of <a href="https://dtsx.io/3HY4SPf">Cassandra: The Definitive Guide for O&rsquo;Reilly</a> for the most up-to-date technical details and practical examples for deploying Apache CassandraⓇ in a production environment.

Apache Cassandra Finds Its Groove

Jeffrey CarpenterSoftware Engineer - Stargate

Discover more

Share

Share

A brief history of innovation on the Cassandra project

Too fast

Too slow

Just right!

A vibrant community driving Cassandra's future

Innovation on the core through CEPs

Innovation at the ecosystem edge

Communication for all

Non-code contributors

More Company

DataStax Acquires Langflow to Accelerate Generative AI Development

The Top 5 DataStax Stories from 2023

2023 Recap: Data = AI

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

One-stop Data API for Production GenAI