Jeff DiNoto

<p>It&rsquo;s said to be difficult to run stateful workloads like Cassandra on Kubernetes. In this blog, we&rsquo;ll take a fresh look at that claim.</p>
<p>In our first &ldquo;<a href="https://www.datastax.com/blog/datastax-cassandra-myth-buster-series-coding-on-cassandra-is-too-complicated">myth buster</a>&rdquo; blog, we took an objective look at the difficulties said to be associated with <a href="https://www.datastax.com/cassandra">Apache Cassandra</a>&reg; and evaluated them in the context of Cassandra&rsquo;s abilities and tools developed to now remove complexity. Cassandra supports cloud-native workloads, and the flexible API layer <a href="https://dtsx.io/3Fd0o7H">Stargate.io</a>&nbsp;makes it easier to work with.</p>
<p>Now, in this post, we&rsquo;ll examine how difficult it is to run stateful workloads like Cassandra on <a href="https://kubernetes.io/">Kubernetes</a>.</p>
<h2>Myth: Running stateful workloads like Cassandra on Kubernetes is difficult</h2>
<p>Stateless application life is free and easy. Stateful application life not so much. There are different requirements. Storage needs to be persistent and follow a workload if it&rsquo;s rescheduled on another node. Identification needs to follow you as you go.</p>
<p>The core of the challenge for stateful application developers is the nature of Kubernetes pods and the containers within them. They are ephemeral and therefore so is the data held within them. So, what are you to do?</p>
<h2>Reality: That was then, this is now</h2>
<p>Kubernetes and Cassandra work hand-in-hand to create a platform for a new generation of modern cloud-native applications. It includes those with stateful requirements. Kubernetes has played a pivotal role in the emergence of modern, cloud-native microservice-oriented applications.&nbsp;</p>
<p>But there was a catch: Kubernetes was built on stateless applications and ephemeral application workloads. And databases simply didn&rsquo;t belong in that environment.</p>
<p>Today, it&rsquo;s&nbsp;<a href="https://www.datastax.com/blog/how-connect-stateful-workloads-across-kubernetes-clusters">a different story</a>: Kubernetes powers a new generation of stateful, data-aware applications. They have improved scalability, reliability, and ease of management. This has been the culmination of several important innovations that arrived in concert-like orchestration.</p>
<ul>
<li>Changes to the Kubernetes ecosystem</li>
<li>The creation of the Kubernetes operator for Cassandra</li>
<li>K8ssandra</li>
</ul>
<h2>Changes to the Kubernetes ecosystem</h2>
<p>Various native Kubernetes resources provide the basic building blocks needed to host stateful applications within Kubernetes. These are APIs like StatefulSets, PersistentVolumes, PersistentVolumeClaims, and StorageClasses.</p>
<p>The Container Storage Interface (CSI) has made it increasingly possible for third-party storage providers to bring new storage systems to the community. These offer flexibility given the varying storage requirements of many different types of applications.</p>
<h2>Kubernetes operator for Cassandra</h2>
<p>The creation of the&nbsp;<a href="https://docs.datastax.com/en/cass-operator/doc/cass-operator/cassOperatorAbout.html">Kubernetes operator for Cassandra</a> provided a native Kubernetes experience for deployment and management of Cassandra datacenters within a Kubernetes cluster. The <a href="https://docs.datastax.com/en/cass-operator/doc/cass-operator/cassOperatorAbout.html">Cass operator</a> leverages all emerging Kubernetes resources to build flexible and robust deployment of Cassandra. This integrates and standardizes all capabilities required to deliver a cohesive Cassandra experience on Kubernetes.</p>
<p>Cass operator&nbsp;provides a Kubernetes custom resource called the CassandraDatacenter. This provides the abstraction layer between configuration provided via Kubernetes and translates it into the configuration of the Cassandra deployment it manages. It also exposes the state of the deployment that can be inspected like other native Kubernetes resources.</p>
<h2>K8ssandra eases use of Cassandra on Kubernetes</h2>
<p>The latest iteration in this process is&nbsp;<a href="https://dtsx.io/3vI2uJn">K8ssandra</a>. It&rsquo;s a complete data platform built on Kubernetes and Cassandra with the capabilities of Cass Operator.</p>
<p>K8ssandra elevates and abstracts away its component technologies and integrates essential supporting services. These are for instance repair, backup and restore, monitoring, and data gateway APIs. K8ssandra is open-source, works with the latest Cassandra releases, and continuously evolves to meet production needs of the community.</p>
<p><img src="https://cdn.sanity.io/images/bbnkhnhl/production/a312b05a8cef7351aa0825e41602439f6246c343-512x128.png" alt="K8ssandra components on kubernetes" width="512" height="128" /></p>
<p><em>Figure 1: K8ssandra is DataStax-contributed open source project that enables you to run&nbsp;</em></p>
<p>Cassandra on Kubernetes with the tools you&rsquo;ll need for production deployments.</p>
<h2>Summary</h2>
<p>As Kubernetes has evolved, so too has the technology surrounding Cassandra. With the development of the Cass Operator and K8ssandra, Kubernetes and Cassandra now provide a platform for modern cloud-native applications, including those that have stateful requirements.</p>
<p>These innovations solve some very challenging technology problems. They are proof of the commitment and talent of open-source contributors (including DataStax engineers) that made them possible. As a result, we can now claim Cassandra as the default data tier for building and running powerful, resilient, truly cloud-native data apps on Kubernetes.</p>
<p><em>Follow the&nbsp;</em><a href="https://dtsx.io/3vJIEgM"><em>DataStax Tech Blog</em></a><em>&nbsp;for more developer stories. Check out the&nbsp;</em><a href="https://dtsx.io/3yeGibI"><em>DataStax YouTube</em></a><em>&nbsp;channel for tutorials and DataStax Developers on&nbsp;</em><a href="https://dtsx.io/3MVn1QJ"><em>Twitter</em></a><em>&nbsp;for the latest news about our developer community.</em></p>
<h2>Resources</h2>
<ol>
<li><a href="https://cassandra.apache.org/_/index.html">Apache Cassandra</a></li>
<li><a href="https://www.datastax.com/products/datastax-astra">DataStax Astra DB</a>&nbsp;(Cassandra-as-a-service)</li>
<li><a href="https://dtsx.io/3Fd0o7H">Stargate</a></li>
<li><a href="https://dtsx.io/3vI2uJn">K8ssandra</a></li>
<li><a href="https://kubernetes.io/">Kubernetes</a></li>
<li><a href="https://docs.datastax.com/en/cass-operator/doc/cass-operator/cassOperatorAbout.html">Kubernetes operator for Cassandra</a></li>
<li><a href="https://www.datastax.com/blog/how-connect-stateful-workloads-across-kubernetes-clusters">How to Connect Stateful Workloads Across Kubernetes Clusters</a></li>
<li><a href="https://dtsx.io/3kFtIKo">Reclaiming Persistent Volumes in Kubernetes</a></li>
<li><a href="https://dtsx.io/3w2YEts">Deploying to Multiple Kubernetes Clusters with the K8ssandra Operator</a></li>
<li><a href="https://dtsx.io/3kXjsgZ">We Pushed Helm to the Limit, then Built a Kubernetes Operator</a></li>
<li><a href="https://dtsx.io/3LFJ1i6">Why We Decided to Build a K8ssandra Operator (Part 1)</a></li>
<li><a href="https://dtsx.io/3FdySH9">Why We Decided to Build a K8ssandra Operator (Part 2)</a></li>
<li><a href="https://dtsx.io/3OTzDcK">Why We Decided to Build a K8ssandra Operator (Part 3)</a></li>
<li><a href="https://dtsx.io/3kGbPLG">Why We Decided to Build a K8ssandra Operator (Part 4)</a></li>
</ol>

Cassandra Myth Busters: How Hard Is It to Run Cassandra on Kubernetes?

Jeff DiNoto

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale

Jeff DiNoto

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DBfor Generative AI,Instantly, At Scale

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale