Kathryn Erickson

In April 2018, we released <a href="https://www.datastax.com/2018/04/datastax-enterprise-6-the-distributed-cloud-database-designed-for-hybrid-cloud">DataStax</a> <a href="https://www.datastax.com/2018/04/datastax-enterprise-6-the-distributed-cloud-database-designed-for-hybrid-cloud">Enterprise</a><a href="https://www.datastax.com/2018/04/datastax-enterprise-6-the-distributed-cloud-database-designed-for-hybrid-cloud"> (</a><a href="https://www.datastax.com/2018/04/datastax-enterprise-6-the-distributed-cloud-database-designed-for-hybrid-cloud">DSE</a><a href="https://www.datastax.com/2018/04/datastax-enterprise-6-the-distributed-cloud-database-designed-for-hybrid-cloud">) 6</a> and revealed to the market that it was twice as fast as Cassandra or any previous version of DSE. The <a href="https://www.datastax.com/2018/04/dse-advanced-performance-apache-cassandra-goes-turbo">performance</a> <a href="https://www.datastax.com/2018/04/dse-advanced-performance-apache-cassandra-goes-turbo">improvements</a> included a new thread-per-core asynchronous architecture and major storage engine improvements.

We would never have imagined that 12 months later <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">Intel</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">would</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">release</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">hardware</a> that more than doubles the performance gap between DSE and Cassandra. The secret lies within the second <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">generation</a> <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">of</a> <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">Intel</a><a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">’</a><a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">s</a> <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">Scalable</a> <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">processors</a>, which have optimizations specifically for their new <a href="https://www.intel.com/content/www/us/en/products/memory-storage/optane-dc-persistent-memory.html">Optane</a><a href="https://www.intel.com/content/www/us/en/products/memory-storage/optane-dc-persistent-memory.html">™ </a><a href="https://www.intel.com/content/www/us/en/products/memory-storage/optane-dc-persistent-memory.html">Persistent</a> <a href="https://www.intel.com/content/www/us/en/products/memory-storage/optane-dc-persistent-memory.html">Memory</a> <a href="https://www.intel.com/content/www/us/en/products/memory-storage/optane-dc-persistent-memory.html">Module</a>.

When you combine our innovations with Intel’s, you get a database, CPU, and storage system that are optimized for working closely together.

Let's break it down:

<ul>
	<li>DataStax thread-per-core architecture assigns each token range a thread and each thread is assigned a CPU core.</li>
	<li>To eliminate thread contention in the new design, DataStax made reads, writes, and other tasks asynchronous throughout the entire platform.</li>
	<li>Intel recognized that more threads and more paths to memory were required for scale-out systems and offered the scalable Xeon® series with two dies per CPU socket (meaning you’ll see two CPUs per socket).</li>
	<li>Intel provided additional <a href="https://www.intel.com/content/www/us/en/products/docs/processors/xeon/2nd-gen-xeon-scalable-processors-brief.html">optimizations</a> (such as single-hop routing) for accessing <a href="https://www.intel.com/content/www/us/en/products/docs/memory-storage/optane-technology/what-is-optane-technology-brief.html">Optane</a><a href="https://www.intel.com/content/www/us/en/products/docs/memory-storage/optane-technology/what-is-optane-technology-brief.html">™ </a><a href="https://www.intel.com/content/www/us/en/products/docs/memory-storage/optane-technology/what-is-optane-technology-brief.html">storage</a>, resulting in latency as low as 79 nanoseconds (yes, nanoseconds).</li>
</ul>

Based on our benchmark findings, the performance of unmodified DSE looks great and further serves to demonstrate the advantages of <a href="https://www.datastax.com/2018/04/dse-advanced-performance-apache-cassandra-goes-turbo">DSE</a> <a href="https://www.datastax.com/2018/04/dse-advanced-performance-apache-cassandra-goes-turbo">Advanced</a> <a href="https://www.datastax.com/2018/04/dse-advanced-performance-apache-cassandra-goes-turbo">Performance</a> over Cassandra.

The benchmark used DSE 6.7 and DataStax Distribution of Apache Cassandra™ (based on Cassandra 3.11) to compare the new Intel® Optane™ Persistent Memory Module’s performance against NVMe drives. All tests were done on a 4-node cluster packed with 40-core Cascade Lake Xeon® Scalable data center processors.

These were the results:

<ul>
	<li>For write workloads, DSE 6.7 throughput is approximately 2x higher (better) on Optane™ compared to the latest NVMe drives we tried, and 99th percent latencies are under 20ms.</li>
	<li>For mixed and read-heavy workloads, DSE 6.7 throughput is up to 4x higher on Optane™ than NVMe.</li>
	<li>DSE Advanced Performance features love this hardware. DSE 6.7 achieves 5x the throughput of Cassandra, while at the same time delivering an almost 4x reduction in p99 latency (lower is better).</li>
	<li>Although Cassandra write-heavy workloads didn’t benefit as much from the new hardware, evenly mixed and read-heavy workloads were also up to 5x faster with Optane™.</li>
</ul>

<img alt="graph comparing throughput of DSE, DDAC, and NVMe" src="https://www.datastax.com/sites/default/files/content/blog/Intel-DataStax-1.png" />

<img alt="graph comparing P99% latency of DSE, DDAC, and NVMe" src="https://www.datastax.com/sites/default/files/content/blog/Intel-DataStax-2.png" />

<h2>The Takeaway</h2>

If you haven’t upgraded to DSE 6 or 6.7, you really should. If you have upgraded and want more performance without data model changes, you should check out <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">Intel</a><a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">'</a><a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">s</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">latest</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">product</a> <a href="https://newsroom.intel.com/news-releases/intel-data-centric-launch/">line</a>.

It’s been incredible watching Intel innovate in this space. No other company is positioned to combine CPU and storage innovation in such a revolutionary way. We’re also working closely with Intel on software innovations they’re making around Cassandra.

We’ll be previewing these ideas at our inaugural user conference, <a href="https://www.datastax.com/accelerate">DataStax</a> <a href="https://www.datastax.com/accelerate">Accelerate</a>, in Maryland on May 21–23, 2019. Shoot our partner team an email and reference this blog for a conference discount code:&nbsp;<a href="mailto:techpartner@datastax.com">techpartner</a><a href="mailto:techpartner@datastax.com">@</a><a href="mailto:techpartner@datastax.com">datastax</a><a href="mailto:techpartner@datastax.com">.</a><a href="mailto:techpartner@datastax.com">com</a>.

<h2>The Power of an Active Everywhere Database (White Paper)</h2>

<a href="/resources/whitepapers/the-power-of-an-active-everywhere-database=" title="datastax.com">READ NOW</a>

New Intel® Hardware Pushes DSE Even Further Ahead of Apache Cassandra™

Kathryn EricksonStrategy

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale