Michael Fero

<p>Over the past couple of months, we’ve released new versions of our C/C++ drivers for DataStax Enterprise (v1.6.0+) and Apache Cassandra (v2.10.0+). These releases fundamentally changed the internals of the C/C++ drivers and are the biggest releases for the driver since the initial <a href="https://www.datastax.com/dev/blog/datastax-c-driver-1-0-ga-released">1.0.0 release</a>. They included a complete refactor of the internal components and increased test coverage. The refactor has to lead to substantially improved performance, decreased resource utilization, and it has enabled us to better unit test internal components.</p>

<h2>Performance</h2>

<p>This release of the driver has substantially improved throughput.</p>

<p><img alt="Final Rate" data-entity-type="file" data-entity-uuid="73be6834-54c6-4037-a036-db90884419f1" src="https://www.datastax.com/sites/default/files/inline-images/final_rate_0.png" /></p>

<p>This was accomplished in two ways.</p>

<p>First, we’ve eliminated the need for requests to be processed by a single shared session thread. Instead, requests are queued and directly processed on the thread that processes I/O for the request. This change also decreases CPU utilization because only a single thread is required to process a request instead of two.</p>

<p>The second way we’ve increased driver’s throughput is by upgrading the driver’s I/O handling. More specifically, we’ve improved the driver’s ability to coalesce requests into a fewer number of system calls and the driver better balances processing of new requests against requests that are already being processed.</p>

<p><img alt="95th Percentile" data-entity-type="file" data-entity-uuid="c05136da-1a9d-4b9e-92af-09de0dc05913" src="https://www.datastax.com/sites/default/files/inline-images/95th.png" /></p>

<h2>Workload Configuration</h2>

<p>1 CPU with 8 cores (2.0 ghz)A simple client/server setup was used with <a href="https://www.hpe.com/us/en/servers/moonshot.html">HPE Moonshot System</a> and the <a href="https://www.hpe.com/us/en/product-catalog/servers/moonshot-systems/pip.hpe-proliant-m510-server-cartridge.1009019439.html">ProLiant m510 Server Cartridge</a>:</p>

<ul>
	<li>Hyperthreading enabled resulting in 16 HT cores</li>
	<li>64 GB RAM</li>
	<li>2x1 TB SSD</li>
	<li>Ubuntu 18.04 LTS</li>
</ul>

<p>In order to keep things easily repeatable, DataStax Enterprise v6.0.3 was configured for a 3-node cluster using the default configuration. The client performance application used v1.6.0 of DataStax C/C++ driver for DataStax Enterprise and was configured to use 13 I/O threads with 2 threads at the application level. Each performance run utilized a payload of 256 bytes using prepared statements, 5,000 concurrent requests for 5,000,000 total requests.</p>

<p>The schema used in this workload is designed to benchmark the driver. To test the driver's maximum request throughput and reduce server-side load we used a keyspace with a replication factor of 1, a simple key/value pair table schema, and a consistency level of LOCAL_ONE for all request types.</p>

<p><code>CREATE KEYSPACE IF NOT EXISTS</code></p>

<p><code>keyspace1 WITH replication = { 'class': 'SimpleStrategy', 'replication_factor': '1'}; </code></p>

<p><code>CREATE TABLE IF NOT EXISTS keyspace1.table1 (key uuid PRIMARY KEY, value varchar); </code></p>

<h2>Testing</h2>

<p>In this version of the C/C++ driver internal components have been explicitly designed for testability. We’ve added greater than 60% more unit tests since the previous GA release and plan to continue increasing coverage in future releases.</p>

<h2>What's Next</h2>

<p>The improvements in this release are a solid foundation for future features and improvements. Here are some of the things we are considering for upcoming releases:</p>

<ul>
	<li>Improve connection utilization for large clusters</li>
	<li>Improve performance and reduce allocations</li>
	<li>Design a first class, object-based C++ API</li>
	<li>Improve DSE graph integration utilizing the object-based C++ API</li>
</ul>

<p>Get involved in the next release, we use your feedback to prioritize specific improvements and features. To get involved use the following resources:</p>

<ul>
	<li>JIRA: <a href="https://datastax-oss.atlassian.net/browse/CPP">https://datastax-oss.atlassian.net/browse/CPP</a></li>
	<li>Mailing List: <a href="https://groups.google.com/a/lists.datastax.com/forum/#!forum/cpp-driver-user">https://groups.google.com/a/lists.datastax.com/forum/#!forum/cpp-driver-user</a></li>
	<li>DataStax Academy: <a href="https://academy.datastax.com/slack">https://academy.datastax.com/slack</a></li>
	<li>Use channel #datastax-drivers&nbsp;</li>
</ul>


C/C++ Driver Performance Enhancements

Michael Fero

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale

Michael Fero

Discover more

Share

More Company

DataStax Astra DB Nabs Three Prestigious 2023 TrustRadius “Best of” Awards, Dominates the Vector Databases Category

DataStax Has Achieved ISO 27001 Certification

Keeping the Momentum Rolling with Google Cloud

My Internship Journey: A Dive into AI

NoSQL and Vector DBfor Generative AI,Instantly, At Scale

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale