João Reis

On October 30, we published a new version for both DataStax C# drivers, version 3.12.0 of the <a href="https://github.com/datastax/csharp-driver">DataStax C# Driver for Apache Cassandra™</a> and version 2.9.0 of the <a href="https://www.nuget.org/packages/Dse">DataStax Enterprise C# Driver</a>, that includes the latest metrics feature. This blog post will help you quickly get started with this new feature.

<h2>Getting Started</h2>

Metrics are disabled by default. To enable this feature, client applications need to provide a metrics provider implementation. <a href="https://docs.datastax.com/en/developer/csharp-driver/3.12/features/metrics/app-metrics/">DataStax offers an implementation based on App.Metrics</a>, but you can also implement your own metrics provider and plug it in.

In this post, I’m going to show you how to run a simple console application that exports the driver metrics to Graphite using our extension based on <a href="https://github.com/AppMetrics/AppMetrics">App.Metrics</a> and how to set up a Grafana dashboard that queries the driver metrics on Graphite. To set up Graphite and Grafana you will need Docker.

You will also need a running Cassandra-compatible cluster. I’m running a cluster locally so I’ll be using the <code>127.0.0.1</code> address as a contact point.

<h3>Launch Graphite Docker Container</h3>

Let’s start by launching a Graphite Docker container to which the driver will export metrics:

<code>docker run -d --name graphite -p 80:80 -p 2003-2004:2003-2004 -p 2023-2024:2023-2024 -p 8125:8125/udp -p 8126:8126 graphiteapp/graphite-statsd</code>

If you are already using port 80, then you need to change the port mapping on the previous command.

<h3>Create Project and Install the Required Packages</h3>

The snippets here use the .NET Core CLI; you can <a href="https://dotnet.microsoft.com/download"> download the .NET Core SDK here</a>.

First, let’s create a C# console application. The following command creates a project in the current directory so you might want to create a new directory before running this command:

<code>dotnet new console</code>

To get started with the DataStax C# driver for Cassandra in a C# project, install the driver package:

<code>dotnet add package CassandraCSharpDriver -v 3.*</code>

To use the DataStax metrics provider based on App.Metrics, install the extension package:

<code>dotnet add package CassandraCSharpDriver.AppMetrics</code>

The extension package depends on App.Metrics.Abstractions but not the App.Metrics core package, so you will need to install it in your application in order to use this library:

<code>dotnet add package App.Metrics -v 3.2.0</code>

In this example, we will export metrics to Graphite, so let’s install an App.Metrics extension package that <a href="https://www.app-metrics.io/reporting/reporters/graphite/">integrates App.Metrics with Graphite</a>:

<code>dotnet add package App.Metrics.Reporting.Graphite -v 3.2.0</code>

<h3>Configuring App.Metrics</h3>

Open Program.cs in your preferred editor and add the following snippet to the Main method:

<code>var metrics = new MetricsBuilder() 
&nbsp; &nbsp; .Report.ToGraphite("net.tcp://127.0.0.1:2003") 
&nbsp; &nbsp; .Build();</code>

The previous snippet configures an App.Metrics’ IMetricsRoot object with the Graphite reporter.

You also need to start the reporter. This can be done using a Task-based scheduler that App.Metrics provides like this:

<code>var scheduler = new AppMetricsTaskScheduler( 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;TimeSpan.FromMilliseconds(10000), 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;async () =&gt; { await Task.WhenAll(metrics.ReportRunner.RunAllAsync()); });</code>

<code>scheduler.Start();</code>

Note that in this example, the reporter is reporting metrics to Graphite every 10 seconds.

<h3>Creating a Metrics-Enabled Session</h3>

To create a driver session with the default metrics enabled, you can add the following snippet to the Main method in Program.cs:

<code>var session = Cluster.Builder() &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; // cassandra running on localhost 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .AddContactPoint("127.0.0.1") 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .WithMetrics(metrics.CreateDriverMetricsProvider()) 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .Build() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .Connect();</code>

And it’s done! You now have an application that is exporting the default driver metrics to Graphite. Just run the following to launch the application:

<code>dotnet run</code>

Note that in this example we haven’t included any code that executes requests. You can add something like this to generate some metrics data:

<code>foreach (var i in Enumerable.Range(0, 20000)) 
{ 
&nbsp; &nbsp; session.Execute("SELECT * FROM system.local"); 
}&nbsp;</code>

<h3>Source Code of This Example</h3>

Here’s how the previous code snippets look when put together in a small console application:

<code>using System; 
using System.Diagnostics; 
using System.Linq; 
using System.Threading.Tasks;</code>

<code>using App.Metrics; 
using App.Metrics.Scheduling;</code>

<code>using Cassandra; 
using Cassandra.Metrics;</code>

<code>namespace DataStaxDemoMetrics 
{ 
&nbsp; &nbsp; internal class Program 
&nbsp; &nbsp; { 
&nbsp; &nbsp; &nbsp; &nbsp; public static void Main(string[] args) 
&nbsp; &nbsp; &nbsp; &nbsp; { 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; //// App Metrics configuration</code>

<code>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;// Build metrics root 
&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;var metrics = new MetricsBuilder() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .Report.ToGraphite("net.tcp://127.0.0.1:2003") 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .Build();</code>

<code>&nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;// Build and run scheduler 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; var scheduler = new AppMetricsTaskScheduler( 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;TimeSpan.FromMilliseconds(5000), 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;async () =&gt; { await Task.WhenAll(metrics.ReportRunner.RunAllAsync()); });</code>

<code>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; scheduler.Start();</code>

<code>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; //// DataStax C# Driver configuration</code>

<code>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; var session = Cluster.Builder() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp;&nbsp; &nbsp; &nbsp; &nbsp;.AddContactPoint("127.0.0.1") 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp; &nbsp; &nbsp; &nbsp;.WithMetrics(metrics.CreateDriverMetricsProvider()) 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;&nbsp; &nbsp; &nbsp; &nbsp;.Build() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.Connect(); 
&nbsp; &nbsp; &nbsp;&nbsp; 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; //// Execute some requests 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; foreach (var i in Enumerable.Range(0, 20000)) 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; { 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; session.Execute("SELECT * FROM system.local"); 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; } 
&nbsp; &nbsp; &nbsp;&nbsp; &nbsp;} 
&nbsp; &nbsp; } 
}</code>

If you’re interested in a complete example project that you can leave running while you inspect the metrics that are being exported, head over to the section “Full example project on GitHub” toward the end of this post.

<h3>Configure Grafana Dashboard</h3>

If you want to inspect the driver metrics with Grafana, you can start by launching a Grafana Docker container:

<code>docker run -d --name -p 3000:3000 grafana grafana/grafana</code>

Open Grafana using the http://127.0.0.1:3000 URL on your favorite web browser. The default username and password are admin. Set up a Graphite datasource using the http://127.0.0.1:80 URL. You might need to select “Browser” access mode, depending on how you are running Docker. You also need to change the datasource port if you mapped another port to the container’s port 80 when you launched the Graphite Docker container.

When adding a query to your dashboard, you can use this as an example of a session metric:

<code>gauge.*.connected-nodes</code>

App.Metrics adds a prefix to the path related to the metric type. Here, * is a wild card for the session name, which you can customize while initializing the driver connection with the Builder (Builder.WithSessionName(string)). If you prefer, you can also use a * as the metric type prefix instead of specifying it since the driver metric names are unique.

Here is an example of a node metric:

<code>gauge.*.nodes.*.pool.open-connections.Value</code>

Here, the second * is a wild card for the node’s address.

I have uploaded an <a href="https://grafana.com/grafana/dashboards/11090">example dashboard to Grafana.com</a> which you can use to test this feature. It uses Timer metrics which are not enabled by default in the driver. To enable all metrics you can do this: 
<code>&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; 
var cluster = Cluster.Builder() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.AddContactPoint("127.0.0.1") 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.WithMetrics( 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;metrics.CreateDriverMetricsProvider(), 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;new DriverMetricsOptions() 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .SetEnabledNodeMetrics(NodeMetric.AllNodeMetrics) 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; .SetEnabledSessionMetrics(SessionMetric.AllSessionMetrics)) 
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;.Build();</code>

<h3>Full Example Project on GitHub</h3>

You can find a <a href="https://github.com/datastax/csharp-driver/blob/master/examples/Metrics/AppMetricsGraphite/Program.cs">small example project on the driver’s repository</a> that contains the full source code of a small console application that exports metrics to Graphite while executing requests until the user presses ENTER. It is a useful application to leave running while analyzing the metrics on the Grafana dashboard, for example.

Here is a screenshot of the <a href="https://grafana.com/grafana/dashboards/11090">dashboard I’ve mentioned previously</a> while running this example project:

<code><img alt="Dashboard Running Example Project" data-entity-type="file" data-entity-uuid="b4eee7da-b624-461c-8829-0dbd643cef8c" src="https://www.datastax.com/sites/default/files/inline-images/EINZh7tWkAENuwK.png" /></code>

<h3>Acknowledgements</h3>

A special thanks to <a href="https://github.com/Umqra">Sivukhin Nikita</a> for kick-starting the discussion and developing a prototype in the initial development stages of this feature which helped us move forward and make this available to everyone in the community.

<h3>Wrapping Up</h3>

In this post, I showcased a way to use this metrics feature but you can use this feature in a variety of ways with a variety of technologies. You can even implement your own metrics provider instead of using our App.Metrics-based provider.

If you are interested in finding out more about this topic, you can go <a href="https://docs.datastax.com/en/developer/csharp-driver/3.12/features/metrics/">here to read more about metrics in the DataStax C# Driver for Apache Cassandra</a> and <a href="https://docs.datastax.com/en/developer/csharp-driver-dse/2.9/features/metrics/">here to read more about metrics in the DataStax Enterprise C# Driver</a>.

A New Feature of the DataStax C# Drivers: Metrics

João Reis

Discover more

Share

Share

Getting Started

Launch Graphite Docker Container

Create Project and Install the Required Packages

Configuring App.Metrics

Creating a Metrics-Enabled Session

Source Code of This Example

Configure Grafana Dashboard

Full Example Project on GitHub

Acknowledgements

Wrapping Up

More Technology

How to Build a Crystal Image Search App with Vector Search

Knowledge Graphs for RAG without a GraphDB

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Vercel + Astra DB: Get Data into Your GenAI Apps Fast

One-stop Data API for Production GenAI