CompanyOctober 13, 2022

From geo-replication to advanced CDC—here’s what’s new in Astra Streaming

David Dieruf
David DierufDeveloper Advocate, Streaming at DataStax
From geo-replication to advanced CDC—here’s what’s new in Astra Streaming

Here’s your fix for the latest in streaming at DataStax. Our team is always here to help you with anything Apache Pulsar™ related. Astra Streaming is a multi-cloud streaming-as-a-service platform built on Apache Pulsar™. Want to learn more? Head over here.

Features and Enhancements

Asynchronous geo-replication

Replicate your messages in different regions of different cloud providers with a check of a box! A perfect example of how Astra Streaming takes all the operations complexities away and lets you get to the messaging. Read more in the docs.

GCP Australia region added

Another addition to our list of supported regions. Your excuses for not using Astra are running out.

Astra Streaming is the easiest way to get a free Apache Pulsar cluster running in no time.

Get started today!

Multiple input topics for sink connectors

Data isn't coming from a single source, it’s coming from a ton of sources. So we added the ability to create a single sink connector that watches many different topics at once.

Pulsar IO connectors

Connectors are made of sources and sinks. While Astra Streaming UI makes it super easy to manage both connector types, going to production usually means automation. So we rebuilt the connectors area in documentation to include a full reference for pulsar-admin and curl. That includes create, remove, update, and everything in between. There’s a table of possible values and direction for observability as well. See the full reference.

Oh! Speaking of connectors, we also opened up the full list of experimental connectors. Apache Pulsar’s ecosystem is constantly expanding and Astra Streaming manages them all. See something you like? Drop the team an email and we’ll get you going.

Astra Streaming is currently using Luna Streaming 2.10 1.7. Read the latest release notes.

Documentation and Code

Scrape Astra Streaming metrics with Prometheus

If you didn’t believe us when we said Astra Streaming has all the features of Apache Pulsar without the operations, this should convince you. Each of your tenants in Astra Streaming has metrics that your Prometheus instance can scrape. Read more in the docs.

Extended and advanced CDC examples

A collection of common producer and consumer techniques. Most of them have to do with CDC for Astra DB and (more specifically) consuming structured Avro messages from a topic. Here’s the GitHub repo.

Learn more about Apache Pulsar in our YouTube playlist:
5 Minutes about Apache Pulsar

Articles and Recordings

Data, Data, Everywhere: How Titanium Built a Cloud IoT Platform

The IoT industry is evolving to support a wide range of use cases and operating models. Titanium's broad SaaS platform was built to tackle the array of IoT challenges that business and IT leaders face. Read more.

Observer Versus Pub-Sub Design Patterns

What are the differences between the Publish Subscribe (Pub-Sub) pattern and the Observer pattern? Let’s compare and contrast the two with use cases and look at how Apache Pulsar can be that missing link. Read more.

Event Streaming and Event Sourcing: The Key Differences

Event sourcing and event sourcing help coordinate events in an event-driven architecture. Together they help build a durable, high-performance application. Read more.

Don’t Break that App: Manage Schema Change with Apache Pulsar

Pulsar supports schema evolution, helping consumers to understand data in both the old and new formats as changes occur. Read more.

Cassandra, Pulsar and good ol’ Spring Boot — build reactive applications like a boss!

Look at how we can improve your application experience by taking real-time data and using it to power decision-making within your application. The example in this article is sending flight radar data from a streaming platform to the application to notify users of real-time events. Read more.

Getting Started with the Apache Pulsar Java Client

Get hands-on with Apache Pulsar’s Java client and create a message producer and consumer. Read more.

Get Support

Discover more
DataStax Astra DBReleases

One-stop Data API for Production GenAI

Astra DB gives JavaScript developers a complete data API and out-of-the-box integrations that make it easier to build production RAG apps with high relevancy and low latency.