Toggle Menu

Astra/Spark Migration Tool

Migrate data from an existing Cassandra cluster to Astra using a Spark application.

40 minutesExpert

Updated


Astra/Spark Migration Tool

40 minutes, Expert, Start Building

Migrate data from an existing Cassandra cluster to Astra using a Spark application.

image

Objectives

  • Leverage Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.

How this works

We're using Spark to migrate data from a Cassandra cluster to Cassandra on AstraDB.

Get Started

To build and play with this app, follow the build instructions that are located here: https://github.com/DataStax-Examples/astra-spark-migration

Running Astra/Spark Migration Tool

Follow the instructions below to get started.

Prerequisites

Let's do some initial setup by creating a serverless(!) database.

DataStax Astra

  1. Create a DataStax Astra account if you don't already have one:

image

  1. On the home page. Locate the button Create Database

image

  1. Locate the Get Started button to continue

image

  1. Define a database name, keyspace name and select a database region, then click create database.

image

  1. Your Astra DB will be ready when the status will change from Pending to Active 💥💥💥

image

  1. After your database is provisioned, we need to generate an Application Token for our App. Go to the Settings tab in the database home screen.

image

  1. Select Admin User for the role for this Sample App and then generate the token. Download the CSV so that we can use the credentials we need later.

image

  1. After you have your Application Token, head to the database connect screen and select the driver connection that we need. Go ahead and download the Secure Bundle for the driver.

image

  1. Make note of where to use the Client Id and Client Secret that is part of the Application Token that we generated earlier.

image

Github

  1. Click Use this template at the top of the GitHub Repository:

image

  1. Enter a repository name and click 'Create repository from template':

image

  1. Clone the repository:

image

Create your Account and get started!

Let's Go!
View on GitHubDeploy to NetlifyDeploy to Vercel