Pieter Humphrey

Welcome to part 2 of our &ldquo;AI as an API&rdquo; series! In this post, you&rsquo;ll learn how to configure a virtual machine and deploy your machine learning REST API using Linode, Docker, cryptography, and <a href="https://www.datastax.com/products/datastax-astra">DataStax Astra DB</a>.
If you haven&rsquo;t yet gone through part 1, <a href="https://www.datastax.com/blog/how-to-train-a-machine-learning-model-as-a-rest-api-and-build-a-spam-classifier-part-1">&ldquo;How to Train a Machine Learning Model as a REST API and Build a Spam Classifier</a>,&rdquo; we highly recommend you do that. Part 1 covered how to:
<ul>
<li style="font-weight: 400;" aria-level="1">Create, train, and test a machine learning (ML) model and get it ready for production</li>
<li style="font-weight: 400;" aria-level="1">Prepare spam datasets for ML using Python, Jupyter Notebook, and Keras</li>
<li style="font-weight: 400;" aria-level="1">Train a Long Short-Term Memory (LSTM) ML model using Keras</li>
<li style="font-weight: 400;" aria-level="1">Convert the ML model into production-ready REST API with FastAPI</li>
<li style="font-weight: 400;" aria-level="1">Integrate AI as an API with <a href="http://astra.datastax.com">Astra DB</a> and test it with ngrok</li>
</ul>
Part 1 can seem like a straightforward process. But we do recommend going through it, so you&rsquo;ve got all you need to deploy your AI as an API into production using a virtual machine.
This <a href="https://youtu.be/nTdMjFcK3SM?t=0">step-by-step video</a> tutorial is taught by the founder of <a href="https://www.codingforentrepreneurs.com/">Coding for Entrepreneurs</a>, Justin Mitchel, and sponsored by DataStax. It will show you how to:
<ul>
<li style="font-weight: 400;" aria-level="1">Provision a virtual machine and configure a virtual environment on a cloud provider</li>
<li style="font-weight: 400;" aria-level="1">Clone a public project and private repository</li>
<li style="font-weight: 400;" aria-level="1">Install Docker and configure Dockerfile</li>
<li style="font-weight: 400;" aria-level="1">Connect to Astra DB using cryptography</li>
</ul>
<h2>What you need to deploy your ML model</h2>
You&rsquo;ll be working heavily with Python today. So it&rsquo;s essential to have experience with classes, variables, functions, and running Python requests. If you need more training with Python, check out the Coding for Entrepreneurs&rsquo; <a href="https://www.codingforentrepreneurs.com/projects/30-days-python-38">30 days of Python series</a>.
You&rsquo;ll also need the code for this tutorial on <a href="https://github.com/codingforentrepreneurs/AI-as-an-API-Course-Reference">AI as an API Course Reference GitHub</a>. Don&rsquo;t forget to download and install the required technologies from this <a href="https://github.com/codingforentrepreneurs/AI-as-an-API-Course-Reference/blob/main/requirements.txt">requirements.txt on GitHub</a>.
The main technologies that you&rsquo;ll work with today include:
<ul>
<li style="font-weight: 400;" aria-level="1"><a href="http://astra.datastax.com">Astra DB</a>, DataStax&rsquo;s database-as-a-service built on <a href="https://cassandra.apache.org/_/index.html">Apache Cassandra&reg;</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.linode.com/">Linode</a>, a cloud-computing platform</li>
<li style="font-weight: 400;" aria-level="1"><a href="https://jupyter.org/">Jupyter Notebook</a>, a web-based interactive computing platform</li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.docker.com/">Docker</a>, a set of platform as a service products that use OS-level virtualization to deliver software in packages called &ldquo;containers&rdquo;</li>
</ul>
<h3>1. Pick a cloud provider</h3>
Creating AI applications is a time-consuming and complex process. Cloud vendors simplify it by offering affordable APIs. Let&rsquo;s begin by selecting a cloud provider for our production application. We have three criteria:
<ol>
<li style="font-weight: 400;" aria-level="1">Access to a virtual machine: it&rsquo;s crucial to control everything about the environment your application runs on. Because we need to install the version of TensorFlow we want to load in our Keras model</li>
<li style="font-weight: 400;" aria-level="1">Ease of use: easy access to all needed resources so you can experiment extensively</li>
<li style="font-weight: 400;" aria-level="1">Access to a GPU: allows you to train the ML model on the cloud service</li>
</ol>
All things considered, we picked <a href="https://www.linode.com/">Linode</a> as our cloud provider for this tutorial.
You can also use:
<ul>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.digitalocean.com/products/droplets/">Digital Ocean Droplet</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://aws.amazon.com/ec2/">Amazon EC2</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://cloud.google.com/compute">Google Cloud Compute Engine</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://azure.microsoft.com/en-us/">Microsoft Azure Virtual Machines</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.raspberrypi.org/">Raspberry Pi</a>&nbsp;</li>
</ul>
We don&rsquo;t recommend <a href="https://www.digitalocean.com/products/app-platform/">DigitalOcean App Platform</a> or <a href="https://www.heroku.com/">Heroku</a>. Controlling the entire environment is either more complex or not possible.
If controlling the environment on the virtual machine from scratch sounds intimidating, don&rsquo;t worry. In reality, it&rsquo;s not that challenging. We&rsquo;ll guide you through it in this tutorial with pre-set codes and in-depth instructions.
<h3>2. Set up your virtual machine</h3>
A virtual machine helps scale your machine learning model for production. You&rsquo;ll set up your virtual machine and run the model on both local and virtual environments together. Here&rsquo;s what you need to do:
<ol>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=152">Generate a Secure Shell (SSH) key and load it to your cloud provider</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=471">Provision your first virtual machine on the cloud provider</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=972">Install GIT and Python PIP on your local and virtual machines</a></li>
</ol>
Now you&rsquo;re ready to deploy the codes on <a href="https://github.com/codingforentrepreneurs/AI-as-an-API-Course-Reference">AI as an API Course Reference GitHub</a> into production. Follow the instructions in the <a href="https://youtu.be/nTdMjFcK3SM?t=1163">video</a> to clone them to your personal project. You can clone a private repository instead of the public project. Find a simple way to do this <a href="https://youtu.be/nTdMjFcK3SM?t=1370">here</a>.
<h3>3. Work with Docker</h3>
The next step is to install Docker on your virtual machine. Docker is a virtualization software for building, running, and managing containers on servers and the cloud.
Docker lets you easily reproduce the working environment used to train and run the ML model anywhere. It also ensures that our virtual and local environments are identical for both environments to work properly. Learn how to install Docker <a href="https://youtu.be/nTdMjFcK3SM?t=1722">here</a> and find a working example with nginx <a href="https://youtu.be/nTdMjFcK3SM?t=2009">here</a>.
Then, create a Dockerfile to get the REST API application running. A Dockerfile is a text document containing commands for Docker to correctly configure the environment. It&rsquo;s similar to what we&rsquo;ve been doing manually with our virtual machine.
<img src="https://cdn.sanity.io/images/bbnkhnhl/production/ec02cca04b125af313e25d8d1c827d9cd352d207-761x426.png" alt="Figure 1: The Dockerfile configuration you need for this tutorial at the baseline level" width="761" height="426" />Figure 1: The Dockerfile configuration you need for this tutorial at the baseline level
 Watch the video to <a href="https://youtu.be/nTdMjFcK3SM?t=2264">add and configure the Dockerfile</a> and <a href="https://youtu.be/nTdMjFcK3SM?t=2776">build Docker project and enter Docker bash</a>. Your Dockerfile should now run on your virtual machine. Next, <a href="https://youtu.be/nTdMjFcK3SM?t=3183">add and activate environment variables</a> to your virtual machine and Dockerfile for it to work on your production machine. Finally, activate the virtual machine and <a href="https://youtu.be/nTdMjFcK3SM?t=3779">implement pypyr pipelines</a> to automate this process. 
<img src="https://cdn.sanity.io/images/bbnkhnhl/production/5feaed899b64f0c9ecc10560802354545ac203bf-671x432.png" alt="Figure 2: Dockerfile with environment variables" width="671" height="432" /> Figure 2: Dockerfile with environment variables 
<h3>4. Connect Astra DB with cryptography</h3>
The last step before you run your ML application is to add the <a href="http://astra.datastax.com">Astra DB</a> connection to your Dockerfile. Here are the steps to do this with links to the exact time stamps in the video:
<ol>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=4100">Secure a directory with cryptography on Jupyter Notebook</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=4847">Convert what you did on Jupyter Notebook to an actual reusable encryption module</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=5379">Create pipelines for encryption and decryption</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://youtu.be/nTdMjFcK3SM?t=5768">Update the production environment with the encryption key</a></li>
</ol>
You should now have a production version of your AI as an API running and working. We tested the application out and it returned all the datasets that we stored in part 1.
<img src="https://cdn.sanity.io/images/bbnkhnhl/production/24aa1822be40c2000f9fd441f2ca5a343dc32ff6-1301x648.png" alt="Figure 3: AI as an API production version" width="1301" height="648" /> Figure 3: AI as an API production version
<h2>Conclusion</h2>
AI as an API service has countless applications in our everyday lives, from language processing to data discovery. This makes it a high-demand field.&nbsp;
If you&rsquo;ve followed this tutorial, you&rsquo;ve now seen how to deploy your AI as an API model into production using a virtual machine. A lot of this was done manually so you can learn the process in-depth. Once you&rsquo;re familiar with the process, you can work towards automating it.
Our challenge for you from here is to create a new dataset, build and train a ML model, and launch your own REST API service. Check out <a href="https://www.datastax.com/blog/how-to-web-scrape-on-a-schedule-with-apache-cassandra-fastapi-and-python">How to Web Scrape on a Schedule with Apache Cassandra, FastAPI, and Python</a> to help you manage database queries too.&nbsp;
Tag <a href="https://dtsx.io/3vA12c2">DataStax Developers on Twitter</a> if you successfully completed this series &ndash; especially if you&rsquo;re starting your own process from scratch. Check out our <a href="https://dtsx.io/38HwUme">YouTube channel</a> for tutorials and for the latest news about our developer community.
<h2>Resources</h2>
<ol>
<li style="font-weight: 400;" aria-level="1"><a href="http://astra.datastax.com">Astra DB: Multi-cloud DBaaS nuilt on Cassandra</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://cassandra.apache.org/_/index.html">Apache Cassandra</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://dtsx.io/38HwUme">DataStax YouTube</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.youtube.com/watch?v=nTdMjFcK3SM">YouTube Tutorial: AI as an API Part 2</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.codingforentrepreneurs.com/">Coding for Entrepreneurs</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://dtsx.io/3ku513x">AI as an API Course Reference GitHub</a></li>
<li style="font-weight: 400;" aria-level="1"><a href="https://www.codingforentrepreneurs.com/projects/30-days-python-38">30 Days of Python Series</a></li>
</ol>

Deploy a Machine Learning Model REST API using Linode, Encryption, Docker & Astra DB (Part 2)

Pieter HumphreyDevelopers

Discover more

Share

Share

What you need to deploy your ML model

1. Pick a cloud provider

2. Set up your virtual machine

3. Work with Docker

4. Connect Astra DB with cryptography

Conclusion

Resources

More Technology

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Vercel + Astra DB: Get Data into Your GenAI Apps Fast

Simplifying Agent Development with Astra DB Connector for Vertex AI Search

Making Astra DB easier for MongoDB developers

One-stop Data API for Production GenAI