Greg Stachnick

Companies often have hundreds or even thousands of existing applications that they want to bring into the AI world. Microsoft&rsquo;s Semantic Kernel is an open-source SDK that helps solve this challenge, by making it easy to build generative AI agents that can call existing code. We&rsquo;re excited to announce the new integration of Semantic Kernel and DataStax Astra DB that enables developers to more easily build upon their current codebase, vectorize the data, and build production-grade GenAI apps and AI agents that utilize the relevance and precision provided by retrieval-augmented generation (RAG).&nbsp;
<h2>What&rsquo;s so cool about Semantic Kernel?&nbsp;</h2>
<a href="https://learn.microsoft.com/en-us/semantic-kernel/overview/">Semantic Kernel</a> is a GenAI/RAG application and agent orchestration framework in Microsoft&rsquo;s stack of AI copilots and models. In many ways, it&rsquo;s similar to LangChain and LlamaIndex, but with more focus on enabling intelligent agents. Semantic Kernel provides capabilities for managing contextual conversations including previous chats, prompt history, and conversations, as well as planners for multi-step functions and connections (plug-ins) for third-party APIs to enable RAG grounded in enterprise data (learn more about why RAG is critical to generating responses that aren&rsquo;t only contextually accurate but also information-rich <a href="https://www.datastax.com/guides/what-is-retrieval-augmented-generation">here</a>).&nbsp;
Another cool thing about Semantic Kernel is that prompts written for a Python version during app iteration can be used by the C# version for much faster execution at runtime. Semantic Kernel is also proven on Microsoft Azure for Copilot and has reference frameworks for developers to build their own scalable copilots with Azure.&nbsp;
<h2>Introducing the Astra DB connector</h2>
With this in mind, we have contributed the Astra DB connector in Python. This connector enables Astra DB to function as a vector database within Semantic Kernel. It's a game-changer for developers building RAG applications that want to use Semantic Kernel&rsquo;s unique framework features for contextual conversations or intelligent agents, or for those targeting the Microsoft AI and Azure ecosystem. The integration allows for the storage of embeddings and the performance of semantic searches with unprecedented ease.
By combining Semantic Kernel with Astra DB, developers can build powerful RAG applications with extended contextual conversation capabilities (such as managing chat and prompt histories) and multi-function or planner capabilities, on a globally scalable vector database proven to give more relevant and faster query responses.&nbsp;
<h2>A performance booster for Python developers</h2>
While this release will benefit a broad swath of the GenAI developer community, it&rsquo;s of particular interest to those who work in the Microsoft/Azure ecosystem. By integrating Astra DB directly into Semantic Kernel, developers can now leverage Astra DB as a data source in their existing applications, streamlining the development process and enhancing application performance.
To add Astra DB support to a Semantic Kernel application, simply import the module and register the memory store:
<pre># import Astra DB connector import semantic_kernel as sk from semantic_kernel.connectors.memory.astradb import AstraDBMemoryStore # create Astra memory store store = AstraDBMemoryStore(ASTRA_DB_TOKEN, ASTRA_DB_ID, ASTRA_REGION, KEYSPACE, EMBEDDING_DIMENSION, SIMILARITY) #register Astra memory in Semantic Kernel Memory memory = SemanticTextMemory(storage=store, embeddings_generator=kernel.get_service("text_embedding"))</pre>
<h2>Unlocking new possibilities</h2>
The integration of Astra DB and Semantic Kernel extends beyond technical enhancements, paving the way for a range of business use cases from personalized customer service to intelligent product recommendations and beyond. It's not just about making development easier; it's about enabling the creation of more intelligent, responsive, and personalized AI applications that can transform industries.
For more information, check out the <a href="https://docs.datastax.com/en/astra/astra-db-vector/integrations/semantic-kernel.html">Astra DB documentation.</a>

Microsoft and DataStax Simplify Building AI Agents with Legacy Apps and Data

Greg StachnickProduct, DataStax

Discover more

Share

Share

What's so cool about Semantic Kernel?

Introducing the Astra DB connector

A performance booster for Python developers

Unlocking new possibilities

More Technology

How to Build a Crystal Image Search App with Vector Search

Knowledge Graphs for RAG without a GraphDB

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Vercel + Astra DB: Get Data into Your GenAI Apps Fast

One-stop Data API for Production GenAI