TechnologyOctober 31, 2023

Build LLM-Powered Applications Faster with LangChain Templates and Astra DB

Aaron Ploetz
Aaron PloetzDeveloper Relations, DataStax
Build LLM-Powered Applications Faster with LangChain Templates and Astra DB
pip install -U "langchain-cli[serve]"
langchain app new cassandraEntomologyRAG --package cassandra-entomology-rag
from cassandra_entomology_rag import chain as cassandra_entomology_rag_chain

add_routes(app, cassandra_entomology_rag_chain, path="/cassandra-entomology-rag")
from fastapi import FastAPI
from langserve import add_routes
from cassandra_entomology_rag import chain as cassandra_entomology_rag_chain

app = FastAPI()

add_routes(app, cassandra_entomology_rag_chain, path="/cassandra-entomology-rag")

if __name__ == "__main__":
    import uvicorn

    uvicorn.run(app, host="0.0.0.0", port=8000)
export OPENAI_API_KEY="xy-..."
export ASTRA_DB_ID="01234567-..."
export ASTRA_DB_APPLICATION_TOKEN="AstraCS:xY......"
export ASTRA_DB_KEYSPACE="default_keyspace"
langchain serve
Discover more
LangChain
Share

NoSQL and Vector DB
for Generative AI,
Instantly, At Scale

Vector search capabilities on Astra DB enable complex, context-sensitive searches across diverse data formats for use in Generative AI applications, powered by Apache Cassandra®.