Betul O'Reilly

Jan Schummers

<a href="https://winweb.de/">Winweb</a> specializes in ERP software for the food and wholesale sectors. It ensures compliance, streamlines processes, and offers comprehensive functionalities like batch tracking and inventory management.
In response to the growing demand for streamlined client support and the desire to stay ahead in technological advancements, Winweb embarked on an ambitious journey to integrate AI into its customer service infrastructure. Recognizing the potential of AI-driven solutions to improve customer interactions, Winweb set out to develop an AI Assistant.This intelligent assistant is trained to answer questions about Winweb by obtaining information from the WinwebWiki and winweb-food help.
Through the collaboration with <a href="https://www.datastax.com/">DataStax</a>, Winweb introduced a chatbot powered by <a href="https://www.datastax.com/guides/what-is-retrieval-augmented-generation">retrieval-augmented generation (RAG)</a>, which enables Winweb to respond precisely to complex queries by performing targeted searches across diverse information sources. The result? Winweb customers gain access to highly relevant and accurate information, significantly enhancing their interaction with the service.&nbsp;
<img style="display: block; margin-left: auto; margin-right: auto;" src="https://cdn.sanity.io/images/bbnkhnhl/production/5682ccd7818bd2daeafeea1e3fe53d5f792434d9-940x788.gif" alt="" width="600" height="503" />
<h2>Technology Stack Overview</h2>
<img style="display: block; margin-left: auto; margin-right: auto;" src="https://cdn.sanity.io/images/bbnkhnhl/production/14cb1e59470c44d6ba5e6d5bba76b46d1dff508a-683x755.png" alt="" width="500" height="553" />
<h2>Retrieval Augmented Generation (RAG) Flow</h2>
<img style="display: block; margin-left: auto; margin-right: auto;" src="https://cdn.sanity.io/images/bbnkhnhl/production/154f04a3ada96efa9882605c241339fc004dd71b-833x705.png" alt="" width="500" height="423" />
Content from platforms such as WinwebWiki and winweb-food help, along with Toggle features, is transformed into embeddings for storage in <a href="https://www.datastax.com/products/datastax-astra">DataStax Astra DB</a>, converting text into dense vector formats. WinwebWiki data is sourced through GraphQL from PostgreSQL, and functionality toggles are managed through SQL Server queries. Content from the winweb-food help site is also extracted as HTML files, allowing for efficient handling and retrieval of diverse data types in a unified database environment.
A custom service, crafted with Python, Flask, and Docker, facilitates access to this database. Designed to dynamically scale with request volume, it's hosted on Google Cloud Run, with Google Firebase for app hosting, and Google Cloud Storage managing files. This interface handles queries from Winweb apps or winweb-food, executing searches within the vector database to swiftly deliver the most relevant documents, thereby ensuring real-time data access and response.
Winweb is currently using Azure OpenAI's GPT 4 as the LLM and text-embedding-ada-002 as the embedding model. It integrated LangChain to load and retrieve data from Astra DB efficiently.&nbsp;
Winweb considered other vector solutions including Pinecone but factors such as scalability, performance, and cost influenced their decision to go with Astra DB.&nbsp;
<h2>Safeguarding Customer Data</h2>
Prioritizing <a href="https://www.datastax.com/resources/whitepaper/astra-security">the most stringent data protection standards</a>, Winweb and DataStax ensure that customer data is secured by employing current encryption protocols and hosting all servers within the European Union. This commitment subjects all data processing activities to the robust EU data protection guidelines.
<h2>Results</h2>
Winweb&rsquo;s journey from proof of concept (POC) to full production deployment with Astra DB was accomplished in less than 30 days, showcasing its efficiency and ease of integration. Winweb&rsquo;s AI Assistant has significantly slashed the time required to find answers from its wiki pages. By leveraging the chatbot, the time required to locate the correct information is expected to be reduced by 20X. Previously, users had to sift through several wiki and help pages to find answers. Now, the chatbot simplifies this by synthesizing data from multiple sources into a singular, coherent response, significantly improving efficiency and user experience.
Additionally, the chatbot is anticipated to decrease the volume of support required for first-level use cases, which typically represent around 10 percent of all cases. This reduction is expected to optimize support workflows and improve overall operational efficiency.
<h2>What&rsquo;s Next?</h2>
Winweb&rsquo;s next project is to develop custom chatbots tailored to each customer's specific domain data, utilizing <a href="https://www.datastax.com/blog/datastax-acquires-langflow-to-accelerate-generative-ai-app-development">Langflow</a> to significantly decrease the time required to set up these multiple chatbots. Langflow's streamlined approach to component integration and its array of prebuilt connections and visual tools will enable Winweb to experiment and iterate at an unprecedented pace.
Furthermore, they're looking to implement <a href="https://arxiv.org/abs/2306.00739">text2SQL</a> features, enabling customers to interact more effectively with their sales data. This strategy aims to improve customer experience by offering more customized and interactive tools for providing deeper, contextually rich engagements with their own data.
Different embedding models can also encode nuanced meanings in unique ways so Winweb will continue experimenting with a range of models which embeddings&nbsp; produce the most accurate and relevant results, fine-tuning their systems to excellence. The Astra DB and Langchain framework simplifies the process of transitioning between various embedding models with minimal effort.
<h2>Conclusion</h2>
The deployment of Winweb&rsquo;s AI assistant elevates the efficiency and effectiveness of its customer support and sets a new standard for AI-driven client interactions in the industry. By embracing the power of AI, Winweb reaffirms its commitment to delivering exceptional service and staying at the forefront of innovation.
This solution enables businesses to not only manage their operations more efficiently but also to connect with customers in a more meaningful way.
<a href="https://www.datastax.com/products/vector-search">Get started building on Astra DB for free</a> and accelerate your adoption to AI with <a href="https://github.com/logspace-ai/langflow">Langflow</a>

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Betul O'ReillySolutions Architect, DataStax

Jan SchummersSenior Software Engineer, Winweb

Discover more

Share

Share

Technology Stack Overview

Retrieval Augmented Generation (RAG) Flow

Safeguarding Customer Data

Results

What's Next?

Conclusion

More Technology

How to Build a Crystal Image Search App with Vector Search

Knowledge Graphs for RAG without a GraphDB

How Winweb Built its AI Assistant with DataStax Astra DB and LangChain

Vercel + Astra DB: Get Data into Your GenAI Apps Fast

One-stop Data API for Production GenAI