Support for Astra DB Vector Database and Apache Cassandra Now Available Out-of-the-Box for Any LangChain User
DataStax has introduced a fresh integration with LangChain, a widely-used orchestration framework for large language models (LLMs). This integration simplifies the inclusion of Astra DB, a real-time database for developers working on Gen AI applications, or Apache Cassandra®, as a new vector source within the LangChain framework.
Developers at startups and enterprises alike are using LangChain to build generative AI apps, so a deep native integration is a must-have
Ed Anuff, CPO, DataStax
As many companies implement retrieval augmented generation (RAG) – the process of providing context from outside data sources to deliver more accurate LLM query responses – into their generative AI applications, they require a vector store that gives them real-time updates with zero latency on critical, real-life production workloads.
Generative AI applications built with RAG stacks require a vector-enabled database and an orchestration framework like LangChain, to provide memory or context to LLMs for accurate and relevant answers. Developers use LangChain as the leading AI-first toolkit to connect their application to different data sources.
The new integration lets developers leverage the power of the Astra DB vector database for their LLM, AI assistant, and real-time generative AI projects through the LangChain plugin architecture for vector stores. Together, Astra DB and LangChain help developers to take advantage of framework features like, vector similarity search, semantic caching, term-based search, LLM-response caching, and data injection from Astra DB (or Cassandra) into prompt templates.
“In a RAG application, the model receives supplementary data or context from various sources — most often a database that can store vectors,” said Harrison Chase, CEO, LangChain.“
“Developers at startups and enterprises alike are using LangChain to build generative AI apps, so a deep native integration is a must-have,” said Ed Anuff, CPO, DataStax.
