Open-source LLM framework to build production-ready applications
- Use the latest LLMs: hosted models by OpenAI or Cohere, open-source LLMs, or other pre-trained models
- All tooling in one place: preprocessing, pipelines, agents & tools, prompts, evaluation and finetuning
- Choose your favorite database: Elasticsearch, OpenSearch, Weaviate, Pinecone, Qdrant, Milvus and more
- Scale to millions of documents: use Haystack's proven retrieval architecture
People in our community work for
Latest Models
Pick any Transformer model from Hugging Face's Model Hub, experiment, find the one that works.
Flexible Document Store
Use Haystack NLP components on top of Elasticsearch, OpenSearch, or plain SQL.
Vector Databases
Boost search performance with Pinecone, Milvus, FAISS, or Weaviate vector databases, and dense passage retrieval.
Scalable
Build semantic search and question answering applications that can scale to millions of documents.
End-to-end
Building blocks for the entire product development cycle such as file converters, indexing functions, models, labeling tools, domain adaptation modules, and REST API.
Pipelines
It's not one-size-fits-all! Combine nodes into flexible and scalable pipelines and launch powerful natural language processing systems.
Start exploring Haystack!
- 12.6k Stars
- 225 Contributors
Join our community
Our community on Discord is for everyone interested in NLP, using Haystack or even just getting started!