mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-07-23 00:42:28 +00:00
3.5 KiB
3.5 KiB
| type | date |
|---|---|
| intro | 1.1.2023 |
pip install farm-haystack
What to build with Haystack
- Ask questions in natural language and find granular answers in your own documents.
- Perform semantic search and retrieve documents according to meaning not keywords
- Use off-the-shelf models or fine-tune them to your own domain.
- Use user feedback to evaluate, benchmark and continuously improve your live models.
- Leverage existing knowledge bases and better handle the long tail of queries that chatbots receive.
- Automate processes by automatically applying a list of questions to new documents and using the extracted answers.
Core Features
- Latest models: Utilize all latest transformer based models (e.g. BERT, RoBERTa, MiniLM) for extractive QA, generative QA and document retrieval.
- Modular: Multiple choices to fit your tech stack and use case. Pick your favorite database, file converter or modeling framework.
- Open: 100% compatible with HuggingFace's model hub. Tight interfaces to other frameworks (e.g. Transformers, FARM, sentence-transformers)
- Scalable: Scale to millions of docs via retrievers, production-ready backends like Elasticsearch / FAISS and a fastAPI REST API
- End-to-End: All tooling in one place: file conversion, cleaning, splitting, training, eval, inference, labeling ...
- Developer friendly: Easy to debug, extend and modify.
- Customizable: Fine-tune models to your own domain or implement your custom DocumentStore.
- Continuous Learning: Collect new training data via user feedback in production & improve your models continuously
| 📒 Docs | Usage, Guides, API documentation ... |
| 🔰 Quick Demo | Quickly see what Haystack offers |
| 💾 Installation | How to install Haystack |
| 🎨 Key Components | Overview of core concepts |
| 🎓 Tutorials | Jupyter/Colab Notebooks & Scripts |
| 👀 How to use Haystack | Basic explanation of concepts, options and usage |
| ❤️ Contributing | We welcome all contributions! |
| 📊 Benchmarks | Speed & Accuracy of Retriever, Readers and DocumentStores |
| 🔭 Roadmap | Public roadmap of Haystack |
| 🙏 Slack | Join our community on Slack |
| Follow us on Twitter for news and updates | |
| 📰 Blog | Read our articles on Medium |
Quick Demo
The quickest way to see what Haystack offers is to start a Docker Compose demo application:
1. Update/install Docker and Docker Compose, then launch Docker
# apt-get update && apt-get install docker && apt-get install docker-compose
# service docker start
2. Clone Haystack repository
# git clone https://github.com/deepset-ai/haystack.git