Silvano Cerza 35ec8cc8fb

Rework evaluation and metrics calculation for Haystack 2.x (#5794) ...

* draft requirements from discussion

* Add some more information

* Update proposal given new feedback

* More drawbacks

* Decision drivers

* Nitpick

* Summary

* PR number

* Mark code snippets

Co-authored-by: ZanSara <sara.zanzottera@deepset.ai>

* Link correct issue

* Add missing word

* More context on blind evaluation

* Rephrase confusing sentence

* Add a more detailed code example

* Ignore mypy and pylint in example file

---------

Co-authored-by: Julian Risch <julian.risch@deepset.ai>
Co-authored-by: ZanSara <sara.zanzottera@deepset.ai>

2023-09-28 00:51:51 +02:00

..

images/4284-drop-basecomponent

proposal: drop BaseComponent and re-implement Pipeline (#4284)

2023-03-13 10:05:59 +01:00

0000-evaluation-haystack-2.md

Rework evaluation and metrics calculation for Haystack 2.x (#5794)

2023-09-28 00:51:51 +02:00

0000-evaluation-haystack-2.py

Rework evaluation and metrics calculation for Haystack 2.x (#5794)

2023-09-28 00:51:51 +02:00

2170-pydantic-dataclasses.md

feat: introduce proposal design process (#3333)

2022-11-11 12:49:23 +01:00

3550-csv-converter.md

ci: pre-commit autoupdate (#5777)

2023-09-12 14:34:41 +02:00

3558-embedding_retriever.md

Update 3558-embedding_retriever.md (#5705)

2023-09-04 11:28:51 +02:00

3665-prompt-node.md

Add PromptNode proposal (#3665)

2022-12-16 10:27:58 +01:00

3695-demo-repository.md

proposal: Create a dedicated Github repository for Haystack demos (#3695)

2022-12-22 10:09:46 +01:00

3784-shaper.md

proposal: Shaper pipeline component (#3784)

2023-01-11 18:50:12 +05:30

3875-table-cell.md

ci: Fix typos discovered by codespell (#5778)

2023-09-13 16:14:45 +02:00

3925-mrkl-agent.md

proposal: Add Agents for extended LLM support (#3925)

2023-02-06 09:47:10 +01:00

3959-json-converter.md

Proposal: Add a JsonConverter node (#3959)

2023-02-09 09:57:00 +01:00

4084-agent-demo.md

proposal: Implement Agent demo (#4085)

2023-02-23 19:56:38 +01:00

4172-shaper-in-prompt-template.md

proposal: Shapers in Prompt Templates (#4172)

2023-03-07 09:52:18 +01:00

4284-drop-basecomponent.md

ci: Fix typos discovered by codespell (#5778)

2023-09-13 16:14:45 +02:00

4370-documentstores-and-retrievers.md

ci: Fix typos discovered by codespell (#5778)

2023-09-13 16:14:45 +02:00

5289-recentness-ranker.md

proposal: Add RecentnessRanker component (#5289)

2023-07-17 16:33:47 +02:00

5390-embedders.md

ci: Fix typos discovered by codespell (#5778)

2023-09-13 16:14:45 +02:00

5540-llm-support-2.0.md

proposal: LLM support in Haystack 2.0 (#5540)

2023-08-28 10:33:07 +02:00

5738-document-2.0.md

feat: Improve Document for Haystack 2.0 (#5738)

2023-09-11 17:40:00 +02:00