tstadel
|
9611b64ec5
|
fix: document retrieval metrics for non-document_id document_relevance_criteria (#3885)
* fix document retrieval metrics for all document_relevance_criteria
* fix tests
* fix eval_batch metrics
* small refactorings
* evaluate metrics on label level
* document retrieval tests added
* fix pylint
* fix test
* support file retrieval
* add comment about threshold
* rename test
|
2023-02-02 15:00:07 +01:00 |
|
bogdankostic
|
594d2a10f8
|
fix: Fix predict_batch in TransformersReader for single nested Document list (#3748)
* Fix restoring of list structure
* Add tests
|
2022-12-29 11:48:18 +01:00 |
|
Stefano Fiorucci
|
1a60e21137
|
refactor: simplify Summarizer, add Document Merger (#3452)
* remove generate_single_summary
* update schemas
* remove unused import
* fix mypy
* fix mypy
* test: summarizer doesnt change content
* other test correction
* move test_summarizer_translation to test_extractor_translation
* fix test
* first try for doc merger
* reintroduce and deprecate generate_single_summary
* progress in document merger
* document merger!
* mypy, pylint fixes
* use generator
* added test that will fail in 1.12
* adapt to review
* extended deprecation docstring
* Update test/nodes/test_extractor_translation.py
* Update test/nodes/test_summarizer.py
* Update test/nodes/test_summarizer.py
* black
* documents fixture
Co-authored-by: Sara Zan <sarazanzo94@gmail.com>
|
2022-11-03 16:04:53 +01:00 |
|
Sebastian
|
59857cb492
|
feat: Speed up reader tests (#3476)
* Use a smaller reader where possible
* Change scope to module of reader to get faster load times
|
2022-10-26 19:04:18 +02:00 |
|
Vladimir Blagojevic
|
938e6fda5b
|
Classify pipeline's type based on its components (#3132)
* Add pipeline get_type mehod
* Add pipeline uptime
* Add pipeline telemetry event sending
* Send pipeline telemetry once a day (at most)
* Add pipeline invocation counter, change invocation counter logic
* Update allowed telemetry parameters - allow pipeline parameters
* PR review: add unit test
|
2022-09-21 14:53:42 +02:00 |
|
Julian Risch
|
3e3ff33cdd
|
feat: add batch evaluation method for pipelines (#2942)
* add basic pipeline.eval_batch for qa without filters
* black formatting
* pydoc-markdown
* remove batch eval tests failing due to bugs
* remove comment
* explain commented out tests
* avoid code duplication
* black
* mypy
* pydoc markdown
* add batch option to execute_eval_run
* pydoc markdown
* Apply documentation suggestions from code review
Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>
* Apply documentation suggestion from code review
Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>
* add documentation based on review comments
* black
* black
* schema updates
* remove duplicate tests
* add separate method for column reordering
* merge _build_eval_dataframe methods
* pylint ignore in function
* change type annotation of queries to list only
* one-liner addressing review comment on params dict
* markdown files updated
Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>
|
2022-08-25 17:50:57 +02:00 |
|