tstadel 7caca41c5d

Support context matching in pipeline.eval() (#2482) ...

* calculate context pred metrics

* Update Documentation & Code Style

* extend doc_relevance_col values

* fix import order

* Update Documentation & Code Style

* fix mypy

* fix typings literal import

* add option for custom document_id_field

* Update Documentation & Code Style

* fix tests and dataframe col-order

* Update Documentation & Code Style

* rename content to context in eval dataframe

* add backward compatibility to EvaluationResult.load()

* Update Documentation & Code Style

* add docstrings

* Update Documentation & Code Style

* support sas

* Update Documentation & Code Style

* add answer_scope param

* Update Documentation & Code Style

* rework doc_relevance_col and keep document_id col in case of custom_document_id_field

* Update Documentation & Code Style

* improve docstrings

* Update Documentation & Code Style

* rename document_relevance_criterion into document_scope

* Update Documentation & Code Style

* add document_scope and answer_scope to print_eval_report

* support all new features in execute_eval_run()

* fix imports

* fix mypy

* Update Documentation & Code Style

* rename pred_label_sas_grid into pred_label_matrix

* update dataframe schema and sorting

* Update Documentation & Code Style

* pass through context_matching params and extend document_scope test

* Update Documentation & Code Style

* add answer_scope tests

* fix context_matching_threshold for document metrics

* shorten dataframe apply calls

* Update Documentation & Code Style

* fix queries getting lost if nothing was retrieved

* Update Documentation & Code Style

* Update Documentation & Code Style

* use document_id scopes

* Update Documentation & Code Style

* fix answer_scope literal

* Update Documentation & Code Style

* update the docs (lg changes)

* Update Documentation & Code Style

* update tutorial 5

* Update Documentation & Code Style

* fix tests

* Add minor lg updates

* final docstring changes

* fix single quotes in docstrings

* Update Documentation & Code Style

* dataframe scopes added for each column

* better docstrings for context_matching params

* Update Documentation & Code Style

* fix summarizer eval test

* Update Documentation & Code Style

* fix test

* Update Documentation & Code Style

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: agnieszka-m <amarzec13@gmail.com>

2022-05-24 18:11:52 +02:00

..

_static

Create documentation website (#272)

2020-09-18 12:57:32 +02:00

_templates

Create documentation website (#272)

2020-09-18 12:57:32 +02:00

api

Support context matching in pipeline.eval() (#2482)

2022-05-24 18:11:52 +02:00

img

Create documentation website (#272)

2020-09-18 12:57:32 +02:00

openapi

Update version to 1.4.1rc0 (#2509)

2022-05-06 11:46:31 +02:00

pydoc

Adjust pydoc markdown config so methods shown with classes (#2511)

2022-05-06 16:00:08 +02:00

conf.py

Apply black formatting (#2115)

2022-02-03 13:43:18 +01:00

index.rst

Create documentation website (#272)

2020-09-18 12:57:32 +02:00

make.bat

Create documentation website (#272)

2020-09-18 12:57:32 +02:00

Makefile

Create documentation website (#272)

2020-09-18 12:57:32 +02:00