haystack

mirror of https://github.com/deepset-ai/haystack.git synced 2025-07-16 13:30:37 +00:00

History

Adding distillation loss functions from TinyBERT (#1879 )

* initial tinybertdistill commit

* add tinybert distill loss

* remove teacher caching for tinybert

* add tinybert to distil_from method

* Add latest docstring and tutorial changes

* add dim mapping and fix type hints

* fix type hints

* fix dummy input

* fix dim mapping for tinybert loss and add comments/doc strings

* add test for tinybert loss

* Add latest docstring and tutorial changes

* add comment

* fix BERT forward parameters

* add doc string to AdaptiveModel forward method

* remove unnecessary data silo

* fix farm import

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

2021-12-23 14:54:02 +01:00

_static

Create documentation website (#272 )

2020-09-18 12:57:32 +02:00

_templates

Create documentation website (#272 )

2020-09-18 12:57:32 +02:00

api

Adding distillation loss functions from TinyBERT (#1879 )

2021-12-23 14:54:02 +01:00

img

Create documentation website (#272 )