haystack/document-language-classifier-1ec0b3c4d08989c0.yaml at 35788a2d060d58b901b8d10237f23273399998e5 - haystack - Gitea: Git with a cup of tea

yujunjun/haystack

mirror of https://github.com/deepset-ai/haystack.git synced 2025-07-24 09:20:13 +00:00

Julian Risch 29b1fefaa4

feat: Add DocumentLanguageClassifier 2.0 (#6037 )

* add DocumentLanguageClassifier and tests

* reno

* fix import, rename DocumentCleaner

* mark example usage as python code

* add assertions to e2e test

* use deserialized document_store

* Apply suggestions from code review

Co-authored-by: Massimiliano Pippi <mpippi@gmail.com>

* remove from/to_dict

* use renamed InMemoryDocumentStore

* adapt to Document refactoring

* improve docstring

* fix test for new Document

---------

Co-authored-by: Massimiliano Pippi <mpippi@gmail.com>
Co-authored-by: Stefano Fiorucci <44616784+anakin87@users.noreply.github.com>
Co-authored-by: anakin87 <stefanofiorucci@gmail.com>

2023-10-31 15:35:05 +01:00

5 lines

187 B

YAML

Raw Blame History

 ---
 preview:
   - |
     Added DocumentLanguageClassifier component so that Documents can be routed to different components based on the detected language for example during preprocessing.