David S. Batista 3f77d3ab6c

!feat: unify NLTKDocumentSplitter and DocumentSplitter (#8617) ...

* wip: initial import

* wip: refactoring

* wip: refactoring tests

* wip: refactoring tests

* making all NLTKSplitter related tests work

* refactoring

* docstrings

* refactoring and removing NLTKDocumentSplitter

* fixing tests for custom sentence tokenizer

* fixing tests for custom sentence tokenizer

* cleaning up

* adding release notes

* reverting some changes

* cleaning up tests

* fixing serialisation and adding tests

* cleaning up

* wip

* renaming and cleaning

* adding NLTK files

* updating docstring

* adding import to init

* Update haystack/components/preprocessors/document_splitter.py

Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>

* updating tests

* wip

* adding sentence/period change warning

* fixing LICENSE header

* Update haystack/components/preprocessors/document_splitter.py

Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>

---------

Co-authored-by: Stefano Fiorucci <stefanofiorucci@gmail.com>

2024-12-12 14:22:27 +00:00

..

__init__.py

chore: add license header to all modules (#7675)

2024-05-09 13:40:36 +00:00

test_filter_retriever.py

feat: Add memory sharing between different instances of InMemoryDocumentStore (#7781)

2024-05-31 16:44:14 +02:00

test_in_memory_bm25_retriever.py

feat: Add filter_policy init parameter to in memory retrievers (#7795)

2024-06-04 17:51:16 +02:00

test_in_memory_embedding_retriever.py

enhancement: reduced usage of numpy and substituted built-in libraries (#8418)

2024-10-18 15:42:19 +02:00

test_sentence_window_retriever.py

!feat: unify NLTKDocumentSplitter and DocumentSplitter (#8617)

2024-12-12 14:22:27 +00:00