Steve Canny 36e81c3367

rfctr(chunking): extract general-purpose objects to base (#2281) ...

Many of the classes defined in `unstructured.chunking.title` are
applicable to any chunking strategy and will shortly be used for the
"by-character" chunking strategy as well.

Move these and their tests to `unstructured.chunking.base`.

Along the way, rename `TextPreChunkBuilder` to `PreChunkBuilder` because
it will be generalized in a subsequent PR to also take `Table` elements
such that inter-pre-chunk overlap can be implemented.

Otherwise, no logic changes, just moves.

2023-12-16 17:28:15 +00:00

..

chunking

rfctr(chunking): extract general-purpose objects to base (#2281)

2023-12-16 17:28:15 +00:00

cleaners

Add clean_ligatures to core cleaners (#1326)

2023-09-07 21:30:18 +00:00

documents

rfctr: skip CheckBox elements during chunking (#2253)

2023-12-13 20:22:25 +00:00

embed

feat: extend ingest options to support multiple embedding modules, add deterministic ingest test for embeddings (#1918)

2023-11-06 12:26:12 +00:00

file_utils

Chore: Libmagic detection for "application/octet-stream" when it is not a zip file. (#1347)

2023-09-08 18:49:00 +00:00

metrics

feat: add visualize param to command and add test (#2178)

2023-11-29 01:05:55 +00:00

nlp

Add check for duplicate click options (#1775)

2023-10-20 14:00:19 +00:00

partition

Refactor: importation consistency for partition_pdf() and partition_image() (#2282)

2023-12-15 22:29:58 +00:00

staging

feat: Weaviate destination connector (#1963)

2023-12-01 22:27:41 +00:00

vcr_fixtures/cassettes

chore: Re-enable test_upload_label_studio_data_with_sdk (#674)

2023-06-02 23:38:43 +00:00

__init__.py

chore: Reorganize partition bricks under partition directory (#76)

2022-11-21 22:27:23 +00:00

test_utils.py

feat: method to catch and classify overlapping bounding boxes (#1803)

2023-10-25 12:17:34 +00:00

unit_utils.py

Dynamic ElementMetadata implementation (#2043)

2023-11-15 13:22:15 -08:00