Steve Canny 137ea67336

feat(chunking): add include_orig_elements chunking option (#2649) ...

**Summary**
Add `include_orig_elements: bool = True` as a new chunking option. This
PR does not implement _adding_ original elements to chunks, only
accepting this parameter as a chunking option and assigning `True` to it
as a default value when it is omitted as a keyword argument.

Note this will need to be added in other repositories as well in order
to fully support this new option by all access methods. In particular it
will need to be added in `unstructured-api` in order to become available
via the SDKs.

2024-03-15 18:48:07 +00:00

..

chunking

feat(chunking): add include_orig_elements chunking option (#2649)

2024-03-15 18:48:07 +00:00

cleaners

Add clean_ligatures to core cleaners (#1326)

2023-09-07 21:30:18 +00:00

documents

fix(html): unequal row lengths in HTMLTable.text_as_html (#2345)

2024-01-04 21:53:19 +00:00

embed

Renamed OpenAiEmbeddingConfig dataclass (#2546)

2024-02-14 17:24:52 +00:00

file_utils

fix: don't treat double quote enclosed text as JSON (#2544)

2024-02-14 13:41:43 +00:00

metrics

fix: teardown fixture for tests and update pre-commit-config (#2565)

2024-03-12 22:16:39 +00:00

nlp

Add check for duplicate click options (#1775)

2023-10-20 14:00:19 +00:00

partition

fix: raises on file-like object with .name not a valid path (#2614)

2024-03-07 19:02:04 +00:00

staging

fix: remove none value keys from flattened dictionary (#2442)

2024-01-23 21:52:11 +00:00

vcr_fixtures/cassettes

chore: Re-enable test_upload_label_studio_data_with_sdk (#674)

2023-06-02 23:38:43 +00:00

__init__.py

chore: Reorganize partition bricks under partition directory (#76)

2022-11-21 22:27:23 +00:00

test_utils.py

chore: add tests and small fixes in utils.py (#2554)

2024-03-06 21:58:10 +00:00

unit_utils.py

rfctr: prepare for adding metadata.orig_elements field (#2647)

2024-03-14 21:31:58 +00:00