unstructured

mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-12-03 18:49:53 +00:00

History

Feat/remove reference of PageLayout.elements (#3943 )

This PR removes usage of `PageLayout.elements` from partition function,
except for when `analysis=True`. This PR updates the partition logic so
that `PageLayout.elements_array` is used everywhere to save memory and
cpu cost.
Since the analysis function is intended for investigation and not for
general document processing purposes, this part of the code is left for
a future refactor.

`PageLayout.elements` uses a list to store layout elements' data while
`elements_array` uses `numpy` array to store the data, which has much
lower memory requirements. Using `memory_profiler` to test the
differences is usually around 10x.

2025-03-12 15:21:21 +00:00

__init__.py

serde tests round-trip through JSON (#1681 )

2023-10-12 19:47:55 +00:00

conftest.py

refactor: ocr modules (#2492 )

2024-02-06 17:11:55 +00:00

test_analysis.py

Remove unstructured.pytesseract fork (#3454 )

2024-08-09 04:28:48 +00:00

test_image.py

Feat/refactor layoutelement textregion to vectorized data structure (#3881 )