unstructured

mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-12-28 15:45:21 +00:00

History

feat: allow passing down of ocr agent and table agent (#3954 )

This PR allows passing down both `ocr_agent` and `table_ocr_agent` as
parameters to specify the `OCRAgent` class for the page and tables, if
any, respectively. Both are default to using `tesseract`, consistent
with the present default behavior.

We used to rely on env variables to specify the agents but os env can be
changed during runtime outside of the caller's control. This method of
passing down the variables ensures that specification is independent of
env changes.

## testing

Using `example-docs/img/layout-parser-paper-with-table.jpg` and run
partition with two different settings. Note that this test requires
`paddleocr` extra.

```python
from unstructured.partition.auto import partition
from unstructured.partition.utils.constants import OCR_AGENT_TESSERACT, OCR_AGENT_PADDLE
elements = partition(f, strategy="hi_res", skip_infer_table_types=[], ocr_agent=OCR_AGENT_TESSERACT, table_ocr_agent=OCR_AGENT_PADDLE)
elements_alt = partition(f, strategy="hi_res", skip_infer_table_types=[], ocr_agent=OCR_AGENT_PADDLE, table_ocr_agent=OCR_AGENT_TESSERACT)
```

we should see both finish and slight differences in the table element's
text attribute.

2025-03-11 16:36:31 +00:00

chunking

chunk: relax table segregation during chunking (#3812 )

2024-12-09 18:57:22 +00:00

cleaners

fix: ipv4 address regex (#3808 )

2024-12-09 14:19:13 -08:00

common

feat(chunk): split tables on even row boundaries (#3504 )

2024-08-19 18:56:53 +00:00

documents

Fix parsing table cells (#3904 )