unstructured

mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-03 15:11:30 +00:00

History

Christine Straub b30d6a601e

Fix/1209 tweak xycut ordering output (#1630 )

Closes GH Issue #1209.

### Summary
- add swapped `xycut` sorting
- update `xycut` sorting evaluation script

PDFs:
-
[sbaa031.073.pdf](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7234218/pdf/sbaa031.073.pdf)
-
[multi-column-2p.pdf](https://github.com/Unstructured-IO/unstructured/files/12796147/multi-column-2p.pdf)
-
[11723901.pdf](https://github.com/Unstructured-IO/unstructured-inference/files/12360085/11723901.pdf)
### Testing
```
elements = partition_pdf("sbaa031.073.pdf", strategy="hi_res")
print("\n\n".join([str(el) for el in elements]))
```
### Evaluation
```
PYTHONPATH=. python examples/custom-layout-order/evaluate_xy_cut_sorting.py sbaa031.073.pdf hi_res xycut_only
```

2023-10-05 07:41:38 +00:00

chunking

fix: chunking fails with detection_class_prob in metadata (#1637 )

2023-10-04 22:14:21 +00:00

cleaners

Add clean_ligatures to core cleaners (#1326 )

2023-09-07 21:30:18 +00:00

documents

fix: Fix various cases of HTML text missing after partition (#1587 )

2023-10-03 04:17:51 +00:00

file_utils

Chore: Libmagic detection for "application/octet-stream" when it is not a zip file. (#1347 )