yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-10 10:35:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,447 Commits 213 Branches 192 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
Christine Straub
b0d8a779da
feat: partiton_pdf() set inferred elements text (#3061) 
This PR adds the ability to fill inferred elements text from embedded
text (`pdfminer`) without depending on `unstructured-inference` library.
This PR is the second part of moving embedded text related code from
`unstructured-inference` to `unstructured` and works together with
https://github.com/Unstructured-IO/unstructured-inference/pull/349.
 2024-05-21 19:43:38 +00:00
Christine Straub
ac5048bf30
enhancement: remove duplicate embedded images (#2897) 
This PR aims to remove duplicate embedded images taken by `PDFminer`.

### Summary
- add `clean_pdfminer_duplicate_image_elements()` to remove embedded
images with similar `bboxes` and the same `text`
- add env_config `EMBEDDED_IMAGE_SAME_REGION_THRESHOLD` to consider the
bounding boxes of two embedded images as the same region
- refactor: reorganzie `clean_pdfminer_inner_elements()`
 2024-04-18 23:07:47 +00:00