Pluto 8685905bd1

Character confidence threshold (#3860) ...

This change adds the ability to filter out characters predicted by
Tesseract with low confidence scores.

Some notes:
- I intentionally disabled it by default; I think some low score(like
0.9-0.95 for Tesseract) could be a safe choice though
- I wanted to use character bboxes and combine them into word bbox
later. However, a bug in Tesseract in some specific scenarios returns
incorrect character bboxes (unit tests caught it 🥳 ). More in comment in
the code

2025-01-13 13:12:46 +00:00

..

chunking

chunk: relax table segregation during chunking (#3812)

2024-12-09 18:57:22 +00:00

cleaners

fix: ipv4 address regex (#3808)

2024-12-09 14:19:13 -08:00

common

feat(chunk): split tables on even row boundaries (#3504)

2024-08-19 18:56:53 +00:00

documents

image alt support (#3797)

2024-11-26 16:20:23 +00:00

embed

feat/remove ingest code, use new dep for tests (#3595)

2024-10-15 10:01:34 -05:00

file_utils

feat: add ndjson support (#3845)

2024-12-19 14:39:26 +00:00

metrics

fix: html incorrectly categorizing text (#3841)

2024-12-18 18:46:54 +00:00

nlp

Feat/contain nltk assets in docker image (#3853)

2025-01-08 22:00:13 +00:00

partition

Character confidence threshold (#3860)

2025-01-13 13:12:46 +00:00

staging

rfctr(part): prepare for pluggable auto-partitioners 3 (#3661)

2024-09-25 18:17:48 +00:00

testfiles/chunking

chunk: relax table segregation during chunking (#3812)

2024-12-09 18:57:22 +00:00

vcr_fixtures/cassettes

chore: Re-enable test_upload_label_studio_data_with_sdk (#674)

2023-06-02 23:38:43 +00:00

__init__.py

chore: Reorganize partition bricks under partition directory (#76)

2022-11-21 22:27:23 +00:00

test_utils.py

feat/remove ingest code, use new dep for tests (#3595)

2024-10-15 10:01:34 -05:00

unit_utils.py

chunk: relax table segregation during chunking (#3812)

2024-12-09 18:57:22 +00:00