yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-14 12:36:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/test_unstructured_ingest/metrics/text-extraction/all-docs-cct.tsv

17 lines
889 B
Plaintext
Raw Normal View History

refactor: separate click wrappers from core evaluation functionality (#1981) ### Summary Click decorated functions cannot (properly) be called outside of the click interface. This makes it difficult to reuse the setup functionality in measure_text_edit_distance or measure_element_type_accuracy. This PR removes the click decoration and separates it into a wrapper function purely to execute the command. ### Technical Details - Changed as suggested in [this StackOverflow post](https://stackoverflow.com/questions/40091347/call-another-click-command-from-a-click-command) response - The locations of these now distinct functions are separate: the `_command` click-decorated functions stay in ingest/evaluate.py, and the core functions measure_text_edit_distance and measure_element_type_accuracy are moved into the unstructured/metrics/ folder (which is a more logical location for them). - Initial test added for measure_text_edit_distance ### Test `sh ./test_unstructured_ingest/evaluation-metrics.sh text-extraction` functionality is unchanged. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: shreyanid <shreyanid@users.noreply.github.com> Co-authored-by: Trevor Bossert <37596773+tabossert@users.noreply.github.com>
2023-11-07 11:54:22 -08:00
filename doctype connector cct-accuracy cct-%missing
chore: update metrics-json-manifest (#2047) Update `metrics-json-manigest.txt` master file for ingest evaluation. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-09 19:24:59 -05:00
Core-Skills-for-Biomedical-Data-Scientists-2-pages.pdf pdf azure 0.981 0.007
refactor: separate click wrappers from core evaluation functionality (#1981) ### Summary Click decorated functions cannot (properly) be called outside of the click interface. This makes it difficult to reuse the setup functionality in measure_text_edit_distance or measure_element_type_accuracy. This PR removes the click decoration and separates it into a wrapper function purely to execute the command. ### Technical Details - Changed as suggested in [this StackOverflow post](https://stackoverflow.com/questions/40091347/call-another-click-command-from-a-click-command) response - The locations of these now distinct functions are separate: the `_command` click-decorated functions stay in ingest/evaluate.py, and the core functions measure_text_edit_distance and measure_element_type_accuracy are moved into the unstructured/metrics/ folder (which is a more logical location for them). - Initial test added for measure_text_edit_distance ### Test `sh ./test_unstructured_ingest/evaluation-metrics.sh text-extraction` functionality is unchanged. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: shreyanid <shreyanid@users.noreply.github.com> Co-authored-by: Trevor Bossert <37596773+tabossert@users.noreply.github.com>
2023-11-07 11:54:22 -08:00
IRS-form-1987.pdf pdf azure 0.783 0.135
chore: update metrics-json-manifest (#2047) Update `metrics-json-manigest.txt` master file for ingest evaluation. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-09 19:24:59 -05:00
spring-weather.html html azure 0.0 0.018
chore: get eval metrics from ingest in (#2097) Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-17 13:22:36 -05:00
fake-text.txt txt Sharepoint 1.0 0.0
stanley-cups.xlsx xlsx Sharepoint 0.778 0.0
ideas-page.html html Sharepoint 0.929 0.033
UDHR_first_article_all.txt txt local-single-file 0.995 0.0
refactor: separate click wrappers from core evaluation functionality (#1981) ### Summary Click decorated functions cannot (properly) be called outside of the click interface. This makes it difficult to reuse the setup functionality in measure_text_edit_distance or measure_element_type_accuracy. This PR removes the click decoration and separates it into a wrapper function purely to execute the command. ### Technical Details - Changed as suggested in [this StackOverflow post](https://stackoverflow.com/questions/40091347/call-another-click-command-from-a-click-command) response - The locations of these now distinct functions are separate: the `_command` click-decorated functions stay in ingest/evaluate.py, and the core functions measure_text_edit_distance and measure_element_type_accuracy are moved into the unstructured/metrics/ folder (which is a more logical location for them). - Initial test added for measure_text_edit_distance ### Test `sh ./test_unstructured_ingest/evaluation-metrics.sh text-extraction` functionality is unchanged. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: shreyanid <shreyanid@users.noreply.github.com> Co-authored-by: Trevor Bossert <37596773+tabossert@users.noreply.github.com>
2023-11-07 11:54:22 -08:00
example-10k.html html local 0.686 0.037
chore: update metrics-json-manifest (#2047) Update `metrics-json-manigest.txt` master file for ingest evaluation. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-09 19:24:59 -05:00
ideas-page.html html local 0.929 0.033
fake-html-cp1252.html html local 0.659 0.0
chore: get eval metrics from ingest in (#2097) Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-17 13:22:36 -05:00
fake-html-cp1252.html html local-single-file-with-encoding 0.659 0.0
chore: update metrics-json-manifest (#2047) Update `metrics-json-manigest.txt` master file for ingest evaluation. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-09 19:24:59 -05:00
layout-parser-paper.pdf pdf local-single-file-with-pdf-infer-table-structure 0.945 0.029
layout-parser-paper-with-table.jpg jpg local-single-file-with-pdf-infer-table-structure 0.716 0.032
chore: get eval metrics from ingest in (#2097) Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com>
2023-11-17 13:22:36 -05:00
2023-Jan-economic-outlook.pdf pdf s3 0.846 0.039
recalibrating-risk-report.pdf pdf s3 0.973 0.007
Reference in New Issue Copy Permalink