unstructured/test_unstructured_ingest/metrics/metrics-json-manifest.txt

handbook-1p.docx.json
example-10k.html.json
IRS-form-1987.pdf.json
science-exploration-1p.pptx.json
Core-Skills-for-Biomedical-Data-Scientists-2-pages.pdf.json
spring-weather.html.json
ideas-page.html.json
fake-text.txt.json
stanley-cups.xlsx.json
UDHR_first_article_all.txt.json
fake-html-cp1252.html.json
layout-parser-paper-with-table.jpg.json
layout-parser-paper.pdf.json
2023-Jan-economic-outlook.pdf.json
page-with-formula.pdf.json
recalibrating-risk-report.pdf.json
Silent-Giant-(1).pdf.json
wiki_movie_plots_small.csv.json
chore: remove copy line from non-matrix connectors (#1976) 2023-11-04 13:58:56 -04:00			`handbook-1p.docx.json`
build: text extraction evaluation metrics workflow added (#1757) Executive Summary This PR adds the evaluation metrics to our current workflow. It verifies the flow that when the code is pushed, the code will gets evaluate against our gold standard and output into `.tsv` file. Technical Details - Adds evaluation metrics to the test-ingest workflow - Make use of `structured-output` from `test-ingest` and compare to the gold-standard uploaded in s3, and download into local when make comparison. The current folder in-use is `s3://utic-dev-tech-fixtures/small-cct`. This dir is editable in the shell script. - With this PR, only one file from one connector is use to compare. Misc - Not many overlapped files between test-ingest and gold-standard. More files will be added. Outputs 2 `.tsv` files are saved under `test_unstructured_ingest/metrics/`. ![image](https://github.com/Unstructured-IO/unstructured/assets/2177850/222e437c-1a94-4d7c-9320-81696633b1ae) ![image](https://github.com/Unstructured-IO/unstructured/assets/2177850/5c840322-6739-4634-8868-eba04b4ebc96) --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com> 2023-10-23 17:39:22 -04:00			`example-10k.html.json`
			`IRS-form-1987.pdf.json`
chore: update metrics-json-manifest (#2047) Update `metrics-json-manigest.txt` master file for ingest evaluation. --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: Klaijan <Klaijan@users.noreply.github.com> 2023-11-09 19:24:59 -05:00			`science-exploration-1p.pptx.json`
			`Core-Skills-for-Biomedical-Data-Scientists-2-pages.pdf.json`
			`spring-weather.html.json`
			`ideas-page.html.json`
			`fake-text.txt.json`
			`stanley-cups.xlsx.json`
			`UDHR_first_article_all.txt.json`
			`fake-html-cp1252.html.json`
			`layout-parser-paper-with-table.jpg.json`
			`layout-parser-paper.pdf.json`
			`2023-Jan-economic-outlook.pdf.json`
			`page-with-formula.pdf.json`
			`recalibrating-risk-report.pdf.json`
			`Silent-Giant-(1).pdf.json`
			`wiki_movie_plots_small.csv.json`