yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-09-25 16:29:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/test_unstructured_ingest
History
cragwolfe abe4e8191a
chore: ingest-script cleanup, better skip condition (#2094) 
When testing ingest tests, one often wants to keep the .json output or
generated metrics files around for inspection after the fact. This
updates the bash condition to actually honor the comment that mentions

    # export UNSTRUCTURED_CLEANUP_DEV_FIXTURES=1
    
** Test Instructions **

Run:

    export UNSTRUCTURED_CLEANUP_DEV_FIXTURES=1
    ./test_unstructured_ingest/src/s3.sh
    ./test_unstructured_ingest/evaluation-metrics.sh text-extraction
    
and witness test directories/files do not get cleaned up. E.g.,
`test_unstructured_ingest/metrics-tmp/`. One can also add a `set -x` at
the top of test_unstructured_ingest/cleanup.sh to see what is getting
skipped (it's a lot!).
2023-11-15 22:28:04 -08:00
..
dest
fix: ingest destination test failure with missing output (#2031)
2023-11-07 23:14:01 +00:00
example-docs
roman/cli infer table arg (#1685)
2023-10-12 16:14:53 +00:00
expected-structured-output
fix(ingest): canonicalize ingest JSON (#2080)
2023-11-15 00:52:58 -08:00
failed-partition-docs
roman/ingest continue on error (#1736)
2023-10-12 21:33:10 +00:00
files
test: update ingest dest tests to follow set pattern (#1991)
2023-11-03 12:46:56 +00:00
metrics
chore: update metrics-json-manifest (#2047)
2023-11-10 00:24:59 +00:00
python
Jj/2011 missing languages metadata (#2037)
2023-11-13 16:47:05 +00:00
src
chore: for ingest-test metrics, also check subdirs (#2079)
2023-11-15 21:02:43 -08:00
unit
feat: support table conversion for tabular destination connectors (#1917)
2023-11-03 16:47:21 +00:00
.gitignore
fix: update .gitignores to include text comparison files (#1246)
2023-08-30 07:21:04 +00:00
check-diff-evaluation-metrics.sh
chore: for ingest-test metrics, also check subdirs (#2079)
2023-11-15 21:02:43 -08:00
check-diff-expected-output.sh
chore: add more parametrization to ingestion test (#2086)
2023-11-15 22:32:41 +00:00
check-num-dirs-output.sh
ci: parametrize ingest test checking scripts (#2062)
2023-11-13 18:42:19 +00:00
check-num-files-expected-output.sh
ci: parametrize ingest test checking scripts (#2062)
2023-11-13 18:42:19 +00:00
check-num-files-output.sh
ci: parametrize ingest test checking scripts (#2062)
2023-11-13 18:42:19 +00:00
check-num-rows-and-columns-output.sh
chore: ingest test file cleanup (#1366)
2023-09-21 11:51:08 -07:00
clean-permissions-files.sh
feat: add file-based access permissions for SharePoint ingest (#1628)
2023-10-13 00:38:08 +00:00
cleanup.sh
chore: ingest-script cleanup, better skip condition (#2094)
2023-11-15 22:28:04 -08:00
evaluation-ingest-cp.sh
chore: for ingest-test metrics, also check subdirs (#2079)
2023-11-15 21:02:43 -08:00
evaluation-metrics.sh
chore: for ingest-test metrics, also check subdirs (#2079)
2023-11-15 21:02:43 -08:00
json-to-clean-text-folder.sh
Added plain-text comparison for tests (#1180)
2023-08-29 23:23:14 +00:00
json-to-text.sh
Added plain-text comparison for tests (#1180)
2023-08-29 23:23:14 +00:00
test-ingest-delta-table-dest.sh
ci: parametrize ingest test checking scripts (#2062)
2023-11-13 18:42:19 +00:00
test-ingest-dest.sh
test: update ingest dest tests to follow set pattern (#1991)
2023-11-03 12:46:56 +00:00
test-ingest-src.sh
separate ingest tests (#1951)
2023-11-01 19:23:44 +00:00