yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-25 18:05:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/MANIFEST.in

58 lines
2.1 KiB
Plaintext
Raw Permalink Normal View History

fix: add missing dep files to manifest (#2516) ### Summary Closes #2484. Adds missing dependency files to `MANIFEST.in` so they are included in the Python distribution. Also updates the manifest to look for ingest dependencies in the `requirements/ingest` subdirectory. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-02-07 20:30:13 -05:00
# Base requirements and constraints
build(deps): avoid version conflicts (#636) Addresses #631. * Uses constraints to keep dependency versions more consistent. * Moves all dependencies to .in files which are then ingested by setup.py. * Adds script to check consistency of all extras. * Adds consistency check to CI. I should note that while it shouldn't be possible to cause a conflict between base.txt and any of the extras (because base.txt constrains all the extras) it is possible to get a conflict between two of the extras files. There are ways of trying to avoid that (like constraining each file by all the files that have already been processed before it in the order given in the make pip-compile target) but the ones I could think of seemed a little overwrought, and come with problems of their own. If a conflict arises, it should be flagged by CI or locally with make check-deps. When/if that happens, you can resolve the conflict by adding appropriate global constraints in requirements/constraints.txt. Also note that if fileA.in is constrained by fileB.txt, then fileB.in should be compiled before fileA.in in the make pip-compile target. Otherwise fileA.in will be compiled with the old version of fileB.txt which can cause conflicts or keep dependencies from being updated properly.
2023-05-24 17:29:35 -05:00
include requirements/base.in
fix: add missing dep files to manifest (#2516) ### Summary Closes #2484. Adds missing dependency files to `MANIFEST.in` so they are included in the Python distribution. Also updates the manifest to look for ingest dependencies in the `requirements/ingest` subdirectory. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-02-07 20:30:13 -05:00
# Unstructured library extras
include requirements/extra-csv.in
include requirements/extra-docx.in
include requirements/extra-epub.in
include requirements/extra-markdown.in
include requirements/extra-msg.in
include requirements/extra-odt.in
include requirements/extra-paddleocr.in
include requirements/extra-pandoc.in
include requirements/extra-pdf-image.in
include requirements/extra-pptx.in
include requirements/extra-xlsx.in
build(deps): avoid version conflicts (#636) Addresses #631. * Uses constraints to keep dependency versions more consistent. * Moves all dependencies to .in files which are then ingested by setup.py. * Adds script to check consistency of all extras. * Adds consistency check to CI. I should note that while it shouldn't be possible to cause a conflict between base.txt and any of the extras (because base.txt constrains all the extras) it is possible to get a conflict between two of the extras files. There are ways of trying to avoid that (like constraining each file by all the files that have already been processed before it in the order given in the make pip-compile target) but the ones I could think of seemed a little overwrought, and come with problems of their own. If a conflict arises, it should be flagged by CI or locally with make check-deps. When/if that happens, you can resolve the conflict by adding appropriate global constraints in requirements/constraints.txt. Also note that if fileA.in is constrained by fileB.txt, then fileB.in should be compiled before fileA.in in the make pip-compile target. Otherwise fileA.in will be compiled with the old version of fileB.txt which can cause conflicts or keep dependencies from being updated properly.
2023-05-24 17:29:35 -05:00
include requirements/huggingface.in
fix: add missing dep files to manifest (#2516) ### Summary Closes #2484. Adds missing dependency files to `MANIFEST.in` so they are included in the Python distribution. Also updates the manifest to look for ingest dependencies in the `requirements/ingest` subdirectory. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-02-07 20:30:13 -05:00
# Ingest extras
include requirements/ingest/airtable.in
fix: allow AstraDB to prevent indexing on metadata columns with long text (#3003) Thanks to @erichare from AstraDB Adds support for specifying the indexing options for various columns in Astra DB, allowing users to avoid a situation where long text columns are by-default indexed. Changes to: test_unstructured_ingest/python/test-ingest-astra-output.py are forward looking from AstraDB
2024-05-16 21:12:37 -07:00
include requirements/ingest/astra.in
fix: add missing dep files to manifest (#2516) ### Summary Closes #2484. Adds missing dependency files to `MANIFEST.in` so they are included in the Python distribution. Also updates the manifest to look for ingest dependencies in the `requirements/ingest` subdirectory. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-02-07 20:30:13 -05:00
include requirements/ingest/azure-cognitive-search.in
include requirements/ingest/azure.in
include requirements/ingest/biomed.in
include requirements/ingest/box.in
include requirements/ingest/chroma.in
include requirements/ingest/confluence.in
include requirements/ingest/databricks-volumes.in
include requirements/ingest/delta-table.in
include requirements/ingest/discord.in
include requirements/ingest/dropbox.in
include requirements/ingest/elasticsearch.in
include requirements/ingest/embed-aws-bedrock.in
include requirements/ingest/embed-huggingface.in
include requirements/ingest/embed-openai.in
include requirements/ingest/gcs.in
include requirements/ingest/github.in
include requirements/ingest/gitlab.in
include requirements/ingest/google-drive.in
include requirements/ingest/hubspot.in
include requirements/ingest/jira.in
feat: Kafka source and destination connector (#3176) Thanks to @tullytim we have a new Kafka source and destination connector. It also works with hosted Kafka via Confluent. Documentation will be added to the Docs repo.
2024-06-22 16:26:23 -07:00
include requirements/ingest/kafka.in
fix: add missing dep files to manifest (#2516) ### Summary Closes #2484. Adds missing dependency files to `MANIFEST.in` so they are included in the Python distribution. Also updates the manifest to look for ingest dependencies in the `requirements/ingest` subdirectory. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: Ahmet Melek <39141206+ahmetmeleq@users.noreply.github.com>
2024-02-07 20:30:13 -05:00
include requirements/ingest/mongodb.in
include requirements/ingest/notion.in
include requirements/ingest/onedrive.in
include requirements/ingest/opensearch.in
include requirements/ingest/outlook.in
include requirements/ingest/pinecone.in
include requirements/ingest/postgres.in
include requirements/ingest/qdrant.in
include requirements/ingest/reddit.in
include requirements/ingest/s3.in
include requirements/ingest/salesforce.in
include requirements/ingest/sftp.in
include requirements/ingest/sharepoint.in
include requirements/ingest/slack.in
include requirements/ingest/weaviate.in
include requirements/ingest/wikipedia.in
Reference in New Issue Copy Permalink