unstructured/MANIFEST.in
Roman Isecke d6f2841ff4
feat: update dependencies and remove constraint on pydantic (#2841)
### Description
* The `consistent-deps.sh` was fixed to take into account the ingest
dependencies, causing some errors to show up. New constriants were added
to make that script pass.
* Update all requirements without constraint on pydantic, allowing the
latest version to be pulled in.
* `pikepdf` is causing a conflict but there's a fix on their `main`
branch, just need for the next release to be published. Opened up a
question here to see if we can get that out any sooner: [Do releases
happen on a
schedule?](https://github.com/pikepdf/pikepdf/discussions/574). For now
added `lxml<5` to the constraints.

A couple optimizations: 
* `constraints.in` renamed to `constraints.txt` since the whole point is
all dependencies are already pinned and the file never gets compiled
* `constraints.txt` moved to a `requirements/deps` directory as this
never gets compiled by `pip-compile`
* Other dependency files updated to reference the new location of
`base.in` and `constraints.txt`
* make file updated since it was originally written to avoid the
`base.in` and `constraints.in` file
2024-04-04 19:58:23 +00:00

56 lines
2.0 KiB
Plaintext

# Base requirements and constraints
include requirements/base.in
# Unstructured library extras
include requirements/extra-csv.in
include requirements/extra-docx.in
include requirements/extra-epub.in
include requirements/extra-markdown.in
include requirements/extra-msg.in
include requirements/extra-odt.in
include requirements/extra-paddleocr.in
include requirements/extra-pandoc.in
include requirements/extra-pdf-image.in
include requirements/extra-pptx.in
include requirements/extra-xlsx.in
include requirements/huggingface.in
# Ingest extras
include requirements/ingest/airtable.in
include requirements/ingest/azure-cognitive-search.in
include requirements/ingest/azure.in
include requirements/ingest/biomed.in
include requirements/ingest/box.in
include requirements/ingest/chroma.in
include requirements/ingest/confluence.in
include requirements/ingest/databricks-volumes.in
include requirements/ingest/delta-table.in
include requirements/ingest/discord.in
include requirements/ingest/dropbox.in
include requirements/ingest/elasticsearch.in
include requirements/ingest/embed-aws-bedrock.in
include requirements/ingest/embed-huggingface.in
include requirements/ingest/embed-openai.in
include requirements/ingest/gcs.in
include requirements/ingest/github.in
include requirements/ingest/gitlab.in
include requirements/ingest/google-drive.in
include requirements/ingest/hubspot.in
include requirements/ingest/jira.in
include requirements/ingest/mongodb.in
include requirements/ingest/notion.in
include requirements/ingest/onedrive.in
include requirements/ingest/opensearch.in
include requirements/ingest/outlook.in
include requirements/ingest/pinecone.in
include requirements/ingest/postgres.in
include requirements/ingest/qdrant.in
include requirements/ingest/reddit.in
include requirements/ingest/s3.in
include requirements/ingest/salesforce.in
include requirements/ingest/sftp.in
include requirements/ingest/sharepoint.in
include requirements/ingest/slack.in
include requirements/ingest/weaviate.in
include requirements/ingest/wikipedia.in