yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-25 18:05:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/requirements/ingest-notion.txt

39 lines
769 B
Plaintext
Raw Normal View History

roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
#
# This file is autogenerated by pip-compile with Python 3.8
# by the following command:
#
# pip-compile requirements/ingest-notion.in
#
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
anyio==3.7.1
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# via
# -c requirements/constraints.in
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
# httpcore
certifi==2023.7.22
Roman/azure cognitive embeddings (#1524) ### Description This PR is two-fold: **Embeddings:** * Embeddings incorporated into the sharepoint source connector, which will now call out to OpenAI and create embeddings if the flag is passed in and the api key provided. **Writing vector content (embeddings) to Azure cognitive search index:** * The schema for the index expected to exist in Azure has been updated to include the vector field type and a test script has been added to test the new content being produced from the Sharepoint connector to push the embedding content. Some important notes about other changes in here: * The embedding code had to be updated to patch the `to_dict` method on elements to add `embeddings` to the dict output if that was added. While the code originally added the embedding content, when `to_dict` was called to save the content as json, this was lost.
2023-09-26 19:24:21 -04:00
# via
# -c requirements/base.txt
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
# -c requirements/constraints.in
# httpcore
Roman/azure cognitive embeddings (#1524) ### Description This PR is two-fold: **Embeddings:** * Embeddings incorporated into the sharepoint source connector, which will now call out to OpenAI and create embeddings if the flag is passed in and the api key provided. **Writing vector content (embeddings) to Azure cognitive search index:** * The schema for the index expected to exist in Azure has been updated to include the vector field type and a test script has been added to test the new content being produced from the Sharepoint connector to push the embedding content. Some important notes about other changes in here: * The embedding code had to be updated to patch the `to_dict` method on elements to add `embeddings` to the dict output if that was added. While the code originally added the embedding content, when `to_dict` was called to save the content as json, this was lost.
2023-09-26 19:24:21 -04:00
# httpx
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
exceptiongroup==1.1.3
# via anyio
h11==0.14.0
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# via httpcore
Support extracting Notion content to html (#1063) * Add notion connector and supporting code * minor fixes * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * Support extracting page content to html * Support extracting database content to html * update CHANGELOG * fix linting * fix linting
2023-08-09 09:56:59 -04:00
htmlbuilder==1.0.0
# via -r requirements/ingest-notion.in
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
httpcore==0.18.0
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# via httpx
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
httpx==0.25.0
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# via notion-client
idna==3.4
# via
# -c requirements/base.txt
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
# anyio
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# httpx
notion-client==2.0.0
# via -r requirements/ingest-notion.in
sniffio==1.3.0
# via
chore: bump inference to 0.6.6 (#1563) - bump `unstructured-inference` to `0.6.6` - specify default model name for element detection to be `detectron2_onnx` to keep current behavior - NOTE: the updated inference package by default would use yolox as element detection model; this will be evaluated and enabled in a separated PR --------- Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com> Co-authored-by: badGarnet <badGarnet@users.noreply.github.com>
2023-09-29 14:09:57 -05:00
# anyio
roman/Add notion connector (#1033) * Add notion connector and supporting code * minor fixes * Add notion deps to extras * Use the same return type for both helper methods * Don't ignore types that aren't recognized when mapping json * Add support for recursively getting docs * Add recursive search for databases * fix logging * fix linting * remove debugging code
2023-08-08 22:01:25 -04:00
# httpcore
# httpx
Reference in New Issue Copy Permalink