cragwolfe
962c9dccca
fix: Python 3.7 typing imports ( #108 )
...
Per issue #57 , fix typing imports in Python 3.7.
2022-12-21 10:28:20 -05:00
Yuming Long
de4d0d42b1
doc: bump to new version ( #107 )
2022-12-20 15:02:16 -05:00
Yuming Long
4803281861
chore: logger should not be setting up a BasicConfig ( #106 )
...
* feat: simple logger
* doc: changelog and version
2022-12-20 10:39:02 -05:00
Matt Robinson
407f700b20
build(deps): bump certify to incorporate security patches ( #105 )
...
* pin certifi in base and huggingface
* pinning for build and docs
2022-12-19 14:47:15 -05:00
Matt Robinson
7a74cdda86
feat: add partition_email cleaning brick ( #104 )
...
* fix for processing deeply embedded list elements
* fix types in mime encodings cleaner
* first pass on partition_email
* tests for email
* test for mime encodings
* changelog bump
* added note about \n=
* linting, linting, linting
* added email docs
* add partition_email to the readme
* add one more test
2022-12-19 18:02:44 +00:00
Matt Robinson
1d68bb2482
feat: apply method to apply cleaning bricks to elements ( #102 )
...
* add apply method to apply cleaners to elements
* bump version
* add check for string output
* documentations for the apply method
* change interface to *cleaners
2022-12-15 22:19:02 +00:00
Matt Robinson
b1cce16c16
feat: translate_text cleaning brick ( #101 )
...
* initial implementation for translate brick
* more input validation
* tests for translate brick
* added docs
* bumped version
* chinese and arabic tests
* re-run pip-compile
* add torch to dependencies
* cleanup doc string
* fix long string
* fix typo in docs
* take out empty string check
* return string if string is empty
* added huggingface into make install
2022-12-15 15:35:15 -05:00
Matt Robinson
1700d4d527
fix: add __init__.py to the partition module ( #100 )
2022-12-14 12:59:34 -05:00
Matt Robinson
151732c74c
release: bump to version 0.3.0 ( #99 )
2022-12-14 11:37:53 -05:00
dependabot[bot]
6b15d706fd
build(deps): Bump huggingface-hub from 0.10.1 to 0.11.1 in /requirements ( #94 )
...
Bumps [huggingface-hub](https://github.com/huggingface/huggingface_hub ) from 0.10.1 to 0.11.1.
- [Release notes](https://github.com/huggingface/huggingface_hub/releases )
- [Commits](https://github.com/huggingface/huggingface_hub/compare/v0.10.1...v0.11.1 )
---
updated-dependencies:
- dependency-name: huggingface-hub
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: qued <64741807+qued@users.noreply.github.com>
2022-12-12 11:32:50 -06:00
Matt Robinson
cf041ea637
fix: remove accident ' file ( #98 )
2022-12-12 12:08:22 -05:00
dependabot[bot]
87a77abe45
build(deps): Bump argilla from 1.1.0 to 1.1.1 in /requirements ( #93 )
...
Bumps [argilla](https://github.com/argilla-io/argilla ) from 1.1.0 to 1.1.1.
- [Release notes](https://github.com/argilla-io/argilla/releases )
- [Changelog](https://github.com/argilla-io/argilla/blob/develop/release.Dockerfile )
- [Commits](https://github.com/argilla-io/argilla/compare/v1.1.0...v1.1.1 )
---
updated-dependencies:
- dependency-name: argilla
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-12 16:56:51 +00:00
dependabot[bot]
a111c3bef3
build(deps): Bump urllib3 from 1.26.12 to 1.26.13 in /requirements ( #95 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.26.12 to 1.26.13.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.12...1.26.13 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-12-12 16:43:47 +00:00
dependabot[bot]
adf48f2530
build(deps): Bump filelock from 3.8.0 to 3.8.2 in /requirements ( #96 )
...
Bumps [filelock](https://github.com/tox-dev/py-filelock ) from 3.8.0 to 3.8.2.
- [Release notes](https://github.com/tox-dev/py-filelock/releases )
- [Changelog](https://github.com/tox-dev/py-filelock/blob/main/docs/changelog.rst )
- [Commits](https://github.com/tox-dev/py-filelock/compare/3.8.0...3.8.2 )
---
updated-dependencies:
- dependency-name: filelock
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-12 11:35:27 -05:00
Sebastian Laverde Alfonso
efd7d38ce5
docs: update readme with gif ( #90 )
...
relative path might have to be changed once the branch is merged
2022-12-12 16:05:46 +01:00
Matt Robinson
3c19c7cd8a
feat: Add partition_html brick ( #91 )
...
* update readme
* updated sphinx docs
* bump version; changelog
* clear cache; retrigger ci
* rename test file
* switch default parameters to None
* typo in the changelog
* add in text output
2022-12-12 14:22:10 +00:00
Matt Robinson
6cb3ac81d8
build(deps): Bump certifi to address security scans ( #92 )
2022-12-12 09:03:02 -05:00
qued
0974ef39a5
chore: add type hint to requests.post arg ( #89 )
2022-12-02 18:44:22 -06:00
Matt Robinson
0658744c38
test: mock model api calls; full coverage for partition_pdf ( #88 )
...
* test: mock model api calls; full coverage for partition_pdf
* bump version
2022-11-30 16:34:24 -05:00
Matt Robinson
77cd5cc01f
feat: text2text and token classification for argilla ( #87 )
...
* add support for text2text
* add support for token classification datasets
* bump versions
* updated docs
* remove extra comment
* fix wording in docs
* fix some more wording
2022-11-30 20:07:42 +00:00
Sebastian Laverde Alfonso
2a56fa741b
fix: partition pdf bad responses ( #86 )
...
* fix: bad responses in partition_pdf raise ValueError
* docs: update changelog with fix of partition_pdf responses
* refactor: remove unused import Text
Co-authored-by: Sebastian Laverde <sebastian@unstructured.io>
2022-11-30 19:27:24 +01:00
Matt Robinson
5c4428413a
build(deps): Bump jupyter-core library ( #85 )
2022-11-30 10:04:56 -05:00
Sebastian Laverde Alfonso
def873f8b5
Sebastian/refine repo and readme ( #82 )
...
* docs: add badges and emojis to README
* docs: add covenant badge and refactor style
* docs: add links to badges
Co-authored-by: qued <64741807+qued@users.noreply.github.com>
2022-11-30 10:02:58 +01:00
Matt Robinson
c62f18c0d0
feat: Add html escape quotes to cleaning brick ( #84 )
...
* feat: Add html escape quotes to cleaning brick
* bump changelog
2022-11-29 10:58:31 -05:00
Sebastian Laverde Alfonso
8bb4b02053
docs: edit and add all issue templates ( #83 )
...
* docs: add title and labels
* docs: create custom.md issue template
* docs: create feature issue template
2022-11-29 15:28:31 +01:00
Sebastian Laverde Alfonso
2ab2f23703
docs: update issue templates ( #80 )
...
* docs: update issue templates
Add customs for Bug report and Feature request.
* docs: correct bug report template, no UI no mobile
2022-11-28 17:38:40 +00:00
asymness
2170a2aae2
feat: Implement Argilla staging brick ( #81 )
...
* Add argilla to dependencies and run pip-compile
* Implement Argilla staging brick and add unit tests
* Update version and changelog
* Update docs with description and usage for Argilla staging brick
* Remove unused fixtures and fix typo in Argilla tests
* add missing quote in docs
* changelog tweak
* doc tweaks
Co-authored-by: Matt Robinson <mrobinson@unstructuredai.io>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-28 14:41:48 +00:00
Sebastian Laverde Alfonso
d6623883dc
docs: create CODE_OF_CONDUCT.md ( #79 )
...
This is in order to complete the community standards in Insights.
Add support@unstructured.io as contact for reporting.
2022-11-28 15:10:43 +01:00
cragwolfe
88373a1559
chore: Python 3.8.15 is the most recent 3.8 ( #78 )
2022-11-23 12:09:13 -05:00
Matt Robinson
b041b0197d
feat: Add entities kwarg to datasaur bricks ( #77 )
...
* added entities to datasaur
* add tests for datasaur with entities
* update docs
* fix missing imports
* bump version
* remove accidental file
2022-11-22 19:50:19 +00:00
Matt Robinson
08e091c5a9
chore: Reorganize partition bricks under partition directory ( #76 )
...
* move partition_pdf to partition folder
* move partition.py
* refactor partioning bricks into partition diretory
* import to nlp for backward compatibility
* update docs
* update version and bump changelog
* fix typo in changelog
* update readme reference
2022-11-21 22:27:23 +00:00
Mallori Harrell
53fcf4e912
chore: Remove PDF parsing code and dependencies ( #75 )
...
Remove PDF parsing code and dependencies.
2022-11-21 11:47:29 -06:00
Sebastian Laverde Alfonso
baa15d0098
feat: new partitioning brick that calls the document image analysis API ( #68 )
...
* docs: add new feature to the CHANGELOG.md, bump the version, update __version__.py
* feat: new partition to call the document image analysis API
* fix: remove duplicated dependency on partition.py
* fix: linting error due to line-lenght > 100
* test: add test to call partition_pdf brick
* chore: new short example-doc pdf for speed up in test X8
* fix: add missing return statement to _read to pass check
* feat: new partitioning brick to call doc parse API
* docs: version update fix in CHANGELOG
* refactor: no nested ifs
* docs: documentation for new brick partition_pdf
* refactor: made tidy
* docs: minor doc refactor
Co-authored-by: Sebastian Laverde <sebastian@unstructured.io>
2022-11-16 17:48:30 +01:00
Yuming Long
83e7f9d347
docs: add Colab notebook line in README ( #66 )
2022-11-14 14:45:22 -05:00
qued
9906dd23a1
fix: move _read out of base Document class
...
Changed where _read sits in the inheritance structure since PDFDocument doesn't really need lazy document processing
2022-11-14 13:34:42 -06:00
dependabot[bot]
2ad2a8fa72
build(deps): Bump pandas from 1.5.0 to 1.5.1 in /requirements ( #69 )
...
Bumps [pandas](https://github.com/pandas-dev/pandas ) from 1.5.0 to 1.5.1.
- [Release notes](https://github.com/pandas-dev/pandas/releases )
- [Changelog](https://github.com/pandas-dev/pandas/blob/main/RELEASE.md )
- [Commits](https://github.com/pandas-dev/pandas/compare/v1.5.0...v1.5.1 )
---
updated-dependencies:
- dependency-name: pandas
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-14 18:07:44 +00:00
dependabot[bot]
8936ab21a7
build(deps): Bump mypy from 0.982 to 0.990 in /requirements ( #73 )
...
* build(deps): Bump mypy from 0.982 to 0.990 in /requirements
Bumps [mypy](https://github.com/python/mypy ) from 0.982 to 0.990.
- [Release notes](https://github.com/python/mypy/releases )
- [Commits](https://github.com/python/mypy/compare/v0.982...v0.990 )
---
updated-dependencies:
- dependency-name: mypy
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix typing issues
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matt Robinson <mrobinson@unstructuredai.io>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-14 17:57:05 +00:00
dependabot[bot]
8b35c00e0b
build(deps-dev): Bump pip-tools from 6.9.0 to 6.10.0 in /requirements ( #71 )
...
Bumps [pip-tools](https://github.com/jazzband/pip-tools ) from 6.9.0 to 6.10.0.
- [Release notes](https://github.com/jazzband/pip-tools/releases )
- [Changelog](https://github.com/jazzband/pip-tools/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jazzband/pip-tools/compare/6.9.0...6.10.0 )
---
updated-dependencies:
- dependency-name: pip-tools
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-14 17:38:34 +00:00
dependabot[bot]
0da8fed32d
build(deps): Bump contourpy from 1.0.5 to 1.0.6 in /requirements ( #70 )
...
Bumps [contourpy](https://github.com/contourpy/contourpy ) from 1.0.5 to 1.0.6.
- [Release notes](https://github.com/contourpy/contourpy/releases )
- [Changelog](https://github.com/contourpy/contourpy/blob/main/docs/changelog.rst )
- [Commits](https://github.com/contourpy/contourpy/compare/v1.0.5...v1.0.6 )
---
updated-dependencies:
- dependency-name: contourpy
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-14 12:32:41 -05:00
dependabot[bot]
b28ba58a98
build(deps): Bump pycocotools from 2.0.5 to 2.0.6 in /requirements ( #72 )
...
Bumps [pycocotools](https://github.com/ppwwyyxx/cocoapi ) from 2.0.5 to 2.0.6.
- [Release notes](https://github.com/ppwwyyxx/cocoapi/releases )
- [Commits](https://github.com/ppwwyyxx/cocoapi/commits )
---
updated-dependencies:
- dependency-name: pycocotools
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-14 11:02:07 -06:00
Yuming Long
7c61639f23
python_require ( #65 )
2022-11-11 12:15:23 -05:00
Yuming Long
4f539dda44
feat: Final Compatibility with Python 3.7 ( #64 )
2022-11-10 19:26:10 -05:00
Matt Robinson
300c564c62
feat: Cleaning bricks to extract text before/after a pattern ( #63 )
...
* brick to extract text before
* brick for extract text after
* tests for extract before and after
* updated docs
* changelog and bump version
* fix typo
* fix another typo
* positive -> non-negative
2022-11-10 21:35:37 +00:00
Matt Robinson
f3756abc90
feat: Cleaning bricks for removing prefixes and postfixes ( #62 )
...
* added prefix and postfix cleaners
* added test for pre and postfix cleaners
* added docs for prefix and postfix bricks
* changelog and bump version
* add dev to version
2022-11-10 12:24:58 -05:00
Matt Robinson
64f2d3aa49
docs: Add developer quick start section ( #61 )
2022-11-09 09:52:29 -06:00
Matt Robinson
4aa3d51b03
fix: Change the image src to an absolute link ( #60 )
2022-11-08 22:05:30 +00:00
Matt Robinson
2715950d6f
chore: Add long description content type; bump version ( #59 )
2022-11-08 16:55:41 -05:00
benjats07
6b3e86c508
docs: Added long description to PyPi ( #58 )
...
* docs: Added long description to PyPi
* Added fields for description in PyPi
2022-11-08 15:22:43 -06:00
benjats07
df16b5806b
feat: Add staging brick for Datasaur token-based tasks ( #50 )
...
* feat: Add staging brick for Datasaur token-based tasks
* Added doc string and formatting with flake8,mypy and black
* docs: Added documentation for stage_for_datasaur
* fix: version sync correction
* fix: Corrections to docs fror stage_for_datasaur
* fix: changes in naming of example variables
* Update docs/source/bricks.rst
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-07 14:56:02 -06:00
dependabot[bot]
d5bd44bee4
build(deps): Bump tokenizers from 0.13.1 to 0.13.2 in /requirements ( #55 )
...
Bumps [tokenizers](https://github.com/huggingface/tokenizers ) from 0.13.1 to 0.13.2.
- [Release notes](https://github.com/huggingface/tokenizers/releases )
- [Changelog](https://github.com/huggingface/tokenizers/blob/main/RELEASE.md )
- [Commits](https://github.com/huggingface/tokenizers/compare/v0.13.1...v0.13.2 )
---
updated-dependencies:
- dependency-name: tokenizers
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Matt Robinson <mrobinson@unstructured.io>
2022-11-07 11:40:02 -05:00
