yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-14 12:36:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
35 Commits 214 Branches 193 Tags
Commit Graph

2 Commits

Author SHA1 Message Date
Matt Robinson
fb16847946
feat: Staging brick for attention window chunking (#34) 
* add huggingface dependencies and re pip-compile

* first pass on chunk by attention window

* test for chunking function

* completed tests for chunk_by_attention_window

* change default buffer size to 2

* wrapper function for staging

* added docs for transformers

* fix wording and typos

* updated change log and bumped the version

* added docs on huggingface dependencies

* fix typo

* re pip-compile
 2022-10-13 11:18:27 -04:00
Matt Robinson
5f40c78f25 Initial Release 2022-09-26 14:55:20 -07:00