2 Commits

Author	SHA1	Message	Date
Steve Canny	51cf6bf716	rfctr(chunking): extract strategy-specific chunking options (#2556) ... **Summary** A pluggable chunking strategy needs its own local set of chunking options that subclasses a base-class in `unstructured`. Extract distinct `_ByTitleChunkingOptions` and `_BasicChunkingOptions` for the existing two chunking strategies and move their strategy-specific option setting and validation to the respective subclass. This was also a good opportunity for us to clean up a few odds and ends we'd been meaning to. Might be worth looking at the commits individually as they are cohesive incremental steps toward the goal.	2024-02-23 18:22:44 +00:00
Steve Canny	23edf2e911	feature(chunking): add basic strategy and overlap (#2367) ... This PR culminates the restructuring of chunking over my prior dozen-or-so commits by adding the new options to the API and documentation. Separately I'll be adding a new ingest test to defend against regression, although the integration test included in this PR will do a pretty good job of that too.	2024-01-10 22:19:24 +00:00