mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-06-27 02:30:08 +00:00

### Summary We no longer use the "bricks" terminology for partioning functions, etc in the library. This PR updates various references to bricks within the repo and the docs. This is just an initial pass to swap the terminology out, it'll likely be helpful to reorganize the docs a bit as well. --------- Co-authored-by: qued <64741807+qued@users.noreply.github.com> Co-authored-by: ryannikolaidis <1208590+ryannikolaidis@users.noreply.github.com>
ISW Summarization Example
This directory shows and example of how to use unstructured
, argilla
, and transformers
to train a custom summarization model on Institute for the Study of War (ISW) reports
about the was in Ukraine. This example shows how, by combining these three libraries, you can
complete a data science project in hours that previously would have taken weeks.
To get started, use the following steps:
- Ensure you have Python 3.8 or higher installed on your system
- Create a new Python virtual environment
- Run
pip install -r requirements.txt
to install the dependencies - Run
PYTHONPATH=. jupyter notebook
from this directory to launch the notebook
At this point, you'll be able to run the model training notebook.