yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-07-14 04:25:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/examples/argilla-summarization
History
Matt Robinson 9b0dbc7026
build(deps): bump dependencies; resolve security issues in example dependencies (#300) 
* bump cryptography version

* re pip-compile for latest versions

* update argilla example requirements

* dependency updates

* bump versions

* pin unstructured-inference due to multithreading issue

* linting, linting, linting

* dependency on one line
2023-02-27 12:45:28 -05:00
..
img
docs: example notebooks from community repo (#187)
2023-01-31 10:37:32 -05:00
.gitignore
docs: example notebooks from community repo (#187)
2023-01-31 10:37:32 -05:00
isw-summarization.ipynb
docs: example notebooks from community repo (#187)
2023-01-31 10:37:32 -05:00
README.md
Resolve numerous typos (#280)
2023-02-24 17:48:23 -08:00
requirements.in
build(deps): bump dependencies; resolve security issues in example dependencies (#300)
2023-02-27 12:45:28 -05:00
requirements.txt
build(deps): bump dependencies; resolve security issues in example dependencies (#300)
2023-02-27 12:45:28 -05:00

README.md

ISW Summarization Example

This directory shows and example of how to use unstructured, argilla, and transformers to train a custom summarization model on Institute for the Study of War (ISW) reports about the was in Ukraine. This example shows how, by combining these three libraries, you can complete a data science project in hours that previously would have taken weeks.

To get started, use the following steps:

  • Ensure you have Python 3.8 or higher installed on your system
  • Create a new Python virtual environment
  • Run pip install -r requirements.txt to install the dependencies
  • Run PYTHONPATH=. jupyter notebook from this directory to launch the notebook

At this point, you'll be able to run the model training notebook.