unstructured

mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-10-24 06:24:01 +00:00

History

pravin-unstructured 4020da56ad

Went through this demo notebook with Matt. Decision was made to add it to our collection of examples for use later. (#484 )

2023-04-17 11:53:25 -04:00

README.md

Went through this demo notebook with Matt. Decision was made to add it to our collection of examples for use later. (#484 )

2023-04-17 11:53:25 -04:00

requirements.txt

Went through this demo notebook with Matt. Decision was made to add it to our collection of examples for use later. (#484 )

2023-04-17 11:53:25 -04:00

topic_model.ipynb

Went through this demo notebook with Matt. Decision was made to add it to our collection of examples for use later. (#484 )

2023-04-17 11:53:25 -04:00

README.md

arXiv Topic Modelling

This directory contains an example of how to use the arXiv python package (wrapper for the arXiv api), berTopic python package (transformer based topic modelling) and several bricks from the unstructured library to run topic modelling on queried arXiV research papers. This notebook is very simple, but can easily modified for more complicated use cases.

To get started, use the following steps:

Ensure you have Python 3.8 or higher installed on your system
Create a new Python virtual environment
Run pip install -r requirements.txt to install the dependencies
Run PYTHONPATH=. jupyter notebook from this directory to launch the notebook

At this point, you'll be able to run the topic modelling example notebook.