This website requires JavaScript.
Explore
Help
Register
Sign In
yujunjun
/
unstructured
Watch
1
Star
0
Fork
0
You've already forked unstructured
mirror of
https://github.com/Unstructured-IO/unstructured.git
synced
2025-07-08 09:33:43 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
unstructured
/
scripts
/
performance
/
requirements.txt
5 lines
60 B
Plaintext
Raw
Permalink
Normal View
History
Unescape
Escape
test: adds profiling script (#661)
2023-06-01 14:26:05 -07:00
flameprof>=0.4
memray>=1.7.0
snakeviz>=2.2.0
dev: add py-spy profiling (#1251) This PR adds a new developer tool for profiling performance: `py-spy`. Additionally it adds a new make command to start a docker with your local `unstructured` repo mounted for quick testing code in a Rocky Linux environment (see usage below for intent). ### py-spy It is a sampling profiler https://github.com/benfred/py-spy and in practice usually provides more readily usable information than commonly used `cProfiler`. It also supports output to `speedscope` format, [which](https://github.com/jlfwong/speedscope#usage) provides a rich view of the profiling result. ### usage The new tool is added to the existing `profile.sh` script and is readily discoverable in the interactive interface. When select to view the new speedscope format profile it would show up in your local browser if you followed the readme to install speedscope locally via `npm install -g speedscope`. On macOS the profiling tool needs superuser privilege. If you are not comfortable with that feel free to run the profiling inside a Linux container if your local dev env is macOS.
2023-08-31 14:26:29 -05:00
py-spy>=0.3.14
Reference in New Issue
Copy Permalink