mirror of
https://github.com/Unstructured-IO/unstructured.git
synced 2025-10-30 17:38:13 +00:00
76efcf4dd7
### Description Given all the shell files that now exist in the repo, would be nice to have linting/formatting around them (in addition to the existing shellcheck which doesn't do anything to format the shell code). This PR introduces `shfmt` to both check for changes and apply formatting when the associated make targets are called.
14 lines
414 B
Bash
Executable File
14 lines
414 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
# Clean the content of json file generated by unstructured library, storing just
|
|
# text elements. The resulting file will be stored at the $2 folder with the same
|
|
# name as the original file appending .txt as suffix.
|
|
# Arguments:
|
|
# - $1 path to the file to clean
|
|
# - $2 path to folder to store the result
|
|
#
|
|
|
|
BASE=$(basename "$1")
|
|
DEST=$2/$BASE.txt
|
|
jq '.[].text' <"$1" | fold -w 80 -s >"$DEST"
|