yujunjun/unstructured
1
0
Fork 0
mirror of https://github.com/Unstructured-IO/unstructured.git synced 2025-12-09 22:30:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
unstructured/Dockerfile-amd64

28 lines
1.1 KiB
Plaintext
Raw Normal View History

fix: update base image SHA for amd64 wolfi (#3270) This PR aims to fix a `test_dockerfile` job [failure](https://github.com/Unstructured-IO/unstructured/actions/runs/9613636416/job/26517074221?pr=3234) in CI after `base-images` repo update.
2024-06-21 11:30:33 -07:00
FROM quay.io/unstructured-io/base-images:wolfi-base@sha256:7c3af225a39f730f4feee705df6cd8d1570739dc130456cf589ac53347da0f1d as base
adding Dockerfile (#359)
2023-03-14 13:40:01 -07:00
build: wolfi base image for Dockerfile (#3016) ### Summary Updates the `Dockerfile` to use the Chainguard `wolfi-base` image to reduce CVEs. Also adds a step in the docker publish job that scans the images and checks for CVEs before publishing. The job will fail if there are high or critical vulnerabilities. ### Testing Run `make docker-run-dev` and then `python3.11` once you're in. And that point, you can try: ```python from unstructured.partition.auto import partition elements = partition(filename="example-docs/DA-1p.pdf", skip_infer_table_types=["pdf"]) elements ``` Stop the container once you're done.
2024-05-15 18:53:15 -04:00
USER root
adding Dockerfile (#359)
2023-03-14 13:40:01 -07:00
build: pull from wolfi base image (#3213) ### Summary Updates the `wolfi` image to pull from the upstream `wolfi-base` base image to avoid maintaining the base layers in both locations. Closes #3105 by pulling in the fix from upstream. ### Testing `test_dockerfile` should continue to pass with the changes.
2024-06-14 16:41:27 -04:00
WORKDIR /app
fix: disable arm build for chainguard (#3039) ### Summary Temporarily disables the ARM build due to the error in [this CI job](https://github.com/Unstructured-IO/unstructured/actions/runs/9114507405/job/25058629166). Will add back support for ARM using the rockylinux container once we show this works.
2024-05-16 20:22:10 -04:00
COPY ./requirements requirements/
adding Dockerfile (#359)
2023-03-14 13:40:01 -07:00
COPY unstructured unstructured
build: wolfi base image for Dockerfile (#3016) ### Summary Updates the `Dockerfile` to use the Chainguard `wolfi-base` image to reduce CVEs. Also adds a step in the docker publish job that scans the images and checks for CVEs before publishing. The job will fail if there are high or critical vulnerabilities. ### Testing Run `make docker-run-dev` and then `python3.11` once you're in. And that point, you can try: ```python from unstructured.partition.auto import partition elements = partition(filename="example-docs/DA-1p.pdf", skip_infer_table_types=["pdf"]) elements ``` Stop the container once you're done.
2024-05-15 18:53:15 -04:00
COPY test_unstructured test_unstructured
COPY example-docs example-docs
adding Dockerfile (#359)
2023-03-14 13:40:01 -07:00
build: pull from wolfi base image (#3213) ### Summary Updates the `wolfi` image to pull from the upstream `wolfi-base` base image to avoid maintaining the base layers in both locations. Closes #3105 by pulling in the fix from upstream. ### Testing `test_dockerfile` should continue to pass with the changes.
2024-06-14 16:41:27 -04:00
RUN chown -R notebook-user:notebook-user /app
USER notebook-user
build: wolfi base image for Dockerfile (#3016) ### Summary Updates the `Dockerfile` to use the Chainguard `wolfi-base` image to reduce CVEs. Also adds a step in the docker publish job that scans the images and checks for CVEs before publishing. The job will fail if there are high or critical vulnerabilities. ### Testing Run `make docker-run-dev` and then `python3.11` once you're in. And that point, you can try: ```python from unstructured.partition.auto import partition elements = partition(filename="example-docs/DA-1p.pdf", skip_infer_table_types=["pdf"]) elements ``` Stop the container once you're done.
2024-05-15 18:53:15 -04:00
fix: disable arm build for chainguard (#3039) ### Summary Temporarily disables the ARM build due to the error in [this CI job](https://github.com/Unstructured-IO/unstructured/actions/runs/9114507405/job/25058629166). Will add back support for ARM using the rockylinux container once we show this works.
2024-05-16 20:22:10 -04:00
RUN find requirements/ -type f -name "*.txt" -exec pip3.11 install --no-cache-dir --user -r '{}' ';'
RUN pip3.11 install unstructured.paddlepaddle
build: wolfi base image for Dockerfile (#3016) ### Summary Updates the `Dockerfile` to use the Chainguard `wolfi-base` image to reduce CVEs. Also adds a step in the docker publish job that scans the images and checks for CVEs before publishing. The job will fail if there are high or critical vulnerabilities. ### Testing Run `make docker-run-dev` and then `python3.11` once you're in. And that point, you can try: ```python from unstructured.partition.auto import partition elements = partition(filename="example-docs/DA-1p.pdf", skip_infer_table_types=["pdf"]) elements ``` Stop the container once you're done.
2024-05-15 18:53:15 -04:00
RUN python3.11 -c "import nltk; nltk.download('punkt')" && \
python3.11 -c "import nltk; nltk.download('averaged_perceptron_tagger')" && \
python3.11 -c "from unstructured.partition.model_init import initialize; initialize()" && \
python3.11 -c "from unstructured_inference.models.tables import UnstructuredTableTransformerModel; model = UnstructuredTableTransformerModel(); model.initialize('microsoft/table-transformer-structure-recognition')"
build: pull from wolfi base image (#3213) ### Summary Updates the `wolfi` image to pull from the upstream `wolfi-base` base image to avoid maintaining the base layers in both locations. Closes #3105 by pulling in the fix from upstream. ### Testing `test_dockerfile` should continue to pass with the changes.
2024-06-14 16:41:27 -04:00
ENV PATH="${PATH}:/home/notebook-user/.local/bin"
build: wolfi base image for Dockerfile (#3016) ### Summary Updates the `Dockerfile` to use the Chainguard `wolfi-base` image to reduce CVEs. Also adds a step in the docker publish job that scans the images and checks for CVEs before publishing. The job will fail if there are high or critical vulnerabilities. ### Testing Run `make docker-run-dev` and then `python3.11` once you're in. And that point, you can try: ```python from unstructured.partition.auto import partition elements = partition(filename="example-docs/DA-1p.pdf", skip_infer_table_types=["pdf"]) elements ``` Stop the container once you're done.
2024-05-15 18:53:15 -04:00
ENV TESSDATA_PREFIX=/usr/local/share/tessdata
ci: update dockerfile to also add models and nltk (#418)
2023-03-29 20:48:06 -07:00
adding Dockerfile (#359)
2023-03-14 13:40:01 -07:00
CMD ["/bin/bash"]
Reference in New Issue Copy Permalink