mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-12-30 16:47:19 +00:00
* Unify CI tests (from #2466) * Update Documentation & Code Style * Change folder names * Fix markers list * Remove marker 'slow', replaced with 'integration' * Soften children check * Start ES first so it has time to boot while Python is setup * Run the full workflow * Try to make pip upgrade on Windows * Set KG tests as integration * Update Documentation & Code Style * typo * faster pylint * Make Pylint use the cache * filter diff files for pylint * debug pylint statement * revert pylint changes * Remove path from asserted log (fails on Windows) * Skip preprocessor test on Windows * Tackling Windows specific failures * Fix pytest command for windows suites * Remove \ from command * Move poppler test into integration * Skip opensearch test on windows * Add tolerance in reader sas score for Windows * Another pytorch approx * Raise time limit for unit tests :( * Skip poppler test on Windows CI * Specify to pull with FF only in docs check * temporarily run the docs check immediately * Allow merge commit for now * Try without fetch depth * Accelerating test * Accelerating test * Add repository and ref alongside fetch-depth * Separate out code&docs check from tests * Use setup-python cache * Delete custom action * Remove the pull step in the docs check, will find a way to run on bot commits * Add requirements.txt in .github for caching * Actually install dependencies * Change deps group for pylint * Unclear why the requirements.txt is still required :/ * Fix the code check python setup * Install all deps for pylint * Make the autoformat check depend on tests and doc updates workflows * Try installing dependencies in another order * Try again to install the deps * quoting the paths * Ad back the requirements * Try again to install rest_api and ui * Change deps group * Duplicate haystack install line * See if the cache is the problem * Disable also in mypy, who knows * split the install step * Split install step everywhere * Revert "Separate out code&docs check from tests" This reverts commit 1cd59b15ffc5b984e1d642dcbf4c8ccc2bb6c9bd. * Add back the action * Proactive support for audio (see text2speech branch) * Fix label generator tests * Remove install of libsndfile1 on win temporarily * exclude audio tests on win * install ffmpeg for integration tests Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
53 lines
1.7 KiB
YAML
53 lines
1.7 KiB
YAML
name: Python Cache
|
|
description: Caches a full installation of Haystack dependencies
|
|
|
|
inputs:
|
|
prefix:
|
|
description: 'prefix for the cache (to distinguish OS)'
|
|
required: true
|
|
default: 'linux'
|
|
pythonPath:
|
|
description: 'Python path to cache/restore'
|
|
required: true
|
|
pythonVersion:
|
|
description: 'Python version to use'
|
|
required: true
|
|
default: "3.7"
|
|
|
|
runs:
|
|
using: "composite"
|
|
steps:
|
|
|
|
- name: Get date
|
|
shell: bash
|
|
run: echo "date=$(date +'%Y-%m-%d')" >> $GITHUB_ENV
|
|
|
|
- name: Checkout
|
|
uses: actions/checkout@v2
|
|
|
|
- name: Setup Python
|
|
uses: actions/setup-python@v2
|
|
with:
|
|
python-version: ${{ inputs.pythonVersion }}
|
|
|
|
- name: Cache
|
|
id: cache-python-env
|
|
uses: actions/cache@v2
|
|
with:
|
|
path: ${{ env.pythonLocation }}
|
|
# The cache will be rebuild every day and at every change of the dependency files
|
|
key: ${{ inputs.prefix }}-py${{ inputs.pythonVersion }}-${{ env.date }}-${{ hashFiles('**/setup.py') }}-${{ hashFiles('**/setup.cfg') }}-${{ hashFiles('**/pyproject.toml') }}
|
|
|
|
- name: Install dependencies
|
|
# NOTE: this action runs only on cache miss to refresh the dependencies and make sure the next Haystack install will be faster.
|
|
# Do not rely on this step to install Haystack itself!
|
|
# The cache can last way longer than a specific action's run, so older Haystack version could be carried over and the tests will run
|
|
# against the cached code instead of the new changes.
|
|
if: steps.cache-python-env.outputs.cache-hit != 'true'
|
|
shell: bash
|
|
run: |
|
|
python -m pip install --upgrade pip
|
|
pip install .[all]
|
|
pip install rest_api/
|
|
pip install ui/
|
|
pip install torch-scatter -f https://data.pyg.org/whl/torch-1.11.0+cpu.html |