181 Commits

Author SHA1 Message Date
Stefano Fiorucci
6ad23f822f
ci: add timeout-minutes to relevant CI jobs (#9409) 2025-05-20 09:23:42 +02:00
Stefano Fiorucci
f8eead3adc
ci: disable caching on Windows tests (#9318)
* ci: try skipping cache on Windows

* trigger

* remove trigger

---------

Co-authored-by: David S. Batista <dsbatista@gmail.com>
2025-04-29 18:21:34 +02:00
Stefano Fiorucci
9ae7da8df3
test: workflow for slow/unstable integration tests (#9267)
* workflow for slow integration tests

* try changing skipper

* Trigger Build

* better names

* fix

* mv tika to slow

* try skipping slow workflow

* retry paths-ignore

* remove skipper

* Revert "remove skipper"

This reverts commit 302ed2f07f36b33fa61fde0843b5590d79b98d74.

* better skipper

* retry

* Revert "retry"

This reverts commit fe5dff68f496645cc45292d74fcd8d043e868392.

* try using one workflow

* trigger

* try to see if it fails

* cosmetic changes

* improvements

* try matrix

* retry

* fix

* clean up

* simplify datadog monitoring and trigger

* send event to datadog for nightly failures

* tests should run if: manual trigger, scheduled, PR has label, release branch, or relevant files changed

* clarify slow marker

* improve comments

* labels
2025-04-23 10:36:44 +02:00
Stefano Fiorucci
4279d7e149
ci: stop rerunning tests on PRs ready for review (#9254) 2025-04-17 10:10:45 +02:00
Stefano Fiorucci
e5dc4ef94d
ci: stop caching Hatch python environment on Ubuntu (#9249)
* try setting hatch variables

* debug steps

* stop caching on ubuntu

* remove debug steps

* cache should work for mac and wind

* bring back cache and log verbose; temp skip win and mac

* try

* stop caching Hatch python environment for Ubuntu

* remove trigger
2025-04-16 18:05:12 +02:00
Stefano Fiorucci
f478d9145f
fix: make mypy run + some type fixes on Agent (#9250)
* make lint work + some mypy fixes on Agent

* Simple solution

* Remove unused import

---------

Co-authored-by: Sebastian Husch Lee <sjrl423@gmail.com>
2025-04-16 17:00:51 +02:00
Stefano Fiorucci
36bbd27e8d
ci: update hatch to 1.14.1 (#9245)
* try updating hatch to 1.14.1

* trigger tests

* better trigger

* remove trigger
2025-04-16 11:25:57 +02:00
Stefano Fiorucci
08fa1db98a
ci: fix lint job (#9217)
* fix lint job

* remove trigger
2025-04-11 11:01:03 +02:00
Stefano Fiorucci
77898762a6
ci: make lint workflow check pyproject.toml (#9199)
* ci: make lint workflow rune when pyproject is modified

* remove trigger
2025-04-09 12:05:24 +02:00
Stefano Fiorucci
cf97ba2a68
ci: review required jobs (#9124)
* ci: review required jobs

* retrigger

* rm trigger
2025-03-27 18:12:27 +01:00
Stefano Fiorucci
593ca87645
ci: run mypy across the codebase (#9103)
* ci: run mypy across the codebase

* trigger

* rm trigger

* actually rm trigger

---------

Co-authored-by: David S. Batista <dsbatista@gmail.com>
2025-03-25 12:14:40 +01:00
dependabot[bot]
75a9441e84
build(deps): bump tj-actions/changed-files from 45 to 46 (#9049)
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 45 to 46.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v45...v46)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-18 11:10:10 +01:00
Stefano Fiorucci
3339097e99
ci: refactor job to check imports (#8892)
* refactor

* Trigger CI

* run tests if this file changes

* show failure

* revert

* rm duplicate subdir and explain in comment
2025-02-21 11:37:41 +01:00
Stefano Fiorucci
de7099e560
ci: add job to check imports (#8594)
* try checking imports

* clarify error message

* better fmt

* do not show complete list of successfully imported packages

* refinements

* relnote

* add missing forward references

* better function name

* linting

* fix linting

* Update .github/utils/check_imports.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
2024-11-29 14:00:59 +00:00
Stefano Fiorucci
c7b898994e
build: unpin numpy + use Python 3.9 in CI (#8492)
* try unpinning numpy

* try python 3.9

* release note
2024-10-28 12:15:17 +01:00
Stefano Fiorucci
7788bfe558
ci: upgrade Hatch to 1.13.0 and adopt uv as installer (#8313)
* try uv

* upgrade hatch

* rm unnecessary specification

* release note
2024-10-17 10:32:14 +02:00
Stefano Fiorucci
c682a59f5e
ci: reintroduce macos-latest in tests (#8405)
* try testing with macos-latest

* trigger CI

* remove trigger
2024-09-25 16:43:03 +02:00
dependabot[bot]
0a1a64cb0c
build(deps): bump tj-actions/changed-files from 44 to 45 (#8269)
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 44 to 45.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v44...v45)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-08-21 17:00:17 +02:00
Massimiliano Pippi
3a03fce71c
ci: Add code formatting checks (#7882)
* ruff settings

enable ruff format and re-format outdated files

feat: `EvaluationRunResult` add parameter to specify columns to keep in the comparative `Dataframe`  (#7879)

* adding param to explictily state which cols to keep

* adding param to explictily state which cols to keep

* adding param to explictily state which cols to keep

* updating tests

* adding release notes

* Update haystack/evaluation/eval_run_result.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update releasenotes/notes/add-keep-columns-to-EvalRunResult-comparative-be3e15ce45de3e0b.yaml

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* updating docstring

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

add format-check

fail on format and linting failures

fix string formatting

reformat long lines

fix tests

fix typing

linter

pull from main

* reformat

* lint -> check

* lint -> check
2024-06-18 15:52:46 +00:00
Massimiliano Pippi
5a247138cb
ci: add dependency cache step (#7874)
* add cache step

* add test commit

* do not use shell to get deps

* force shell on all platforms

* use short-lived cache

* do not use a dedicated build step
2024-06-17 10:46:11 +02:00
Massimiliano Pippi
24518dfa32
ci: merge linting steps into the test workflow (#7866)
* move license header check under format

* merge linting into test workflow

* test commit to trigger CI

* Revert "test commit to trigger CI"

This reverts commit ade5dcc6873cdd29ff5c5e8c9033b137cdef4d81.

* remove unused skipper
2024-06-14 16:01:37 +02:00
Massimiliano Pippi
324bbc3868
chore: clean up default env and add a script to generate release notes. (#7858)
* clean up default env and add reno script

* update contributions guidelines

* use test script

* format

* re-add missing dep

* remove black in favour of ruff
2024-06-14 14:57:24 +02:00
Silvano Cerza
15aa4217bd
Install hatch in testing jobs (#7755) 2024-05-28 17:04:21 +02:00
Massimiliano Pippi
cc521f42ef
ci: remove dependency cache job (#7754)
* remove dependency cache job

* leftover
2024-05-28 16:03:59 +02:00
Tobias Wochinger
451fae880e
ci: fix catch-all (#7215)
* ci: trigger separate workflow

* ci: temporary use current branch

* ci: fix workflow name

* ci: try with same job name

* ci: try with dispatch

* Revert "ci: try with dispatch"

This reverts commit bd66e56c0697ae97fc2599eebaceff417d9be65c.

* Revert "ci: try with same job name"

This reverts commit 9e2ae5b402758c14a9f812c2e06f820bd3ece767.

* ci: try with workflow call in both cases

* ci: introduce change to trigger CI

* Revert "ci: introduce change to trigger CI"

This reverts commit e3ec07c5e26f114364babea69535183253c801b7.

* ci: add name

* Revert "Revert "ci: introduce change to trigger CI""

This reverts commit 6718585fd24069112e0f773e010056e1d96e3eee.

* ci: improve naming

* ci: further improve naming

* Unset reusable workflow version and use relative path

* Remove CI trigger

---------

Co-authored-by: Silvano Cerza <silvanocerza@gmail.com>
2024-04-29 14:54:12 +02:00
Vladimir Blagojevic
36b9a05212
Rollback macos-latest to macos-12 (#7597) 2024-04-26 10:44:49 +02:00
Silvano Cerza
65705a8fdc
Add HF_API_TOKEN env var in tests.yml (#7490) 2024-04-05 17:02:26 +02:00
Stefano Fiorucci
e793c718b6
chore: Upgrade transformers to 4.38.2 in test environment (#7363)
* upgrade transformers to 4.38.2 in test environment

* add pyproject to files to check in test workflow
2024-03-15 10:06:28 +01:00
Stefano Fiorucci
4b814b2b28
remove references to test_requirements (#7351) 2024-03-13 17:29:32 +01:00
Massimiliano Pippi
221bfb012c
fix: Update pyproject.toml (#7281)
* Update pyproject.toml

* make tests run on templates changes

---------

Co-authored-by: anakin87 <stefanofiorucci@gmail.com>
2024-03-01 12:40:24 +01:00
Tobias Wochinger
ba49905eff
ci: unify dependency management + hatch scripts (#7079)
* ci: unify dependency management + hatch scripts

* ci: migrate readme sync

* build: migrate snippets

* ci: pin hatch

* ci: make Python version more explicit + quote

* ci: add scripts with parameters to hatch

---------

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
2024-02-26 15:40:10 +01:00
Tobias Wochinger
d6ef2b55be
ci: only only skip tests if no code changes at all (#7061)
* ci: only only skip tests if no code  changes at all

* ci: introduce fake change to test flow

* ci: skip running entire workflow

* Revert "ci: introduce fake change to test flow"

This reverts commit 96eed5d65f0a96e90b5d5a390b1a04386a046dac.

* ci: add missing paths
2024-02-22 11:15:16 +01:00
Massimiliano Pippi
f8a06b6cf2
chore: collect templates in a dedicated folder (#7048)
* collect templates in a dedicated folder

* run the tests if the templates change
2024-02-21 10:50:31 +01:00
Stefano Fiorucci
5910b4adc9
fix: Pipeline templates with new devices mgmt (#7036)
* fix Pipeline templates with new devices mgmt

* Update haystack/templates/rag.yaml.jinja2

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>

* Update haystack/templates/indexing.yaml.jinja2

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>

* change to templates make tests run

---------

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
2024-02-19 16:05:46 +01:00
Silvano Cerza
549021d2fc
Use better cache key for dependencies in tests.yml (#6966) 2024-02-09 17:49:06 +01:00
Vladimir Blagojevic
37d9de3c4e
feat: Add service_credentials to OpenAPIServiceConnector run (#6962)
* Add service_credentials to OpenAPIServiceConnector run
* PR feedback Silvano
2024-02-09 16:03:27 +01:00
dependabot[bot]
ac353c4652
chore(deps): bump actions/cache from 3 to 4 (#6775)
Bumps [actions/cache](https://github.com/actions/cache) from 3 to 4.
- [Release notes](https://github.com/actions/cache/releases)
- [Changelog](https://github.com/actions/cache/blob/main/RELEASES.md)
- [Commits](https://github.com/actions/cache/compare/v3...v4)

---
updated-dependencies:
- dependency-name: actions/cache
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-18 15:21:31 +01:00
Massimiliano Pippi
9e63492440
fix: Fix error when calling dir() on a component instance (#6730)
* do not copy over __dict__ when creating the component class

* relnote

* let test run on core/*
2024-01-12 11:56:03 +01:00
Massimiliano Pippi
1bdc30679b
ci: re-enable coverage report (#6693)
* re-enable coverage report

* Update tests.yml
2024-01-08 11:24:00 +01:00
Vladimir Blagojevic
9c08f3d9c7
Add AZURE keys for Haystack 2.x Azure integration (#6690) 2024-01-05 14:53:01 +01:00
Stefano Fiorucci
01616d5b6b
ci: skip Tika tests in macOS integration tests (#6654)
* skip tika tests in macos integration tests

* test on this branch

* rm this branch from those to be tested
2023-12-28 15:23:32 +01:00
Stefano Fiorucci
30065eebae
ci: make Tika service smoothly run on MacOs (#6619) 2023-12-22 21:39:28 +01:00
Stefano Fiorucci
8469c7f702
chore: upgrade transformers to 4.36.2 in test requirements (#6610)
* Update test_requirements.txt

* make tests run when tests requirements change

---------

Co-authored-by: ZanSara <sara.zanzottera@deepset.ai>
2023-12-21 16:48:24 +01:00
dependabot[bot]
3c897e3b09
chore(deps): bump actions/setup-python from 4 to 5 (#6616)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-21 16:02:45 +01:00
Silvano Cerza
5546c8144e
ci: Speed up tests.yml by caching dependencies (#6417)
* Speed up tests.yml by caching dependencies

* Trigger for testing

* Use restore only action to speedup restoring

* Use bash shell to get pip cache dir

* Set shell for caching step

* Cache correct path

* Remove trigger
2023-12-20 16:21:48 +01:00
Stefano Fiorucci
cf47abdff5
chore: simplify the management of test dependencies (#6559)
* remove audio dep group

* extract dependencies

* beautify

* rm one step
2023-12-15 16:40:41 +01:00
Massimiliano Pippi
bc45170f4e
chore: add boilerpy3 to the core dependencies (#6544)
* add boilerpy3 to the core dependencies

* remove boilerpy3 installation from test workflow

* fix pylint: import order and unused import

* fix import order

* add release note

---------

Co-authored-by: Julian Risch <julian.risch@deepset.ai>
2023-12-14 11:53:38 +01:00
dependabot[bot]
51b49b838c
chore(deps): bump actions/setup-python from 4 to 5 (#6498)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4 to 5.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v4...v5)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-06 22:33:05 +01:00
Massimiliano Pippi
bf542ebfb0
downgrade unnecessary runner instance (#6477) 2023-12-04 11:39:36 +01:00
Massimiliano Pippi
a86807b834
move Cohere generator into dedicated integration (#6475) 2023-12-04 11:16:12 +01:00