yujunjun/haystack
1
0
Fork 0
mirror of https://github.com/deepset-ai/haystack.git synced 2025-08-26 09:26:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,174 Commits 76 Branches 253 Tags
Commit Graph

3174 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tobias Wochinger
f22d49944d
docs: review and normalize haystack.components.websearch (#7236) 
* docs: review and normalize `haystack.components.websearch`

* fix: use correct type annotations

* refactor: use type from protocol

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>

* Revert "refactor: use type from protocol"

This reverts commit 23d6f45cd763c39b98be1bff03639a90f2a01fac.

* docs: refactor according to comments

* build: correctly pin to 4.7

---------

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
 2024-02-28 16:43:08 +01:00
David S. Batista
20ebb46fa5
Fix/docstrings dataclasses (#7221) 
* wip

* fixing docstrings

* Update haystack/dataclasses/document.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/dataclasses/document.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
 2024-02-28 15:35:25 +01:00
Tobias Wochinger
c2a9528595
build: pin typing-extensions (#7245) 
https://community.openai.com/t/error-while-importing-openai-from-open-import-openai/578166/26
 2024-02-28 14:34:41 +01:00
Silvano Cerza
2fea67d4a9
Fix delete_outdated_docs.py to get the correct api key (#7242) 2024-02-28 12:52:13 +01:00
Silvano Cerza
61eb143905
Fix delete outdated docs job in readme_sync.yml (#7241) 2024-02-28 12:41:10 +01:00
Massimiliano Pippi
f812048713
remove the override feature (#7227) 2024-02-28 11:33:40 +01:00
Stefano Fiorucci
7b9704a93a
docs: review Routers docstrings (#7234) 
* wip

* review routers

* small fixes

* Update haystack/components/routers/conditional_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/conditional_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/file_type_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/file_type_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/file_type_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/file_type_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/metadata_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/metadata_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/text_language_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/text_language_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/routers/text_language_router.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
 2024-02-28 11:26:22 +01:00
Tobias Wochinger
ac4f458e2b
docs: review and normalize haystack.components.fetchers (#7232) 
* docs: review and normalize `haystack.components.fetchers`

* docs: drop defaults
 2024-02-28 11:24:12 +01:00
Silvano Cerza
85491433c6
ci: Add script to delete documentation that don't exist anymore (#7209) 
* Add script to delete documentation that don't exist anymore

* Remove prints
 2024-02-28 11:02:59 +01:00
Tobias Wochinger
419009b495
fix: move sensitive log to debug mode (#7230) 2024-02-28 09:45:50 +01:00
Stefano Fiorucci
380052a963
replace text with content (#7211) 2024-02-28 09:28:14 +01:00
David S. Batista
f9db75c497
Fix/docstrings generators (#7218) 
* fixing azure

* fixing openai

* fixing remaining

* Update haystack/components/generators/openai.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/generators/hugging_face_local.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/generators/hugging_face_local.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* Update haystack/components/generators/hugging_face_local.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

* fixing docstrings

* fixing docstrings

* fixing docstrings

* Update haystack/components/generators/hugging_face_tgi.py

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>

---------

Co-authored-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
 2024-02-27 20:14:58 +01:00
Tobias Wochinger
14f65d5a68
feat: check tty / jupyter availability for logging config detection (#7226) 
* feat: check tty availability for logging config detection

* chore: support jupyter + lower env variable

* chore: also use jupyter util for check

* test: set right mode
 2024-02-27 18:31:51 +01:00
Vladimir Blagojevic
d871bbbfbd
feat: Add complex types in OpenAPI support (#7065) 
* Add complex types OpenAPI support

* Add release note
---------

Co-authored-by: Julian Risch <julian.risch@deepset.ai>
 2024-02-27 18:11:06 +01:00
David S. Batista
3fc77979d8
fixing docstrings (#7225) 2024-02-27 17:50:36 +01:00
Massimiliano Pippi
93acdc1d3a
refactor: Refactor pipeline templates (#7213) 
* merge template source into pipeline template

* docstrings

* rework pipeline templates using Jinja features

* amend release notes

* linting

* Apply suggestions from code review

Co-authored-by: Julian Risch <julian.risch@deepset.ai>

* specify QA is generative

* amend docstring

* review feedback

* forgot one comment

* add template source to the error message for easy debugging

* fix tests

* try

* annotate return type of build function

---------

Co-authored-by: Julian Risch <julian.risch@deepset.ai>
 2024-02-27 17:39:23 +01:00
Stefano Fiorucci
e194c08316
docs: review DocumentLanguageClassifier docstrings (#7210) 
* review DocumentLanguageClassifier docstrings

* fix

* improve pydoc config
 2024-02-27 16:02:53 +01:00
Stefano Fiorucci
2580e053ad
fix wrong docs config (#7224) 2024-02-27 16:00:44 +01:00
Stefano Fiorucci
9b1d7926ae
preprocessors: review docstrings (#7219) 2024-02-27 15:51:23 +01:00
dependabot[bot]
87727e4d5c
chore(deps): bump iterative/setup-cml from 2 to 3 (#7223) 
Bumps [iterative/setup-cml](https://github.com/iterative/setup-cml) from 2 to 3.
- [Release notes](https://github.com/iterative/setup-cml/releases)
- [Commits](https://github.com/iterative/setup-cml/compare/v2...v3)

---
updated-dependencies:
- dependency-name: iterative/setup-cml
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-27 15:49:48 +01:00
Tobias Wochinger
6fce2dbb11
feat: log trace correlation (#7206) 
* feat: implement support for trace-log correlation

* docs: add release notes
 2024-02-27 10:06:53 +01:00
Tobias Wochinger
2a591280ab
feat: implement support for structured logging (#7126) 
* feat: implement support for structured logging

* docs: add release notes

* style: add explanatory comment

* chore: test + import fixes

* tests: fix windows tests
 2024-02-27 09:15:01 +01:00
Stefano Fiorucci
e0b692467b
TopPSampler docstrings (#7205) 
* TopPSampler docstrings

* inline quote
 2024-02-26 18:06:29 +01:00
Silvano Cerza
8838c02872
Fix snippets_tests.yml (#7208) 2024-02-26 18:04:43 +01:00
Julian Risch
22e9def2cd
chore: Remove deprecated GPTGenerator and GPTChatGenerator (#7125) 
* remove deprecated GPTGenerator and GPTChatGenerator

* remove unused import
 2024-02-26 16:06:26 +01:00
Tobias Wochinger
ba49905eff
ci: unify dependency management + hatch scripts (#7079) 
* ci: unify dependency management + hatch scripts

* ci: migrate readme sync

* build: migrate snippets

* ci: pin hatch

* ci: make Python version more explicit + quote

* ci: add scripts with parameters to hatch

---------

Co-authored-by: Silvano Cerza <3314350+silvanocerza@users.noreply.github.com>
 2024-02-26 15:40:10 +01:00
Silvano Cerza
d66b5358a1
Remove eval end to end tests (#7093) 2024-02-26 12:27:15 +01:00
Stefano Fiorucci
3b8af365e3
restore transparent background for Pipeline images (#7086) 2024-02-26 09:25:07 +01:00
Tobias Wochinger
79b32cd755
build: fix CVE-2022-40897 (#7080) 2024-02-23 16:58:39 +01:00
Vladimir Blagojevic
f5645a4454
Update API docs to include OutputAdapter, OpenAPIServiceConnector and OpenAPIServiceToFunctions (#7076) 2024-02-23 14:34:16 +01:00
Silvano Cerza
0a7dfc1b32
Revert "Add AnswerExactMatchEvaluator (#7050)" (#7075) 
This reverts commit b4011af8e9bc4ae2f72e51db254bfda69e20b651.
 2024-02-23 14:05:57 +01:00
Tobias Wochinger
41b93108c0
feat: allow content tracing (#7066) 
* feat: implement content tracing capability

* feat: trace component input/output

* chore: extend type serialization to classes with `to_dict`

* docs: add option for content tracing

* style: remove unused import

* chore: add more tags

* style: ignore typing

* fix: fix tagging of types
 2024-02-23 11:52:54 +01:00
Silvano Cerza
b4011af8e9
Add AnswerExactMatchEvaluator (#7050) 
* Add AnswerExactMatchEvaluator

* Add release notes

* Fix linting

* Update docstrings
 2024-02-23 10:37:18 +01:00
Tobias Wochinger
bc8a48cc3c
feat: datadog tracer (#7058) 
* feat: implement datadog tracer

* feat: autoenable for ddtrace

* docs: add release notes

* ci: add missing test dependency

* chore: use forward references
 2024-02-23 09:18:32 +01:00
Vladimir Blagojevic
08e97d874e
Export (de)serialize_callable and (de)serialize_type in haystack.utils (#7069) 
* Export (de)serialize_callable and (de)serialize_type in haystack.utils

* Group imports where possible
 2024-02-22 17:07:07 +01:00
Massimiliano Pippi
0507fce256
forward-declare opentelemetry (#7067) 2024-02-22 15:30:03 +01:00
Vladimir Blagojevic
49cad21a2e
chore: Adjust json_schema.py slightly (#7055) 
* Slighly adjust json_schema.py

* Adjust test structures
 2024-02-22 14:33:07 +01:00
Tobias Wochinger
6d0d373def
feat: opentelemetry tracer (#7052) 
* feat: add opentelemetry tracer

* feat: implement auto enable for `OpenTelemetry`

* docs: add release notes

* style: fix linting

* tests: more test coverage

* refactor: fix old method call

* docs: fix duplicate `the`

Co-authored-by: Massimiliano Pippi <mpippi@gmail.com>

---------

Co-authored-by: Massimiliano Pippi <mpippi@gmail.com>
 2024-02-22 14:30:58 +01:00
Vladimir Blagojevic
cb6389d7a2
feat: Improve OpenAPI integration (#7034) 
* Simplify and improve OpenAPIServiceConnector and OpenAPIServiceToFunctions, add unit tests

* Add reno note

* Add flask test dependency

* Initial PR feedback - Julian

* Remove indirection - Silvano

* Remove flask end-to-end tests

* Remove unused import

* Add mixed body unit test

* Update unit test, mock properly
 2024-02-22 14:03:50 +01:00
Tobias Wochinger
6e580e4430
feat: implement pipeline tracing (#7046) 
* feat: implement pipeline tracing

* tests: improve test setup for spying tracer

* feat: implement util for type coercion

* fix: trace a after checking pipeline output

* docs: add release notes

* docs: drop unused imports

* refactor: simplify getting raw span

* refactor: implement `ProxyTracer`
 2024-02-22 12:52:04 +01:00
Tobias Wochinger
d6ef2b55be
ci: only only skip tests if no code changes at all (#7061) 
* ci: only only skip tests if no code  changes at all

* ci: introduce fake change to test flow

* ci: skip running entire workflow

* Revert "ci: introduce fake change to test flow"

This reverts commit 96eed5d65f0a96e90b5d5a390b1a04386a046dac.

* ci: add missing paths
 2024-02-22 11:15:16 +01:00
ZanSara
62ab83a0a0
remove pydoc config (#7060) 2024-02-22 10:48:35 +01:00
ZanSara
34edaa1105
fix formatting (#7059) 2024-02-22 10:39:02 +01:00
ZanSara
088aa50d99
update version (#7057) v2.0.0-beta.8 2024-02-22 10:27:43 +01:00
dependabot[bot]
7f4d11c38e
chore(deps): bump fossas/fossa-action from 1.3.1 to 1.3.3 (#7019) 
Bumps [fossas/fossa-action](https://github.com/fossas/fossa-action) from 1.3.1 to 1.3.3.
- [Release notes](https://github.com/fossas/fossa-action/releases)
- [Commits](https://github.com/fossas/fossa-action/compare/v1.3.1...v1.3.3)

---
updated-dependencies:
- dependency-name: fossas/fossa-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-02-22 10:01:15 +01:00
Silvano Cerza
8ca4bf405b
Remove all evaluator components (#7053) 2024-02-21 18:24:14 +01:00
Massimiliano Pippi
f3be576b5c
refact: remove the concept of TemplateSource from the public API (#7051) 
* remove unused field

* hide the TemplateSource abstraction

* amend release notes

* revert
 2024-02-21 12:02:04 +01:00
Massimiliano Pippi
f8a06b6cf2
chore: collect templates in a dedicated folder (#7048) 
* collect templates in a dedicated folder

* run the tests if the templates change
 2024-02-21 10:50:31 +01:00
Varun Mathur
b335b5d723
feat: Add Lost In The Middle Ranker (#6995) 
* add lost in the middle ranker

* update

* add release notes

* update release notes

* fix mypy

* Update

* fix mypy

* fix mypy [union-attr] for content.split

* remove e2e tests and negative topk param

* remove query param, validate params

---------

Co-authored-by: Julian Risch <julian.risch@deepset.ai>
 2024-02-20 19:55:41 +01:00
Ashwin Mathur
327c2d260d
feat: Add Mean Reciprocal Rank (MRR) metric to StatisticalEvaluator (#7042) 
* Add MRR Metric

* Add release notes

* Update logic
 2024-02-20 13:58:48 +01:00