haystack/rest_api/test/samples/pipeline/test_pipeline_faiss_indexing.yaml

version: '0.7'

components:
  - name: DPRRetriever
    type: DensePassageRetriever
    params:
      document_store: NewFAISSDocumentStore
  - name: PDFConverter
    type: PDFToTextConverter
    params:
      remove_numeric_tables: false
  - name: Preprocessor
    type: PreProcessor
    params:
      clean_whitespace: true
  - name: NewFAISSDocumentStore
    type: FAISSDocumentStore


pipelines:
  - name: indexing_pipeline
    type: Pipeline
    nodes:
      - name: PDFConverter
        inputs: [File]
      - name: Preprocessor
        inputs: [PDFConverter]
      - name: DPRRetriever
        inputs: [Preprocessor]
      - name: NewFAISSDocumentStore
        inputs: [DPRRetriever]
Improve dependency management (#1994) * Fist attempt at using setup.cfg for dependency management * Trying the new package on the CI and in Docker too * Add composite extras_require * Add the safe_import function for document store imports and add some try-catch statements on rest_api and ui imports * Fix bug on class import and rephrase error message * Introduce typing for optional modules and add type: ignore in sparse.py * Include importlib_metadata backport for py3.7 * Add colab group to extra_requires * Fix pillow version * Fix grpcio * Separate out the crawler as another extra * Make paths relative in rest_api and ui * Update the test matrix in the CI * Add try catch statements around the optional imports too to account for direct imports * Never mix direct deps with self-references and add ES deps to the base install * Refactor several paths in tests to make them insensitive to the execution path * Include tstadel review and re-introduce Milvus1 in the tests suite, to fix * Wrap pdf conversion utils into safe_import * Update some tutorials and rever Milvus1 as default for now, see #2067 * Fix mypy config Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> 2022-01-26 18:12:55 +01:00			`version: '0.7'`

			`components:`
			`- name: DPRRetriever`
			`type: DensePassageRetriever`
			`params:`
			`document_store: NewFAISSDocumentStore`
			`- name: PDFConverter`
			`type: PDFToTextConverter`
			`params:`
			`remove_numeric_tables: false`
			`- name: Preprocessor`
			`type: PreProcessor`
			`params:`
			`clean_whitespace: true`
			`- name: NewFAISSDocumentStore`
			`type: FAISSDocumentStore`


			`pipelines:`
			`- name: indexing_pipeline`
			`type: Pipeline`
			`nodes:`
			`- name: PDFConverter`
			`inputs: [File]`
			`- name: Preprocessor`
			`inputs: [PDFConverter]`
			`- name: DPRRetriever`
			`inputs: [Preprocessor]`
			`- name: NewFAISSDocumentStore`
			`inputs: [DPRRetriever]`