Sara Zan 01ea4bf21f

Change default encoding for PDFToTextConverter from Latin 1 to UTF-8 (#2420) ...

* Change default encoding for PDFToTextConverter

* Update Documentation & Code Style

* Improve docstring

* Update Documentation & Code Style

* Add list of ligatures to ignore and add the possibility to modify such list at need

* Add docstring

* Add tests

* Rename parameter

* Update Documentation & Code Style

* Move implementation into the base converter to make mypy happier

* Update Documentation & Code Style

* mypy and pylint

* mypy

* move encoding parameter to init of PDFToTextConverter

* Update Documentation & Code Style

* make utf8 default and fix mypy

* Update Documentation & Code Style

* Update Documentation & Code Style

* remove note on encoding in tutorial8

* Update Documentation & Code Style

* skip OCRConverter and test converter.run

* Update Documentation & Code Style

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Julian Risch <julian.risch@deepset.ai>

2022-05-04 17:01:45 +02:00

..

benchmarks

ElasticsearchRetriever to BM25Retriever (#2423)

2022-04-26 16:09:39 +02:00

samples

ElasticsearchRetriever to BM25Retriever (#2423)

2022-04-26 16:09:39 +02:00

__init__.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

conftest.py

Renaming the ElasticsearchFilterOnlyRetriever to FilterRetriever (#2461)

2022-04-29 10:16:02 +02:00

test_connector.py

Change return types of indexing pipeline nodes (#2342)

2022-03-29 13:53:35 +02:00

test_distillation.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_document_classifier.py

fix pip backtracking issue (#2281)

2022-03-07 19:25:33 +01:00

test_document_store.py

Add flag to disable scaling scores to probabilities (#2454)

2022-05-02 13:35:07 +02:00

test_eval.py

Fix and use delete_index instead of delete_documents in tests (#2453)

2022-04-26 19:06:30 +02:00

test_extractor.py

ElasticsearchRetriever to BM25Retriever (#2423)

2022-04-26 16:09:39 +02:00

test_faiss_and_milvus.py

Add flag to disable scaling scores to probabilities (#2454)

2022-05-02 13:35:07 +02:00

test_file_converter.py

Change default encoding for PDFToTextConverter from Latin 1 to UTF-8 (#2420)

2022-05-04 17:01:45 +02:00

test_filetype_classifier.py

Make python-magic fully optional (#2412)

2022-04-20 09:18:02 +02:00

test_generator.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_knowledge_graph.py

Apply black formatting (#2115)

2022-02-03 13:43:18 +01:00

test_modeling_dpr.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_modeling_inference.py

fix pip backtracking issue (#2281)

2022-03-07 19:25:33 +01:00

test_modeling_prediction_head.py

Apply black formatting (#2115)

2022-02-03 13:43:18 +01:00

test_modeling_processor_saving_loading.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_modeling_processor.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_modeling_question_answering.py

Match answer sorting in QuestionAnsweringHead with FARMReader (#2414)

2022-04-21 11:24:39 +02:00

test_pipeline_debug_and_validation.py

ElasticsearchRetriever to BM25Retriever (#2423)

2022-04-26 16:09:39 +02:00

test_pipeline_extractive_qa.py

fix pip backtracking issue (#2281)

2022-03-07 19:25:33 +01:00

test_pipeline_yaml.py

Change YAML version exception into a warning (#2385)

2022-04-19 16:08:08 +02:00

test_pipeline.py

Add support for positional args in pipeline.get_config() (#2478)

2022-05-02 14:41:07 +02:00

test_preprocessor.py

Change return types of indexing pipeline nodes (#2342)

2022-03-29 13:53:35 +02:00

test_question_generator.py

Apply black formatting (#2115)

2022-02-03 13:43:18 +01:00

test_ranker.py

Fix bug ranker: wrong lambda function (#1824)

2021-12-06 17:13:57 +01:00

test_ray.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_reader.py

Match answer sorting in QuestionAnsweringHead with FARMReader (#2414)

2022-04-21 11:24:39 +02:00

test_retriever.py

Renaming the ElasticsearchFilterOnlyRetriever to FilterRetriever (#2461)

2022-04-29 10:16:02 +02:00

test_schema.py

Allow different filters per query in pipeline evaluation (#2068)

2022-02-03 19:19:05 +01:00

test_standard_pipelines.py

ElasticsearchRetriever to BM25Retriever (#2423)

2022-04-26 16:09:39 +02:00

test_summarizer_translation.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_summarizer.py

fix pip backtracking issue (#2281)

2022-03-07 19:25:33 +01:00

test_table_reader.py

Fix TableReader for tables without rows (#2369)

2022-03-30 17:02:39 +02:00

test_telemetry.py

Add basic telemetry features (#2314)

2022-03-21 11:58:51 +01:00

test_tokenization.py

Pipeline's YAML: syntax validation (#2226)

2022-03-15 11:17:26 +01:00

test_translator.py

Refactoring of the haystack package (#1624)

2021-10-25 15:50:23 +02:00

test_utils.py

Change return types of indexing pipeline nodes (#2342)

2022-03-29 13:53:35 +02:00

test_weaviate.py

Fix and use delete_index instead of delete_documents in tests (#2453)

2022-04-26 19:06:30 +02:00