bogdankostic 4fbe80c098

feat: Extraction of headlines in markdown files (#3445) ...

* Extract headings from markdown files + adapt PreProcessor

* Add tests

* Fix mypy

* Generate JSON schema

* Apply suggestions from code review

Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>

* Update haystack/nodes/file_converter/markdown.py

Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>

* Apply black

* Add PR feedback

Co-authored-by: Agnieszka Marzec <97166305+agnieszka-m@users.noreply.github.com>

2022-10-26 11:57:55 +02:00

..

audio

AnswerToSpeech (#2584)

2022-06-15 10:13:18 +02:00

crawler

Fix crawler long file names (#2723)

2022-07-11 12:16:32 +02:00

dc

refactor: rename master into main in documentation and links (#3063)

2022-08-24 19:05:12 +02:00

docs

add test

2019-11-27 17:53:42 +01:00

docx

Add basic support for Docx Files (#225)

2020-07-14 12:28:19 +02:00

dpr

Fix DPR tests + add Tokenizer tests (#1429)

2021-09-09 12:56:44 +02:00

embeddings

[CI Refactoring] Refactor Document fixtures in tests (#2577)

2022-06-10 18:22:48 +02:00

extensionless_files

extract extension based on file's content (#2330)

2022-04-11 09:16:30 +02:00

glove

Add TinyBERT data augmentation (#1923)

2022-01-04 18:34:16 +01:00

images

feat: MultiModalRetriever (#2891)

2022-10-17 18:58:35 +02:00

markdown

feat: Extraction of headlines in markdown files (#3445)

2022-10-26 11:57:55 +02:00

mmr

Add TableTextRetriever (#1529)

2021-10-25 12:27:02 +02:00

pdf

feat: add public layout-base extraction support on PDFToTextConverter (#3137)

2022-09-13 16:55:21 +02:00

pipeline

Refactoring the Raypipeline.run method - merging it with the Pipeline.run (#2981)

2022-08-11 09:50:14 +02:00

preprocessor/nltk_models

Add support for custom trained PunktTokenizer in PreProcessor (#2783)

2022-07-21 09:50:45 +02:00

qa

Add testdata, add tests for qa processor, add dpr tests (some failing)

2021-09-08 12:02:08 +02:00

squad

Simplify language_modeling.py and tokenization.py (#2703)

2022-07-22 16:29:30 +02:00