Dayenne Souza b94290ec2b

add option to add metadata into text chunks (#1681) ...

* add new options

* add metadata json into input document

* remove doc change

* add metadata column into text loader

* prepend_metadata

* run fix

* fix tests and patch

* fix test

* add watrning for metadata tokens > config size

* fix typo and run fix

* fix test_integration

* fix test

* run check

* rename and fix chunking

* fix

* fix

* fiz test verbs

* fix

* fix tests

* fix chunking

* fix index

* fix cosmos test

* fix vars

* fix after PR

* fix

2025-02-12 09:38:03 -08:00

..

__init__.py

Ci streamline (#988)

2024-08-21 15:16:15 -06:00

test_blob_pipeline_storage.py

add option to add metadata into text chunks (#1681)

2025-02-12 09:38:03 -08:00

test_cosmosdb_storage.py

add option to add metadata into text chunks (#1681)

2025-02-12 09:38:03 -08:00

test_factory.py

Refactor config (#1593)

2025-01-21 17:52:06 -06:00

test_file_pipeline_storage.py

add option to add metadata into text chunks (#1681)

2025-02-12 09:38:03 -08:00