David S. Batista 6c7ae8f658
feat: pipeline checkpoints crash allow to resume from snapshot (#9743)
* initial PoC idea running

* removing test code

* cleaning up

* wip

* cleaning up demos

* adding more pipelines to test persistence saving

* wip

* wip

* working example for logging components inputs in run time

* reverting to a simpler solution for intermediate results

* cleaning up

* testing that in a crash components outputs/inputs up to the crash point are returned

* adding tests for state persistance in a RAG pipeline

* updataing tests for state persistance in a RAG pipeline

* removing use cases of agent tests

* adding LICENSE header

* adding LICENSE header

* adding release notes

* updating tests for mocked components only

* updating release notes

* adapting PipelineRuntimeError

* cleaning up tests

* fixing test pipeline crash components inputs/outputs are saved

* fixing tests for state persistance

* removing code

* removing code

* removing code

* updating release notes

* validating parameters

* cleaning

* wip: debugging

* removing persistance tests

* formatting

* formatting

* cleaning up code

* updating release notes

* adding missing docstrings

* typo in release notes

* Update haystack/core/pipeline/pipeline.py

Co-authored-by: Sebastian Husch Lee <10526848+sjrl@users.noreply.github.com>

* PR comments

* handling potential issues with saving the snapshot file

* updating tests

* Update haystack/core/pipeline/pipeline.py

Co-authored-by: Sebastian Husch Lee <10526848+sjrl@users.noreply.github.com>

* Update haystack/core/pipeline/pipeline.py

Co-authored-by: Sebastian Husch Lee <10526848+sjrl@users.noreply.github.com>

* some more improvements

* fixing exxception

* fixing exception error name conflict

---------

Co-authored-by: Sebastian Husch Lee <10526848+sjrl@users.noreply.github.com>
2025-09-01 11:22:37 +02:00
..