mathislucka
e5b9bdeb66
feat: AsyncPipeline that can schedule components to run concurrently ( #8812 ) ...
* add component checks
* pipeline should run deterministically
* add FIFOQueue
* add agent tests
* add order dependent tests
* run new tests
* remove code that is not needed
* test: intermediate from cycle outputs are available outside cycle
* add tests for component checks (Claude)
* adapt tests for component checks (o1 review)
* chore: format
* remove tests that aren't needed anymore
* add _calculate_priority tests
* revert accidental change in pyproject.toml
* test format conversion
* adapt to naming convention
* chore: proper docstrings and type hints for PQ
* format
* add more unit tests
* rm unneeded comments
* test input consumption
* lint
* fix: docstrings
* lint
* format
* format
* fix license header
* fix license header
* add component run tests
* fix: pass correct input format to tracing
* fix types
* format
* format
* types
* add defaults from Socket instead of signature
- otherwise components with dynamic inputs would fail
* fix test names
* still wait for optional inputs on greedy variadic sockets
- mirrors previous behavior
* fix format
* wip: warn for ambiguous running order
* wip: alternative warning
* fix license header
* make code more readable
Co-authored-by: Amna Mubashar <amnahkhan.ak@gmail.com>
* Introduce content tracing to a behavioral test
* Fixing linting
* Remove debug print statements
* Fix tracer tests
* remove print
* test: test for component inputs
* test: remove testing for run order
* chore: update component checks from experimental
* chore: update pipeline and base from experimental
* refactor: remove unused method
* refactor: remove unused method
* refactor: outdated comment
* refactor: inputs state is updated as side effect
- to prepare for AsyncPipeline implementation
* format
* test: add file conversion test
* format
* fix: original implementation deepcopies outputs
* lint
* fix: from_dict was updated
* fix: format
* fix: test
* test: add test for thread safety
* remove unused imports
* format
* test: FIFOPriorityQueue
* chore: add release note
* feat: add AsyncPipeline
* chore: Add release notes
* fix: format
* debug: switch run order to debug ubuntu and windows tests
* fix: consider priorities of other components while waiting for DEFER
* refactor: simplify code
* fix: resolve merge conflict with mermaid changes
* fix: format
* fix: remove unused import
* refactor: rename to avoid accidental conflicts
* fix: track pipeline type
* fix: and extend test
* fix: format
* style: sort alphabetically
* Update test/core/pipeline/features/conftest.py
Co-authored-by: Amna Mubashar <amnahkhan.ak@gmail.com>
* Update test/core/pipeline/features/conftest.py
Co-authored-by: Amna Mubashar <amnahkhan.ak@gmail.com>
* Update releasenotes/notes/feat-async-pipeline-338856a142e1318c.yaml
* fix: indentation, do not close loop
* fix: use asyncio.run
* fix: format
---------
Co-authored-by: Amna Mubashar <amnahkhan.ak@gmail.com>
Co-authored-by: David S. Batista <dsbatista@gmail.com>
2025-02-07 16:37:29 +01:00
2024-09-02 18:06:38 +02:00
2024-06-20 13:44:23 +02:00
2024-09-10 10:29:56 +00:00
2024-05-30 15:34:52 +02:00
2024-05-23 19:04:55 +02:00
2025-01-13 11:15:33 +01:00
2024-09-06 10:59:12 +02:00
2024-09-11 08:56:59 -05:00
2024-07-04 10:08:12 +02:00
2024-11-14 16:19:49 +01:00
2025-01-12 17:41:38 +01:00
2024-07-08 10:18:39 +00:00
2024-04-02 14:04:16 +02:00
2024-07-03 13:55:17 +02:00
2024-03-11 13:14:59 +01:00
2024-06-12 11:58:36 +02:00
2025-02-05 16:09:35 +00:00
2025-01-09 09:03:19 +01:00
2024-05-23 15:41:29 +00:00
2024-02-08 08:48:46 +01:00
2024-07-08 14:07:15 +02:00
2024-02-06 16:55:06 +01:00
2024-05-15 19:33:57 +00:00
2024-06-17 18:08:52 +02:00
2024-05-16 19:18:48 +02:00
2025-02-05 23:19:14 +01:00
2024-11-04 09:26:57 +01:00
2024-02-20 19:55:41 +01:00
2024-11-22 14:58:45 +00:00
2024-11-12 16:01:53 +01:00
2024-08-21 11:29:23 +02:00
2024-12-09 14:51:14 +00:00
2024-08-02 10:37:10 +02:00
2024-02-20 13:58:48 +01:00
2024-02-13 13:03:50 +01:00
2024-05-02 14:48:27 +02:00
2024-04-29 12:51:18 +02:00
2024-06-04 17:51:16 +02:00
2024-03-01 11:55:44 +01:00
2024-06-07 09:43:29 +00:00
2024-06-10 14:54:07 +02:00
2024-04-29 14:21:53 +02:00
2024-07-10 13:13:46 +00:00
2024-06-21 16:45:25 +02:00
2024-06-27 15:07:43 +02:00
2024-12-03 13:48:56 +05:00
2024-11-25 15:22:19 +05:00
2024-11-22 13:55:08 +01:00
2024-10-29 15:32:06 +01:00
2025-01-17 09:58:45 +01:00
2024-10-30 15:03:41 +00:00
2024-12-20 11:15:55 +01:00
2024-12-20 14:02:42 +01:00
2024-06-05 15:28:53 +02:00
2024-04-03 16:41:30 +02:00
2024-03-14 11:14:04 +01:00
2024-08-05 13:00:39 +02:00
2024-09-23 15:40:50 +02:00
2024-10-22 14:01:26 +00:00
2024-09-10 11:00:05 +02:00
2024-07-02 11:31:51 +02:00
2025-01-10 17:28:53 +01:00
2024-03-19 08:47:53 +01:00
2024-07-11 13:14:03 +02:00
2024-11-22 15:45:00 +01:00
2024-04-10 09:02:08 +02:00
2024-09-17 10:10:34 +00:00
2024-05-14 17:08:51 +02:00
2024-04-09 09:45:06 +02:00
2024-05-23 16:28:24 +02:00
2025-01-23 09:24:04 +00:00
2024-07-12 14:47:00 +00:00
2024-07-22 15:13:46 +02:00
2024-09-17 10:36:42 +02:00
2024-06-05 18:04:24 +02:00
2024-02-29 15:55:53 +01:00
2024-11-28 09:53:02 +00:00
2024-11-28 09:35:24 +00:00
2025-01-02 10:34:41 +00:00
2024-06-21 14:22:33 +02:00
2024-11-29 14:00:59 +00:00
2024-02-22 12:52:04 +01:00
2024-10-18 08:38:48 +00:00
2024-02-27 18:11:06 +01:00
2024-02-19 12:43:40 +01:00
2025-01-27 14:52:24 +01:00
2024-02-08 11:46:10 +01:00
2024-09-12 15:58:16 +02:00
2024-09-18 13:05:31 +02:00
2025-01-28 12:18:54 +01:00
2024-11-26 10:48:55 +01:00
2024-10-29 18:06:54 +01:00
2024-02-23 11:52:54 +01:00
2024-04-22 14:10:00 +02:00
2024-12-06 10:28:41 +01:00
2025-01-10 12:15:15 +01:00
2025-02-06 17:56:38 +01:00
2025-02-03 15:55:29 +01:00
2024-02-23 09:18:32 +01:00
2024-02-14 17:11:08 +01:00
2024-09-12 11:00:12 +02:00
2024-08-16 10:34:44 +02:00
2025-01-31 15:03:15 +01:00
2024-09-13 10:03:29 +02:00
2024-07-26 10:00:59 +02:00
2024-09-25 11:28:30 +02:00
2024-07-09 16:18:38 +02:00
2024-08-02 16:47:17 +02:00
2024-07-25 09:58:57 +00:00
2024-09-25 09:29:31 +00:00
2024-08-13 13:49:41 +02:00
2024-08-29 09:31:59 +02:00
2024-12-12 15:16:54 +01:00
2025-01-10 14:46:41 +01:00
2024-08-14 13:29:27 +02:00
2024-04-04 17:04:59 +02:00
2024-04-04 17:04:59 +02:00
2024-10-01 16:15:02 +02:00
2024-05-27 14:48:38 +02:00
2024-08-21 09:48:02 +00:00
2024-08-21 12:37:43 +02:00
2025-01-24 11:06:09 +00:00
2025-02-05 14:43:19 +01:00
2024-08-22 12:24:32 +00:00
2024-06-27 08:19:01 +02:00
2024-03-27 15:34:50 +01:00
2024-10-22 17:08:36 +02:00
2024-10-29 16:20:27 +01:00
2024-05-03 12:10:15 +00:00
2024-10-18 15:42:19 +02:00
2024-02-09 14:44:24 +01:00
2024-02-09 14:44:34 +01:00
2024-04-05 16:02:34 +02:00
2024-05-13 19:44:02 +02:00
2024-04-12 06:59:16 +00:00
2024-05-23 16:03:39 +02:00
2024-04-04 16:33:59 +00:00
2025-02-07 16:37:29 +01:00
2024-09-12 16:38:37 +02:00
2024-11-14 16:09:01 +01:00
2024-05-17 16:06:03 +02:00
2024-03-11 14:58:08 +01:00
2024-10-16 12:38:49 +02:00
2024-06-18 12:37:16 +02:00
2024-05-15 10:00:38 +02:00
2024-07-04 14:42:30 +02:00
2025-01-07 19:00:52 +01:00
2024-06-21 12:31:29 +02:00
2025-02-03 12:35:37 +01:00
2024-08-06 14:48:04 +02:00
2024-06-20 13:20:52 +02:00
2024-09-25 10:06:30 +02:00
2025-01-24 11:17:47 +01:00
2024-03-01 10:56:47 +01:00
2024-06-06 13:19:07 +00:00
2025-02-04 14:51:06 +01:00
2024-05-14 08:36:14 +02:00
2024-12-06 17:13:30 +01:00
2024-11-25 13:08:59 +01:00
2024-08-07 14:50:14 +02:00
2024-11-14 11:41:28 +00:00
2024-07-24 15:15:36 +02:00
2024-03-27 17:31:05 +01:00
2024-05-23 16:03:26 +02:00
2024-07-12 15:30:10 +00:00
2024-05-08 17:14:37 +02:00
2025-01-23 11:40:19 +00:00
2024-06-25 12:07:11 +02:00
2024-07-26 14:02:09 +00:00
2025-01-28 10:29:55 +01:00
2024-07-09 15:28:49 +02:00
2024-06-19 13:47:38 +02:00
2024-04-12 14:07:18 +00:00
2024-10-15 14:11:14 +02:00
2024-03-05 12:13:56 +01:00
2024-03-11 12:52:55 +01:00
2024-05-24 16:41:29 +02:00
2024-11-14 13:00:28 +01:00
2024-02-15 17:35:28 +01:00
2024-11-20 10:27:22 +01:00
2024-08-08 14:02:40 +02:00
2024-05-27 21:04:40 +02:00
2024-09-10 15:23:45 +02:00
2024-07-17 10:28:29 +02:00
2025-02-06 14:19:47 +00:00
2024-03-26 16:55:31 +01:00
2024-04-11 16:39:38 +02:00
2024-06-21 11:10:34 +02:00
2024-07-30 15:00:12 +02:00
2024-09-03 10:57:11 +02:00
2024-05-08 16:00:49 +02:00
2024-06-26 11:07:00 +02:00
2024-07-26 20:13:47 +02:00
2024-11-25 14:21:08 +01:00
2024-09-10 14:59:53 +02:00
2025-01-17 13:01:16 +00:00
2024-06-27 10:31:58 +02:00
2024-05-14 10:22:38 +00:00
2025-02-03 15:11:16 +00:00
2024-07-10 12:18:05 +02:00
2024-03-07 16:23:57 +01:00
2024-12-19 15:04:37 +01:00
2024-04-05 18:48:34 +02:00
2024-04-08 15:06:26 +02:00
2024-10-30 11:51:07 +01:00
2024-04-05 18:48:13 +02:00
2024-04-08 14:22:54 +02:00
2024-12-19 15:12:12 +01:00
2024-03-21 15:49:18 +01:00
2024-08-09 12:04:24 +02:00
2024-04-25 12:16:48 +02:00
2025-01-08 11:28:00 +01:00
2024-06-25 16:59:37 +02:00
2024-04-29 17:29:27 +02:00
2024-07-24 15:49:19 +02:00
2024-05-15 14:25:19 +02:00
2024-05-31 16:44:14 +02:00
2024-02-29 14:31:20 +01:00
2024-08-01 12:51:17 +02:00
2024-02-15 14:07:01 +01:00
2024-09-25 12:34:51 +02:00
2025-01-21 10:07:56 +01:00
2024-02-28 09:45:50 +01:00
2024-06-27 11:45:20 +02:00
2024-06-07 12:49:23 +02:00
2024-03-25 07:05:27 +01:00
2024-02-27 10:06:53 +01:00
2024-10-21 09:47:46 +02:00
2024-02-27 18:31:51 +01:00
2024-09-09 15:11:52 +02:00
2024-05-29 10:54:21 +02:00
2024-07-08 22:34:51 +02:00
2024-02-19 10:05:35 +01:00
2024-07-08 11:16:26 +02:00
2024-11-20 20:07:04 +01:00
2024-02-12 18:25:28 +01:00
2024-10-24 16:21:15 +02:00
2024-02-13 13:08:35 +01:00
2024-06-12 10:42:02 +02:00
2024-12-20 10:41:44 +01:00
2024-05-14 12:24:55 +02:00
2024-12-20 15:33:27 +01:00
2024-09-17 13:59:19 +02:00
2024-12-20 14:20:54 +00:00
2024-10-31 16:56:17 +01:00
2024-02-09 16:03:27 +01:00
2024-02-22 14:03:50 +01:00
2024-02-22 14:30:58 +01:00
2024-11-15 10:52:44 +01:00
2025-01-13 10:12:06 +00:00
2024-06-17 10:54:02 +02:00
2024-12-12 16:26:38 +01:00
2024-07-19 10:39:10 +02:00
2024-02-28 16:43:08 +01:00
2024-10-22 08:35:30 +00:00
2024-03-21 12:55:06 +01:00
2024-02-26 09:25:07 +01:00
2024-04-10 17:47:14 +02:00
2024-05-10 11:35:15 +02:00
2024-04-10 17:16:00 +02:00
2024-04-24 12:27:18 +02:00
2024-05-14 12:29:41 +02:00
2024-10-29 15:43:16 +01:00
2024-02-16 17:07:52 +01:00
2024-07-24 15:03:01 +02:00
2024-02-07 16:03:17 +01:00
2024-11-22 16:27:50 +01:00
2024-11-26 16:37:59 +01:00
2024-11-26 14:47:04 +01:00
2025-01-09 19:12:10 +00:00
2024-03-26 10:09:29 +01:00
2024-06-21 16:52:03 +02:00
2024-10-01 16:35:38 +02:00
2024-10-08 14:35:43 +02:00
2024-08-02 14:46:20 +02:00
2024-09-11 12:47:29 +02:00
2024-05-23 09:35:10 +02:00
2024-03-26 16:15:03 +01:00
2024-09-30 17:17:56 +02:00
2024-07-12 11:29:44 +02:00
2024-07-26 10:39:48 +02:00
2024-08-09 11:38:47 +02:00
2024-09-30 17:11:49 +02:00
2024-11-26 10:44:50 +00:00
2024-12-06 15:43:43 +01:00
2024-07-16 15:39:40 +02:00
2024-09-30 15:58:05 +02:00
2024-08-27 11:27:38 +02:00
2024-10-29 16:42:48 +00:00
2024-08-28 10:04:52 +02:00
2024-02-26 16:06:26 +01:00
2024-07-24 13:16:47 +02:00
2024-09-12 16:28:31 +02:00
2024-03-05 12:45:53 +01:00
2024-09-30 15:52:36 +02:00
2025-01-15 16:11:51 +00:00
2024-07-26 17:46:44 +02:00
2025-01-08 14:58:52 +00:00
2024-07-08 22:35:25 +02:00
2024-06-04 17:51:16 +02:00
2024-06-21 10:36:12 +02:00
2024-06-21 11:15:13 +02:00
2025-01-15 18:55:22 +01:00
2024-08-08 11:54:31 +02:00
2024-03-01 17:39:13 +01:00
2024-02-14 16:16:22 +01:00
2024-04-04 10:10:41 +02:00
2024-10-14 17:43:04 +02:00
2024-02-19 14:52:44 +01:00
2024-10-14 16:08:53 +00:00
2024-12-03 17:41:19 +01:00
2024-12-04 16:55:56 +01:00
2024-08-27 10:30:12 +02:00
2024-06-14 17:52:32 +02:00
2024-05-22 13:14:39 +02:00
2024-04-23 19:03:41 +02:00
2024-05-09 15:11:43 +00:00
2024-03-19 18:04:16 +01:00
2024-11-18 11:54:30 +01:00
2024-02-14 16:48:03 +01:00
2025-01-23 12:14:32 +01:00
2024-06-18 12:37:16 +02:00
2024-02-27 09:15:01 +01:00
2024-07-05 08:21:53 +02:00
2024-02-15 16:10:38 +01:00
2024-03-21 09:28:21 +01:00
2024-12-18 21:34:57 +01:00
2024-07-09 09:56:46 +02:00
2024-12-18 11:36:44 +00:00
2025-01-09 12:30:13 +01:00
2024-10-29 17:39:41 +01:00
2024-05-17 10:38:47 +02:00
2024-07-09 13:32:44 +02:00
2024-12-12 14:22:27 +00:00
2024-10-28 12:15:17 +01:00
2024-09-02 14:14:54 +00:00
2025-02-07 14:29:53 +01:00
2024-09-06 11:37:56 +02:00
2024-04-03 10:48:50 +02:00
2024-03-05 13:04:53 +01:00
2024-08-27 15:51:03 +00:00
2024-06-20 18:15:01 +02:00
2024-12-10 16:03:38 +01:00
2025-01-20 09:51:47 +01:00
2024-03-19 07:53:26 +01:00
2024-10-17 10:32:14 +02:00
2024-05-03 10:14:54 +02:00
2024-03-26 16:10:06 +01:00
2024-11-28 10:16:07 +00:00
2024-08-14 10:56:32 +02:00
2025-01-03 15:06:58 +01:00
2024-02-16 11:25:53 +01:00
2024-03-15 13:56:07 +01:00
e5b9bdeb66