Pere Miquel Brull
375e001dd9
MINOR - Fix S3 logging from ingestion pipelines ( #23590 )
...
* MINOR - Fix S3 logging from ingestion pipelines
* Update generated TypeScript types
* config
* update s3 configurations for streamable logs
* Update generated TypeScript types
* update s3 configurations for streamable logs
* update s3 configurations for streamable logs
* update s3 configurations for streamable logs
* SSE off by default
* Update log retrieval to use s3 if ingestion runner has streamable logs enabled
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pablo Takara <pjt1991@gmail.com>
2025-10-01 09:44:17 +02:00
Pere Miquel Brull
d901dd2948
FIX #16284 - Toggle if we want to raise workflow errors ( #20969 )
...
* FIX #16284 - Toggle if we want to raise workflow errors
* schema
* schema
* move prop
* fix
* move prop
* improve error handling
* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Add the `Raise on Error` option to the ingestion schedule step
* Revert "Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/IngestionPipelineRepository.java"
This reverts commit 985b73513a59695c6bb39ad41c2d273bbf4e5d22.
* Update the tests
* Fix sonar issue
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-04-29 08:19:13 +02:00
Mayur Singal
7760663b22
MINOR: Change ingestion licence header ( #20549 )
2025-04-03 10:39:47 +05:30
Imri Paran
97fad806a2
Fixes 19755: Publish app config with status ( #19754 )
...
* feat(app): add config to status
add config to the reported status of the ingestion pipeline
* added separate pipeline service client call for external apps
* fix masking of pydantic model
* - overload model_dump to mask secrets instead of a separate method
- moved tests to test_custom_pydantic.py
* fix: execution time
* fix: mask secrets in dump json
* fix: for python3.8
* fix: for python3.8
* fix: use mask_secrets=False when dumping a model for create
* format
* fix: update mask_secrets=False for workflow configurations
* fix: use context directly when using model_dump_json
* fix: default behavior when dumping json
* format
* fixed tests
2025-02-25 16:51:49 +00:00
Pere Miquel Brull
c68a45e7d8
Create new Auto Classification Workflow ( #18610 )
2024-11-19 08:10:45 +01:00
