11981 Commits

Author SHA1 Message Date
Jonny Dixon
58d8a802f8 better capture of microbatchexecution and logs 2025-06-03 10:03:48 +01:00
Jonny Dixon
75086ada94 linting 2025-06-03 01:04:02 +01:00
Jonny Dixon
954e369ad7 job lineage 2025-06-02 00:28:55 +01:00
Jonny Dixon
eca5a35613 streaming improvements - adding correlator for inputs and outputs 2025-06-01 22:13:32 +01:00
Jonny Dixon
f59afd7154 streaming improvements - adding correlator for inputs and outputs 2025-06-01 22:12:20 +01:00
Jonny Dixon
2a9b7479c2 spark streaming with passed config 2025-05-31 23:35:58 +01:00
Jonny Dixon
7a4ef72a34
Merge branch 'master' into split-spark-merges-on-tables 2025-05-29 20:50:36 +01:00
Jonny Dixon
cfc05747aa
Openlineage 1 31 0 upgrade - Tamas' changes (#13658)
Co-authored-by: treff7es <treff7es@gmail.com>
2025-05-29 20:50:11 +01:00
Chakru
906eba2b3e
ci(coverage): run coverage without ci-optimization on release and schedule (#13579) 2025-05-30 01:11:24 +05:30
purnimagarg1
528d705544
feat(ingestions): redesign ingestion table and page (#13585) 2025-05-29 12:27:44 -04:00
Pedro Silva
14fc4f0343
fix(docs): Correct Access Policy references to GraphQL endpoints (#13645) 2025-05-29 15:35:35 +01:00
Hyejin Yoon
a142a9e2d2
feat(sdk): add dataflow and datajob entity (#13551) 2025-05-29 22:53:56 +09:00
purnimagarg1
f335093607
improvement(ui): bring compact markdown viewer changes to OSS (#13593) 2025-05-29 09:47:39 -04:00
Pedro Silva
7b21a5cea3
feat(docs): Publish docs for 1.1.0 release (#13647) 2025-05-29 11:51:12 +01:00
Aseem Bansal
4976656df8
fix(policies): more assertions, add missing policy for editor role (#13644) 2025-05-29 15:44:54 +05:30
david-leifker
7cb26edb5b
feat(docker-compose): add localstack to compose profiles (#13650) 2025-05-28 15:11:27 -05:00
david-leifker
8787892cbb
config(): disable service name in header (#13638) 2025-05-28 15:11:08 -05:00
Sergio Gómez Villamor
fea6e6ac4f
fix(snowflake): pass correct BaseTimeWindowConfig instead of SnowflakeV2Config (#13643)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 13:08:43 +02:00
Sergio Gómez Villamor
f2ca93d275
feat(openapi): add verify_ssl configuration option (#13634)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-28 09:35:45 +02:00
david-leifker
492b55322f
feat(tracing): trace error log with timestamp & update system-metadata (#13628) 2025-05-27 17:33:40 -05:00
joseph-sentry
747e42497e
build: add codecov bundle analysis (#13087) 2025-05-27 12:21:04 -07:00
Chakru
3de438692d
build: support tag computation from branch with slash in name (#13636) 2025-05-27 22:00:11 +05:30
Andrew R Smith
647fb792de
feat(ingest): add snowflake ingestion config options (#12841)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-05-27 09:22:16 -07:00
Esteban Gutierrez
ec9719c801
ci(smoke-tests): run tests on push to release branches (#13629) (addendum) (#13635) 2025-05-27 10:04:25 -05:00
Sergio Gómez Villamor
d8d1de431f
fix(iceberg): update MinIO client commands for compatibility (#13631)
Co-authored-by: Claude <noreply@anthropic.com>
2025-05-27 11:15:41 +02:00
Aseem Bansal
2b2f6e7d82
fix(test): url encode urn (#13626) 2025-05-27 12:00:13 +05:30
Chakru
79ff05abcd
ci(smoke-tests): run tests on push to release branches (#13629) 2025-05-27 00:32:06 +05:30
david-leifker
650cff172d
fix(generic-patch): fix mixed attributed/non-attributed patches (#13618) 2025-05-26 12:28:44 -05:00
David Leifker
b956132e3c Revert "feat(tracing): python logging & update system metadata on no-op"
This reverts commit 64f315eb64417467cfef5cec473068dc42886293.
2025-05-26 12:15:18 -05:00
David Leifker
64f315eb64 feat(tracing): python logging & update system metadata on no-op 2025-05-26 10:22:51 -05:00
Tamas Nemeth
2ffa84be5c
fix(ingest/datahub): Create Structured property templates in advance and batch processing (#13355)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2025-05-26 14:05:17 +02:00
david-leifker
4c6672213c
config(gradle): pin jackson via bom (#13617) 2025-05-24 13:42:10 -05:00
Esteban Gutierrez
09facfdfc5
feat(docs): Add section on updating DataHub for 1.1.0 (#13561) 2025-05-23 20:15:58 -05:00
Jonny Dixon
2cee79fd4d docs prettier 2025-05-23 20:57:41 +01:00
Jonny Dixon
0446c68e3e add backstop 2025-05-23 20:51:43 +01:00
Jonny Dixon
98cb074bb5
Merge branch 'master' into split-spark-merges-on-tables 2025-05-23 20:45:13 +01:00
Jonny Dixon
22a5486a6a Merge branches 'split-spark-merges-on-tables' and 'split-spark-merges-on-tables' of https://github.com/datahub-project/datahub into split-spark-merges-on-tables 2025-05-23 20:44:40 +01:00
Jonny Dixon
da44176cfe fixes for spark streaming NPE for generating flow_urns 2025-05-23 20:44:33 +01:00
Pedro Silva
da3f82ea58
feat(docs): Add docs for 0.3.11.1 Cloud Release (#13604) 2025-05-23 20:30:54 +01:00
david-leifker
62ab7d817f
fix(config-servlet): fix config endpoint to be thread-safe (#13616) 2025-05-23 13:39:43 -05:00
Harshal Sheth
e1de763c17
docs: add note on column transformation logic (#13615) 2025-05-23 10:07:45 -07:00
Aseem Bansal
947761f875
doc(assertion): change to millis in example (#13610) 2025-05-23 21:19:30 +05:30
Jay
76a9fc0d7f
fix(web) set domain dropdown ui to match domains page (#13294) 2025-05-23 11:14:44 -04:00
Jonny Dixon
5205ec2a21
Merge branch 'master' into split-spark-merges-on-tables 2025-05-23 13:08:39 +01:00
Jonny Dixon
75f12621c9 standardized job name 2025-05-23 13:08:10 +01:00
Sergio Gómez Villamor
7bd7a33d0b
feat(hex): consider additional context when parsing hex query metadata (#13596) 2025-05-23 08:01:04 +02:00
Harshal Sheth
69f368b00e
fix(ingest): restrict duckdb dep on old python versions (#13605) 2025-05-22 16:19:31 -07:00
david-leifker
d234f5580a
fix(config): fix mcp batch configuration (#13598) 2025-05-22 15:54:48 -05:00
Jonny Dixon
99e9f22998
Merge branch 'master' into split-spark-merges-on-tables 2025-05-22 21:31:38 +01:00
Jonny Dixon
c548d9f465 add parameter and docs 2025-05-22 21:31:17 +01:00