413 Commits

Author SHA1 Message Date
Tamas Nemeth
7e5610f358
feat(ingest/dagster): Dagster source (#10071)
Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-03-25 13:28:35 +01:00
Mayuri Nehate
d3b0450e09
feat(ci): exempt more names from community (#10039) 2024-03-14 20:34:51 -07:00
Hyejin Yoon
729090bf02
docs: add missing api sample docs (#9869)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-13 12:28:01 -07:00
Harshal Sheth
7de517c363
fix(ci): refactor build-and-test command (#9999) 2024-03-06 13:43:05 -06:00
Harshal Sheth
6d3f087302
feat(docs): disable last update timestamps (#9987) 2024-03-05 16:28:03 -08:00
Harshal Sheth
55bc955304
feat(ci): skip smoke-test lint if there are no changes (#9945) 2024-02-28 09:49:58 -08:00
RyanHolstien
aa5ba5bc23
fix(pr): make prs only pull changes from pr branch instead of head merge (#9937) 2024-02-27 14:22:40 -06:00
Harshal Sheth
02f41b74b6
feat(ingest): use uv for python package installs (#9885) 2024-02-26 15:02:47 -08:00
Aseem Bansal
93acb82b4c
feat(ci): exempt more names from being marked as community (#9918) 2024-02-26 11:25:33 -08:00
david-leifker
fbc291c645
build(workflow): test enable workflow for docs change (#9901) 2024-02-21 15:19:41 -08:00
Aseem Bansal
fd34e41614
feat(ci): check for packages, change location of lint (#9759) 2024-02-03 13:57:13 +05:30
Aseem Bansal
3f9490d901
feat(cli): option to init via username password, add lint for smoke-test (#9675)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-31 14:42:40 +05:30
Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 (#9731) 2024-01-29 10:50:47 -08:00
Harshal Sheth
5adb799f13
fix(cli): fix example data contract yaml + update airflow codecov (#9707) 2024-01-26 23:02:52 +01:00
david-leifker
d292b35f23
test(spark-lineage): minor tweaks (#9717) 2024-01-25 12:41:51 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage (#9697) 2024-01-23 17:49:23 -06:00
david-leifker
ad65c36ddc
fix(workflow): workflow tweaks (#9678) 2024-01-21 15:39:31 -05:00
david-leifker
087d3fdb0d
feat(build): conditional ci (#9673) 2024-01-19 23:27:44 -06:00
Harshal Sheth
14dee5723d
feat(ingest/airflow): support airflow 2.8 dataset listeners (#9664) 2024-01-19 16:18:15 -08:00
Aseem Bansal
c3d3dbbeb6
fix(ci): fix label logic (#9571) 2024-01-05 13:59:45 +05:30
Harshal Sheth
031e6fbb6d
fix(ci): ignore binaries from test results upload (#9560) 2024-01-05 12:18:52 +05:30
david-leifker
8f45d3d0cb
build(spark-smoke): dump container logs for spark smoke test (#9565) 2024-01-04 14:38:32 -06:00
Aseem Bansal
17049088b9
ci(label): datahub-community-champion label based off usernames (#9558)
Co-authored-by: socar-dini <0327jane@gmail.com>
2024-01-04 11:29:56 +09:00
Harshal Sheth
4240578627
feat(ui): switch to vite and vitest (#9451) 2024-01-03 17:16:16 -05:00
Aseem Bansal
c3c4bef1ad
ci(doc): tweak build rule to avoid docker build for docs (#9555) 2024-01-03 12:29:39 -05:00
Harshal Sheth
9f79f44dd6
build: enable gradle caching (#9525) 2023-12-27 20:05:17 -05:00
noggi
c8e59aabed
Do not sync demo in downstream repos (#9493) 2023-12-20 12:33:23 -08:00
Harshal Sheth
ecda3e6187
feat(ingest): pydantic v2 compatibility (#9434) 2023-12-18 18:26:33 -05:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
Aseem Bansal
3c0727e9b7
feat(ci): split no cypress test suite (#9387) 2023-12-06 15:07:50 +05:30
noggi
f8db90926e
Upload metadata model to s3 (#9325) 2023-11-29 09:26:14 -08:00
david-leifker
38adff8693
fix(gha): fix gha for single tag (#9283) 2023-11-21 15:14:52 -06:00
noggi
b7df9e0996
Sync datahub-head on merge (#9267) 2023-11-17 16:53:19 -08:00
Harshal Sheth
0e3efabd2c
fix(build): set @cliMajorVersion@ correctly (#9228) 2023-11-10 16:00:20 -08:00
Harshal Sheth
4a4c29030c
chore: stop ingestion-smoke CI errors on forks (#9160) 2023-11-06 12:47:24 -08:00
Aseem Bansal
f5c8192cca
ci: tweak to only run relevant workflows (#9052) 2023-10-30 18:32:51 +05:30
david-leifker
3f4ab44a91
feat(kafka): increase kafka message size and enable compression (#9038)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-10-29 16:26:05 -05:00
Shirshanka Das
c9309ff157
feat(ci): enable ci to run on PR-s targeting all branches (#8933) 2023-10-05 09:07:12 -07:00
Aseem Bansal
2bc685d3b9
ci: tweak ci to decrease wait time of devs (#8945) 2023-10-05 09:31:32 +05:30
Harshal Sheth
a300b39f15
feat(ingest/airflow): airflow plugin v2 (#8853) 2023-10-04 16:23:15 +05:30
Harshal Sheth
9deb7be3fc
fix(ingest): refactor test markers + fix disk space issues in CI (#8938) 2023-10-03 20:17:49 -07:00
david-leifker
b45b7f7d2a
fix(docker): slim tags (#8922) 2023-09-29 17:49:36 -05:00
david-leifker
d33a85314d
fix(docker): move base image to -base tag, full image to head (#8919)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-09-28 21:21:04 -05:00
Harshal Sheth
ed1d35c79b
fix(build): run codegen when building datahub-ingestion image (#8869) 2023-09-25 23:10:49 -05:00
Aseem Bansal
ec714fc1e5
feat(ci): disable ingestion smoke build (#8845) 2023-09-15 20:04:11 +05:30
Harshal Sheth
5a0ce38bc6
docs: add 0.11 docs to docs site (#8813)
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-09-11 13:29:31 -07:00
david-leifker
486bd861d2
test(managed_ingestion): fix managed ingestion test by fixing actions… (#8820) 2023-09-11 14:20:21 -05:00
Harshal Sheth
6c55eb8e6d
ci: upgrade python to 3.10 for builds (#8808)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-09-08 16:30:08 -07:00
david-leifker
68ae3bfc26
fix(spark-test): upgrade gradle and fix spark smoke test (#8777) 2023-09-07 20:17:50 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30