413 Commits

Author SHA1 Message Date
Mayuri Nehate
e867dbc3da
ci: separate airflow build and test (#8688)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-08-30 14:08:42 -07:00
Tamas Nemeth
d86b336e70
chore(ingest/s3) Bump Deequ and Pyspark version (#8638)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2023-08-29 18:11:37 +02:00
Harshal Sheth
d6e36f16de
ci: add needs_artifact_download output for ingestion image (#8695) 2023-08-22 21:27:02 -07:00
david-leifker
655914841b
fix(docker): misc docker fixes (#8677) 2023-08-22 10:38:08 +05:30
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images (#8515) 2023-08-17 10:40:17 +05:30
Harshal Sheth
a9bc5643f3
ci: reduce git fetch depth (#8473) 2023-08-01 19:34:11 +05:30
david-leifker
3640291493
config(ebean): add ebean retry configuration (#8500) 2023-07-28 14:09:44 -05:00
Pedro Silva
dd9613027b
feat(images): Add build processes for arm64v8 image variants (#7990)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 17:23:47 +01:00
Harshal Sheth
4ecb459f1e
ci: prevent qodana from using all of our cache (#8054) 2023-05-19 14:16:26 +05:30
david-leifker
429c54f3ad
fix(ci): fix spark lineage test (#7829) 2023-04-17 15:29:45 -07:00
RyanHolstien
97ac8d93f8
fix(ci): prevent republish of images on release edits (#7828) 2023-04-15 13:31:58 -07:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-13 12:01:51 -05:00
Harshal Sheth
dac540e691
ci: limit qodana concurrency to group (#7764)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-04-06 10:48:58 -07:00
Aseem Bansal
1324231e70
chore(ci): add coverage code for python (#7681) 2023-03-24 07:10:45 +00:00
Harshal Sheth
3b519924e8
fix(cli): protect against timeseries get_aspects (#7665) 2023-03-22 22:04:11 -07:00
Harshal Sheth
d9231addd2
feat(docs-website): add vercel preview environment (#7644) 2023-03-22 12:28:52 -07:00
Harshal Sheth
2722ad54d4
feat(cli): build and upload Python wheels in CI (#7537) 2023-03-22 21:31:32 +05:30
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
Shirshanka Das
3e39b955f6
fix(docker): fix image name for datahub-ingestion-slim (#7653) 2023-03-20 22:13:26 -07:00
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version (#7412) 2023-03-20 18:06:35 -05:00
Aseem Bansal
c43d7dd9d2
chore(ci): fix flakiness, misc improvements (#7605) 2023-03-17 09:34:00 +05:30
Aseem Bansal
2ef26e8b74
fix(policies): add missing policies, add check to prevent problems (#7586)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:55 +05:30
Aseem Bansal
b2ecd7f968
chore(ci): update dependencies, fix smoke image build (#7580) 2023-03-15 21:07:30 +05:30
Aseem Bansal
39f7f74329
chore(ci): add daylight savings timezone for tests, fix daylight saving bug in analytics charts (#7484) 2023-03-14 16:12:29 +05:30
Aseem Bansal
64b4d0bace
chore(ci): try Qodana Scan for quality (#7560) 2023-03-14 14:26:06 +05:30
Aseem Bansal
1adbc2cab0
chore(ci): upgrade GE version (#7290) 2023-03-02 10:47:38 -08:00
Aseem Bansal
324fc8ee9f
chore(ci): update base dependencies (#7390)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-21 16:07:51 -06:00
david-leifker
237933cc8d
build(scan): enable trivy scan ingestion-base (#7389) 2023-02-21 11:15:15 +05:30
Aseem Bansal
f79438ffe9
fix(ci): remove command from cache key as irrelevant for dependency (#7314) 2023-02-13 12:54:56 -08:00
Aseem Bansal
db2f4fb762
chore(ci): speed up ingestion test runs (#7296) 2023-02-10 14:34:35 +05:30
Aseem Bansal
d18dab4084
chore(ci): remove redundant quickstart check (#7286) 2023-02-09 19:47:24 +05:30
Aseem Bansal
2ae368cdbe
chore(ci): ensure kafka setup runs for smoke tests (#7278) 2023-02-08 09:03:59 -06:00
Aseem Bansal
8df66ecaff
fix(ci): trivy code scanning fix (#7232) 2023-02-02 21:50:24 +05:30
Harshal Sheth
5d7246b151
ci(): fix datahub-upgrade quickstart regression (#7217)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-01 15:30:18 -08:00
Harshal Sheth
7e869cd1d6
feat(): add a linter for github actions workflows (#7178)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-30 13:13:41 -08:00
Harshal Sheth
fe910e5bcf
ci(ingest): fix broken CI workflow for metadata-ingestion (#7161) 2023-01-29 17:52:41 +05:30
Aseem Bansal
e880f1415a
fix(ci): do not fail fast for matrix runs (#7132) 2023-01-25 09:31:47 -08:00
Pedro Silva
bef59b0928
feat(quickstart): Remove kafka-setup as a hard deployment requirement (#7073) 2023-01-24 16:12:57 +00:00
Aseem Bansal
db968497cc
fix(analytics): add missing usage events causing warning in logs (#7109) 2023-01-24 17:15:14 +05:30
david-leifker
1452332835
fix(build): Fix postgres setup gha (#7104) 2023-01-23 12:41:39 -06:00
david-leifker
5e935c7ae8
fix(build): postgres docker secret (#7092) 2023-01-20 15:15:47 -06:00
Amanda Ng
087b169b38
feat(editor): improve documentation editor using Remirror (#6631)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-01-17 18:00:39 -05:00
Aseem Bansal
10db6265c0
fix(ci): use trivy offline scanning (#7050) 2023-01-16 12:55:32 -06:00
Aseem Bansal
16c41b4778
fix(ci): only scan on master branch (#7047) 2023-01-16 09:34:37 -06:00
Aseem Bansal
e8a074f8b8
chore(ci): parallelise build and test workflow to reduce time (#6949) 2023-01-05 14:45:04 +05:30
david-leifker
c845866521
test(misc): misc test updates (#6890) 2022-12-29 11:26:42 -06:00
Aseem Bansal
0bbe6d693e
fix(ci): reduce flakiness in add_users, siblings smoke test (#6883) 2022-12-29 21:47:25 +05:30
Peter Szalai
9c794af4a7
feat(CI): add venv caching (#6843)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-28 13:22:47 +01:00
Harshal Sheth
8e0f4078b8
chore(ingest): loosen additional requirements (#6868) 2022-12-28 12:08:53 +01:00
Aseem Bansal
1bec1d87bd
fix(ci): reduce smoke test run time (#6841) 2022-12-27 00:08:01 +05:30