11753 Commits

Author SHA1 Message Date
Patrick Franco Braz
f0a371941e
refactor(ingest): bigquery-lineage - allow tables and datasets in uppercase (#6739) 2022-12-14 14:58:03 +01:00
Harshal Sheth
68fd802881
fix(ingest/lookml): fix directory handling and a github_info resolution bug (#6751) 2022-12-14 14:55:38 +01:00
Pedro Silva
3e274dc186
fix(auth): Renames metadata-auth archive name to not conflict with other modules. (#6749)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2022-12-13 19:38:48 -08:00
Harshal Sheth
b8560abd5a
fix(smoke-test): fix stateful ingestion test regression (#6753) 2022-12-13 19:35:37 -08:00
fully
7080c3e605
fix(actions): fix mistype slack/teams base url (#6754) 2022-12-13 19:34:34 -08:00
cccs-seb
3c2982c02c
fix(ingest): support airflow mapped operators (#6738) 2022-12-13 22:31:53 -05:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry (#6752) 2022-12-13 20:16:59 -05:00
RyanHolstien
f85fd157e9
fix(elasticsearch): build in resilience against IO exceptions on httpclient (#6680)
* fix(elasticsearch): build in resilience against IO exceptions on http client
2022-12-13 18:11:02 -06:00
mohdsiddique
b7a2ce5c00
fix(): Add auth-api as compileOnly dependency (#6747)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-12-13 09:22:52 -08:00
Harshal Sheth
cf3db168ac
feat(ingest): start simplifying stateful ingestion state (#6740) 2022-12-13 10:05:57 +01:00
Harshal Sheth
7d63399d00
fix(ingest): fix serde for empty dicts in unions with null (#6745)
The code changes in https://github.com/acryldata/avro_gen/pull/16, but tests are written here.
2022-12-13 08:17:24 +01:00
Dmitry Bryazgin
551ef1b335
feat(ingest): add stateful ingestion to the ldap source (#6127)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-13 01:13:39 -05:00
Aseem Bansal
1da27edcbc
fix(ci): remove warnings due to deprecated action (#6735) 2022-12-13 10:42:21 +05:30
Tamas Nemeth
43f95d2b5c
Initial commit for bigquery ingestion guide (#6587)
* Initial commit for bigquery ingestion guide

* Addressing PR review comments

* Fixing lint error

* Shorten titles

* Removing images

* update copy on overview.md

* update to setup steps with additional roles

* update configuration.md

* lowcasing overview.md filename

* lowcasing setup.md

* lowcasing configuration.md

* update reference to setup.md

* update reference to setup.md

* update reference to configuration.md

* lowcase bigquery ingestion guide filenames

* Update location of ingestion guides in sidebar

* renaming ingestion quickstart guide sidebar

* remove old files

* Update docs-website/sidebars.js

* tweak

Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-12 18:43:43 -08:00
Harshal Sheth
85bb1f5030
test(ingest): make hive/trino test more reliable (#6741) 2022-12-12 21:02:52 -05:00
Tamas Nemeth
5658fd5a54
feat(ingest): bigquery - external url support and a small profiling filter fix (#6714) 2022-12-12 16:25:32 -08:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 (#6666) 2022-12-12 12:30:09 -08:00
Aseem Bansal
574bc85c73
doc(restore): document restore indices API endpoint (#6737) 2022-12-12 10:45:11 -08:00
cccs-Dustin
2cc64742e0
feat(ingest/iceberg): add stateful ingestion (#6344) 2022-12-12 13:06:03 -05:00
John Joyce
621974e559
feat(ui): Support DataBricks Unity Catalog Source in Ui Ingestion (#6707) 2022-12-12 09:14:06 -08:00
Aseem Bansal
3099bd1486
fix(ci): flakiness due to onboarding tour in add user test (#6734) 2022-12-12 22:02:19 +05:30
Mayuri Nehate
65ba13d9aa
feat(ingest): snowflake - add separate config for include_column_lineage in snowflake (#6712) 2022-12-12 15:23:12 +01:00
Jan Hicken
d3fca44e16
fix(ingest): bigquery - rectify filter for BigQuery external tables (#6691) 2022-12-12 10:58:23 +01:00
Harshal Sheth
fd911c9820
feat(ingest): redact configs reported in ingestion_run_summary (#6696) 2022-12-12 10:48:26 +01:00
Mayuri Nehate
5c99f20b7d
fix(ingest): mysql - fix mysql ingestion issue with non-lowercase database (#6713) 2022-12-12 10:48:01 +01:00
jx2lee
1f197d089c
docs(aws): edit markdown link (#6706) 2022-12-09 17:52:07 -08:00
david-leifker
be9348b518
fix(build): rename conflicting module auth-api (#6728)
* fix(build): rename conflicting module `auth-api`
2022-12-09 18:06:51 -06:00
david-leifker
1e5d434501
fix(security): commons-text in frontend, hadoop-commons in datahub-upgrade (#6723) 2022-12-09 14:11:12 -06:00
Harshal Sheth
b7735d5b21
fix(ingest): fix bug in auto_status_aspect (#6705)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-12-09 12:24:39 -05:00
Pedro Silva
c93bdc5e39
fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS. (#6612)
* fix(setup): Bump setup images to alpine 3.14 with arch based on machine OS.
2022-12-09 09:49:24 -06:00
david-leifker
68e30d3bc2
test(quickstart): add debugging to quickstart test (#6718) 2022-12-09 09:26:22 -06:00
Harshal Sheth
ab24379def
build: add retries to gradle wrapper download in ingestion docker (#6704) 2022-12-08 22:37:29 -05:00
Harshal Sheth
c211cfbbe6
fix(ingest/sagemaker): handle missing ProcessingInputs field (#6697)
Fixes #6360.
2022-12-08 18:42:28 -08:00
david-leifker
27ea3bf125
fix(security): play framework upgrade (#6626)
* fix(security): play framework upgrade
2022-12-08 20:27:51 -06:00
Maggie Hays
121e9c211c
docs(logos): Update Great Expectations logo (#6698) 2022-12-08 16:35:37 -08:00
Harshal Sheth
4dded454ff
fix(ingest): cleanup config extra usage (#6699) 2022-12-08 16:34:34 -08:00
dependabot[bot]
e769a723a3
build(deps): bump qs from 6.5.2 to 6.5.3 in /datahub-web-react (#6664) 2022-12-08 16:29:20 -08:00
Aditya Radhakrishnan
37126f56e8
fix(ui): fix search on policy builder (#6703) 2022-12-08 16:15:23 -08:00
Felix Lüdin
e7acc8ef30
fix(config): unify the handling of boolean environment variables (#6684) 2022-12-08 15:00:09 -08:00
Harshal Sheth
acc79d7d0d
fix(ingest/tableau): support ssl_verify flag properly (#6682) 2022-12-08 14:58:31 -08:00
dependabot[bot]
2008130f2f
build(deps): bump express from 4.17.1 to 4.18.2 in /datahub-web-react (#6665) 2022-12-08 14:57:53 -08:00
dependabot[bot]
7ccbaca219
build(deps): bump qs from 6.5.2 to 6.5.3 in /smoke-test/tests/cypress (#6663) 2022-12-08 14:57:10 -08:00
John Joyce
962998feff
fix(publish): Attempting to fix publish for auth-api (#6695) 2022-12-08 14:51:46 -08:00
Harshal Sheth
1165884c6b
ci: stop commenting unit test results on PR (#6700)
The results will still be surfaced under the "Test Results" action
workflow, but the results won't be commented on the PR itself.
2022-12-08 23:19:27 +01:00
Tamas Nemeth
729e486b62
feat(ingest): bigquery - option to set on behalf project (#6660) 2022-12-08 15:25:22 -05:00
orlandine
b219f0848a
docs(ingest/salesforce): list required permissions (#6610) 2022-12-08 14:50:15 -05:00
david-leifker
691f802a13
fix(security): version bump to latest minor python image (#6694) 2022-12-08 13:54:21 -05:00
Aseem Bansal
96150cfb10
fix(ci): revert confluent kafka in base image (#6690) 2022-12-08 13:54:13 -05:00
John Joyce
bbcec3b226
refactor(ui): Adding caching for users, groups, and roles (#6673) 2022-12-08 09:23:15 -08:00
Aseem Bansal
5b52534fd4
fix(ci): reduce warnings due to deprecated action (#6686) 2022-12-08 10:00:05 +05:30