7127 Commits

Author SHA1 Message Date
Harshal Sheth
54e04ba436
fix(ingest/dbt): remove unsupported usage indicator (#6805) 2022-12-19 09:34:49 -08:00
jx2lee
cdedc19c70
fix(docs): edit text to link (#6798) 2022-12-19 08:45:22 -08:00
danielli-ziprecruiter
7ca21a8e7c
fix(ingest): prevent NullPointerException when non-jdbc SaveIntoDataSourceCommand (#6803) 2022-12-19 08:41:06 -08:00
John Joyce
6f71c957d5
fix(ui): Fixing minor issues with Ingestion forms (#6790) 2022-12-19 07:50:14 -08:00
david-leifker
637b540fa6
fix(kafka-setup): fix return code check (#6782)
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
Aditya Radhakrishnan
d48e44499e
fix(tutorial): skip getting steps if there is no user (#6786) 2022-12-16 11:18:43 -08:00
Mayuri Nehate
9716a49067
fix(ingest): correct external url for account identifier with account name (#6715) 2022-12-16 14:00:42 -05:00
Harshal Sheth
5c8a3659db
fix(smoke-test): remove stateful ingestion config check (#6781) 2022-12-16 13:04:48 -05:00
Shirshanka Das
b236d0958c
feat(ci): adding github security reporting to trivy scans (#6773) 2022-12-15 21:28:07 -08:00
Harshal Sheth
22081f5ecc
feat(ingest): lookml - add unreachable views to report (#6779) 2022-12-15 20:26:30 -08:00
david-leifker
cca3639848
Optimize kafka setup (#6778)
* fix(kafka-setup): parallelize topic creation
2022-12-15 20:09:29 -06:00
Maggie Hays
2d0188c7ed
docs(snowflake) Snowflake quick ingestion guide (#6750) 2022-12-15 17:01:38 -08:00
John Joyce
0215245aa3
refactor(ui): Caching Ingestion Secrets (#6772) 2022-12-15 16:37:07 -08:00
Harshal Sheth
8a537b0559
feat(ingest): add datahub state inspect command (#6763) 2022-12-15 18:55:36 -05:00
Harshal Sheth
798d82fe60
docs(ingest): fix error in custom tags transformer example (#6767) 2022-12-15 15:31:12 -08:00
Aseem Bansal
1350bb010c
docs(docker): add section for adding community images (#6770) 2022-12-15 15:26:31 -08:00
Tamas Nemeth
b7bc1e9116
fix(ingest): bigquery - handling custom sql errors as warning (#6777) 2022-12-15 23:40:32 +01:00
Harshal Sheth
6152b5e9f7
feat(ingest): simplify more stateful ingestion state (#6762) 2022-12-15 11:33:29 -05:00
Harshal Sheth
7d7da15742
docs(ingest/airflow): clarify Airflow 1.x docs for airflow plugin (#6761) 2022-12-14 23:48:06 +01:00
John Joyce
0e614d110b
fix(): Fix the datahub-web-react build (#6764) 2022-12-14 12:58:54 -08:00
Shirshanka Das
db182e4639
fix(python-sdk): DataHubGraph get_aspect should accept empty responses (#6760) 2022-12-14 10:40:16 -08:00
Harshal Sheth
2f95719dba
feat(ingest): remove source config from DatahubIngestionCheckpoint (#6722) 2022-12-14 12:39:21 -05:00
jakobhanna
8109b8b567
docs(): Added build failed yarn error (#6757)
docs: add build failed yarn error message and how to deal with it 

I encountere this error and with the help of the community i could deal with it (https://datahubspace.slack.com/archives/CV2UVAPPG/p1670608619404699).
2022-12-14 09:30:45 -08:00
John Joyce
fd6d12f84a
refactor(ux): Misc UX Improvements (tutorial copy, caching, filters) (#6743) 2022-12-14 09:11:51 -08:00
Patrick Franco Braz
f0a371941e
refactor(ingest): bigquery-lineage - allow tables and datasets in uppercase (#6739) 2022-12-14 14:58:03 +01:00
Harshal Sheth
68fd802881
fix(ingest/lookml): fix directory handling and a github_info resolution bug (#6751) 2022-12-14 14:55:38 +01:00
Pedro Silva
3e274dc186
fix(auth): Renames metadata-auth archive name to not conflict with other modules. (#6749)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2022-12-13 19:38:48 -08:00
Harshal Sheth
b8560abd5a
fix(smoke-test): fix stateful ingestion test regression (#6753) 2022-12-13 19:35:37 -08:00
fully
7080c3e605
fix(actions): fix mistype slack/teams base url (#6754) 2022-12-13 19:34:34 -08:00
cccs-seb
3c2982c02c
fix(ingest): support airflow mapped operators (#6738) 2022-12-13 22:31:53 -05:00
Harshal Sheth
8c14dfc617
ci: fix ingestion gradle retry (#6752) 2022-12-13 20:16:59 -05:00
RyanHolstien
f85fd157e9
fix(elasticsearch): build in resilience against IO exceptions on httpclient (#6680)
* fix(elasticsearch): build in resilience against IO exceptions on http client
2022-12-13 18:11:02 -06:00
mohdsiddique
b7a2ce5c00
fix(): Add auth-api as compileOnly dependency (#6747)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-12-13 09:22:52 -08:00
Harshal Sheth
cf3db168ac
feat(ingest): start simplifying stateful ingestion state (#6740) 2022-12-13 10:05:57 +01:00
Harshal Sheth
7d63399d00
fix(ingest): fix serde for empty dicts in unions with null (#6745)
The code changes in https://github.com/acryldata/avro_gen/pull/16, but tests are written here.
2022-12-13 08:17:24 +01:00
Dmitry Bryazgin
551ef1b335
feat(ingest): add stateful ingestion to the ldap source (#6127)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-13 01:13:39 -05:00
Aseem Bansal
1da27edcbc
fix(ci): remove warnings due to deprecated action (#6735) 2022-12-13 10:42:21 +05:30
Tamas Nemeth
43f95d2b5c
Initial commit for bigquery ingestion guide (#6587)
* Initial commit for bigquery ingestion guide

* Addressing PR review comments

* Fixing lint error

* Shorten titles

* Removing images

* update copy on overview.md

* update to setup steps with additional roles

* update configuration.md

* lowcasing overview.md filename

* lowcasing setup.md

* lowcasing configuration.md

* update reference to setup.md

* update reference to setup.md

* update reference to configuration.md

* lowcase bigquery ingestion guide filenames

* Update location of ingestion guides in sidebar

* renaming ingestion quickstart guide sidebar

* remove old files

* Update docs-website/sidebars.js

* tweak

Co-authored-by: Maggie Hays <maggiem.hays@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-12-12 18:43:43 -08:00
Harshal Sheth
85bb1f5030
test(ingest): make hive/trino test more reliable (#6741) 2022-12-12 21:02:52 -05:00
Tamas Nemeth
5658fd5a54
feat(ingest): bigquery - external url support and a small profiling filter fix (#6714) 2022-12-12 16:25:32 -08:00
John Joyce
54230a8d81
feat(): Views Feature Milestone 1 (#6666) 2022-12-12 12:30:09 -08:00
Aseem Bansal
574bc85c73
doc(restore): document restore indices API endpoint (#6737) 2022-12-12 10:45:11 -08:00
cccs-Dustin
2cc64742e0
feat(ingest/iceberg): add stateful ingestion (#6344) 2022-12-12 13:06:03 -05:00
John Joyce
621974e559
feat(ui): Support DataBricks Unity Catalog Source in Ui Ingestion (#6707) 2022-12-12 09:14:06 -08:00
Aseem Bansal
3099bd1486
fix(ci): flakiness due to onboarding tour in add user test (#6734) 2022-12-12 22:02:19 +05:30
Mayuri Nehate
65ba13d9aa
feat(ingest): snowflake - add separate config for include_column_lineage in snowflake (#6712) 2022-12-12 15:23:12 +01:00
Jan Hicken
d3fca44e16
fix(ingest): bigquery - rectify filter for BigQuery external tables (#6691) 2022-12-12 10:58:23 +01:00
Harshal Sheth
fd911c9820
feat(ingest): redact configs reported in ingestion_run_summary (#6696) 2022-12-12 10:48:26 +01:00
Mayuri Nehate
5c99f20b7d
fix(ingest): mysql - fix mysql ingestion issue with non-lowercase database (#6713) 2022-12-12 10:48:01 +01:00
jx2lee
1f197d089c
docs(aws): edit markdown link (#6706) 2022-12-09 17:52:07 -08:00