1085 Commits

Author SHA1 Message Date
Ravindra Lanka
50ef658339
fix(ingestion): Invoke SqlLineageSQLParser's implementation in a separate process (#4391) 2022-03-14 17:49:03 -07:00
Abhiram98
d82e1d31a4
fix(ingestion): redshift - read all tables (#4345) 2022-03-14 17:46:35 -07:00
WaStCo
bd3090ae86
fix(query_combiner): add try block to handle queries of type str (#4397)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-03-14 17:45:28 -07:00
Hassan Shahid
eb9a167e0d
build(ingestion): update markupsafe pinning for Airflow compatibility (#4388) 2022-03-14 16:19:59 -07:00
Ravindra Lanka
5aaf187371
fix(ingestion): Fix mypy error stateful committable & restore mypy version. (#4408) 2022-03-14 14:15:14 -07:00
Aseem Bansal
1198123d78
fix: telemetry failure should not cause CLI failure (#4406) 2022-03-14 12:25:22 -07:00
Aseem Bansal
f0230b05f5
fix: add missing logo (#4386) 2022-03-14 09:05:50 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups (#4367) (#4368)
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift (#4344) 2022-03-14 08:50:29 -07:00
mayurinehate
3ea72869f3
feat(GE): add option to disable sql parsing, use default parser (#4377) 2022-03-10 17:36:59 -08:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type (#4361) 2022-03-09 20:06:02 -08:00
Ravindra Lanka
dc62feb1e5
feat(ingest): Add memory leak detection capability to the datahub cli command. (#4363) 2022-03-09 17:08:44 -08:00
Tamas Nemeth
799b5305c8
fix(ingest): bigquery - Fixing missing attribute error if credential was not set (#4356) 2022-03-09 10:27:27 -08:00
Vishal Shah
733413f58e
feat(ingest): mysql - add database_alias functionality (#4319)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-09 09:29:58 -08:00
Tamas Nemeth
48380ada4c
fix(ingest) bigquery-usage: Adding credential support for bigquery usage (#4111) 2022-03-08 12:29:10 -08:00
MugdhaHardikar-GSLab
f198a92def
fix(config-parsing): add support for variable expansion for in variables in between string (#4350) 2022-03-08 12:24:08 -08:00
Aseem Bansal
7eec30b2ec
fix(hive): clean protocol for hive source (#4330) 2022-03-08 11:57:26 -08:00
mayurinehate
e19b12030e
fix(GE): fix dependencies for GE DataHubValidationAction, logic for s… (#4347) 2022-03-08 11:20:09 -08:00
Aseem Bansal
05f2507e16
fix(doc): remove duplicate entry for permission (#4341) 2022-03-08 09:32:32 -08:00
Aseem Bansal
beb51ebf59
fix(ingestion): add logging, make job more resilient to errors (#4331) 2022-03-07 14:32:44 -08:00
BZ
e2d05cd8eb
docs: postgres - update support for platform instance (#4292) 2022-03-07 13:16:39 -08:00
Salih Can
915798a5ad
fix(ingest): elasticsearch - connector should work with defaults for auth (#4329)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-07 13:16:05 -08:00
Swaroop Jagadish
35b187a8d4
feat(ingest): transformers - add support for processing MCP-s (#4337) 2022-03-07 13:14:29 -08:00
Ravindra Lanka
bd6603bec5
fix(ingest): logging - insulate 'datahub' and child loggers from external modules. (#4324) 2022-03-07 12:00:06 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source (#4261) 2022-03-04 11:52:04 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00
Aseem Bansal
9a9a5c3084
fix: revert changes to OpenApi casing (#4291) 2022-03-04 10:35:44 -08:00
Aseem Bansal
182d4d1cd2
doc: improve doc on adding source (#4316) 2022-03-04 10:22:53 -08:00
Tamas Nemeth
a4c1d5d382
fix(ingest): bigquery - remove unneeded warning (#4317) 2022-03-04 09:11:30 -08:00
Tamas Nemeth
3158e49171
fix(ingest): Removing python 3.9.9 restriction (#4312) 2022-03-04 08:21:33 -08:00
Arun Vasudevan
2bf648f98a
feat (ingest): kafka-connect: adding Auth to Kafka Connect API (#4298) 2022-03-03 20:43:20 -08:00
Aseem Bansal
53d1379a85
fix(cli): telemetry - failures should not cause the CLI to fail (#4302) 2022-03-03 09:40:01 -08:00
Ravindra Lanka
520968b247
fix(ingest): bigquery - fix stateful ingestion checkpoint reconstruction. (#4295) 2022-03-02 13:10:15 -08:00
Kevin Hu
b2b8826118
fix(ingest): clarify s3/s3a requirements and platform defaults (#4263) 2022-03-02 08:58:27 -08:00
Tamas Nemeth
2a5cf3dd07
feat(ingest): bigquery - ability to disable partition profiling (#4228) 2022-03-01 22:29:48 -08:00
Aseem Bansal
d52638a252
fix(ingest): lib - revert positional arg change, create new method (#4266)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-01 22:06:37 -08:00
Ravindra Lanka
ba0c912c88
fix(ingest): snowflake - fix view upstream lineages to eliminate false edges. (#4284) 2022-03-01 16:53:26 -08:00
MugdhaHardikar-GSLab
ec26b0d52a
fix(ingest): fix config parsing for $ (#4258) 2022-03-01 16:11:06 -08:00
Tamas Nemeth
329b0b34b2
feat(ingest): bigquery - supporting v2 audit metadata on Bigquery (#4233) 2022-03-01 16:09:19 -08:00
Aditya Radhakrishnan
1275379d7d
feat(ingest) - cli - always display CLI version (#4282) 2022-03-01 16:07:58 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Ravindra Lanka
f12f653366
fix(ingest): snowflake - lineage + logging & reporting improvements. (#4276) 2022-02-28 17:34:48 -08:00
RyanHolstien
77a27359f2
fix(platform): timeline - fix semantic version ordering in API response and cli improvements (#4271) 2022-02-28 15:14:13 -08:00
Vishal Shah
93ff09517b
feat(ingest): add lineage_client_project_id field to the BigQuery config (#4138)
* feat(ingest): add lineage_client_project_id field to the bigquery config

* fix linting issues

* add type annotation for arguments
2022-02-28 11:19:23 -08:00
Aseem Bansal
c8a3e68202
fix(docs): doc build failing (#4267) 2022-02-28 10:53:22 -08:00
ksrinath
60c12d04be
docs(lineage): add fine-grained lineage docs and examples (#4260) 2022-02-25 07:35:48 -08:00
Vincenzo Lavorini
a113e4357e
fix(ingest): openapi - add support for user, password auth (#4086) 2022-02-24 23:29:01 -08:00
Kevin Hu
02fe05eb8f
feat(ingest): data-lake - remove spark requirement if not profiling (#4131) 2022-02-24 23:26:06 -08:00
Kevin Hu
3d6db93aa6
fix(ingest): fix mixpanel profile emits (#4253) 2022-02-24 21:26:41 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity (#4252) 2022-02-24 19:40:55 -08:00