3975 Commits

Author SHA1 Message Date
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type (#4361) 2022-03-09 20:06:02 -08:00
Ravindra Lanka
dc62feb1e5
feat(ingest): Add memory leak detection capability to the datahub cli command. (#4363) 2022-03-09 17:08:44 -08:00
Tamas Nemeth
799b5305c8
fix(ingest): bigquery - Fixing missing attribute error if credential was not set (#4356) 2022-03-09 10:27:27 -08:00
Vishal Shah
733413f58e
feat(ingest): mysql - add database_alias functionality (#4319)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-09 09:29:58 -08:00
Tamas Nemeth
48380ada4c
fix(ingest) bigquery-usage: Adding credential support for bigquery usage (#4111) 2022-03-08 12:29:10 -08:00
MugdhaHardikar-GSLab
f198a92def
fix(config-parsing): add support for variable expansion for in variables in between string (#4350) 2022-03-08 12:24:08 -08:00
Aseem Bansal
7eec30b2ec
fix(hive): clean protocol for hive source (#4330) 2022-03-08 11:57:26 -08:00
mayurinehate
e19b12030e
fix(GE): fix dependencies for GE DataHubValidationAction, logic for s… (#4347) 2022-03-08 11:20:09 -08:00
Aseem Bansal
05f2507e16
fix(doc): remove duplicate entry for permission (#4341) 2022-03-08 09:32:32 -08:00
Aseem Bansal
beb51ebf59
fix(ingestion): add logging, make job more resilient to errors (#4331) 2022-03-07 14:32:44 -08:00
BZ
e2d05cd8eb
docs: postgres - update support for platform instance (#4292) 2022-03-07 13:16:39 -08:00
Salih Can
915798a5ad
fix(ingest): elasticsearch - connector should work with defaults for auth (#4329)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-07 13:16:05 -08:00
Swaroop Jagadish
35b187a8d4
feat(ingest): transformers - add support for processing MCP-s (#4337) 2022-03-07 13:14:29 -08:00
Ravindra Lanka
bd6603bec5
fix(ingest): logging - insulate 'datahub' and child loggers from external modules. (#4324) 2022-03-07 12:00:06 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source (#4261) 2022-03-04 11:52:04 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00
Aseem Bansal
9a9a5c3084
fix: revert changes to OpenApi casing (#4291) 2022-03-04 10:35:44 -08:00
Aseem Bansal
182d4d1cd2
doc: improve doc on adding source (#4316) 2022-03-04 10:22:53 -08:00
Tamas Nemeth
a4c1d5d382
fix(ingest): bigquery - remove unneeded warning (#4317) 2022-03-04 09:11:30 -08:00
Tamas Nemeth
3158e49171
fix(ingest): Removing python 3.9.9 restriction (#4312) 2022-03-04 08:21:33 -08:00
Arun Vasudevan
2bf648f98a
feat (ingest): kafka-connect: adding Auth to Kafka Connect API (#4298) 2022-03-03 20:43:20 -08:00
Aseem Bansal
53d1379a85
fix(cli): telemetry - failures should not cause the CLI to fail (#4302) 2022-03-03 09:40:01 -08:00
Ravindra Lanka
520968b247
fix(ingest): bigquery - fix stateful ingestion checkpoint reconstruction. (#4295) 2022-03-02 13:10:15 -08:00
Kevin Hu
b2b8826118
fix(ingest): clarify s3/s3a requirements and platform defaults (#4263) 2022-03-02 08:58:27 -08:00
Tamas Nemeth
2a5cf3dd07
feat(ingest): bigquery - ability to disable partition profiling (#4228) 2022-03-01 22:29:48 -08:00
Aseem Bansal
d52638a252
fix(ingest): lib - revert positional arg change, create new method (#4266)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-01 22:06:37 -08:00
Ravindra Lanka
ba0c912c88
fix(ingest): snowflake - fix view upstream lineages to eliminate false edges. (#4284) 2022-03-01 16:53:26 -08:00
MugdhaHardikar-GSLab
ec26b0d52a
fix(ingest): fix config parsing for $ (#4258) 2022-03-01 16:11:06 -08:00
Tamas Nemeth
329b0b34b2
feat(ingest): bigquery - supporting v2 audit metadata on Bigquery (#4233) 2022-03-01 16:09:19 -08:00
Aditya Radhakrishnan
1275379d7d
feat(ingest) - cli - always display CLI version (#4282) 2022-03-01 16:07:58 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Ravindra Lanka
f12f653366
fix(ingest): snowflake - lineage + logging & reporting improvements. (#4276) 2022-02-28 17:34:48 -08:00
RyanHolstien
77a27359f2
fix(platform): timeline - fix semantic version ordering in API response and cli improvements (#4271) 2022-02-28 15:14:13 -08:00
Vishal Shah
93ff09517b
feat(ingest): add lineage_client_project_id field to the BigQuery config (#4138)
* feat(ingest): add lineage_client_project_id field to the bigquery config

* fix linting issues

* add type annotation for arguments
2022-02-28 11:19:23 -08:00
Aseem Bansal
c8a3e68202
fix(docs): doc build failing (#4267) 2022-02-28 10:53:22 -08:00
ksrinath
60c12d04be
docs(lineage): add fine-grained lineage docs and examples (#4260) 2022-02-25 07:35:48 -08:00
Vincenzo Lavorini
a113e4357e
fix(ingest): openapi - add support for user, password auth (#4086) 2022-02-24 23:29:01 -08:00
Kevin Hu
02fe05eb8f
feat(ingest): data-lake - remove spark requirement if not profiling (#4131) 2022-02-24 23:26:06 -08:00
Kevin Hu
3d6db93aa6
fix(ingest): fix mixpanel profile emits (#4253) 2022-02-24 21:26:41 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity (#4252) 2022-02-24 19:40:55 -08:00
Sunil Patil
16f3d4683a
feat(ingest): elasticsearch - add support for url_prefix in configuration (#4214)
Co-authored-by: Sunil Patil <spatil@twilio.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:06:38 -08:00
Edward Vaisman
6ff551cbcd
feat(ingest): lineage-file - add ability to provide lineage manually through a file (#4116) 2022-02-24 17:02:38 -08:00
Aseem Bansal
6248a55edb
fix(docs): fix broken link (#4242) 2022-02-24 15:45:52 -08:00
David Sanchez
8f75c278a1
fix(ingest): tableau - fix sheets external url ingestion (#4231) 2022-02-24 15:44:31 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model (#4248)
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
Arun Vasudevan
a3940962ba
fix(ingest): kafka-connect - pass the env variable as part of making dataset (#4244) 2022-02-24 13:58:52 -08:00
Kevin Hu
46701319dc
feat(ingest): switch telemetry endpoint to Mixpanel (#4238) 2022-02-24 12:35:48 -08:00
Harshal Sheth
49a8ece02a
fix(ingestion): enable compat with avro 1.11 (#4205) 2022-02-22 22:13:50 -08:00
Xu Wang
aa3363bcc2
feat(ingest): lib - add better support for working with urns (#4172)
Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-02-22 19:39:24 -08:00
Ravindra Lanka
7f4cb87c57
Revert "fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets. (#4140)" (#4218)
This reverts commit 6c75185445bbb23974932ff64cb142ee6bf5b51b.
2022-02-22 16:21:40 -08:00