197 Commits

Author SHA1 Message Date
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
Ebu (えぶ)
2911e1ed1b
feat(ingest): Add Source from Vertica (#4555)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:26:28 -07:00
John Joyce
944be9a1da
feat(Tests): Metadata Tests Models + APIs + UI (Part 1) (#4989) 2022-05-25 08:55:08 -07:00
mayurinehate
65cf0053a3
feat(model): add created, lastModified auditstamps to SchemaField (#4943) 2022-05-24 22:51:26 -07:00
mayurinehate
d316fc47ff
docs(transformer): update custom transform example to add missing super init (#4912) 2022-05-13 12:12:32 +05:30
Aseem Bansal
15438f62f1
fix(doc): update doc url to generated docs (#4860) 2022-05-13 10:19:46 +05:30
Cristian Calugaru
2a19a85f97
ssl configuration support for elasticsearch source (#4843) 2022-05-06 11:22:33 -07:00
mitchelllovessoftware123
27ed4508ef
Create sample_pii_glossary.yml (#4795) 2022-05-02 21:09:01 -07:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven (#4798)
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
2022-05-02 00:18:15 -07:00
Danilo Peixoto
d2a6bc06dc
feat(ingest): feast - add support for Feast 0.18, deprecate older integration (#4094) 2022-04-26 14:35:02 -07:00
Aseem Bansal
c66ef7c1fe
fix(snowflake): deprecate config, update examples (#4644)
* fix(snowflake): deprecate config, update examples

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-04-20 15:21:09 -07:00
Tamas Nemeth
f99d27fd8c
feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2022-04-12 23:19:39 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
mayurinehate
e2723bc981
feat(assertion): update python example, assertion entity doc (#4507) 2022-03-29 13:25:51 -07:00
MugdhaHardikar-GSLab
37aedfc87c
feat(s3): add s3 source (#4490)
* feat(data-lake): add containers and folder level dataset support

* docs(data-lake): Update readme for data lake

* doc(data-lake): fix examples, update doc

* lint fix

* feat(s3): add s3 source, restore old data-lake source

Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-03-29 11:52:57 +02:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Gabe Lyons
1ab3ad3986
feat(gql): make gql layer resistant to unresolvable relationships (#4424)
* query for custom properties on containers

* dont break gql if fine grained lineage is present
2022-03-16 14:19:10 -07:00
Aseem Bansal
f0230b05f5
fix: add missing logo (#4386) 2022-03-14 09:05:50 -07:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type (#4361) 2022-03-09 20:06:02 -08:00
Swaroop Jagadish
35b187a8d4
feat(ingest): transformers - add support for processing MCP-s (#4337) 2022-03-07 13:14:29 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00
Aseem Bansal
d52638a252
fix(ingest): lib - revert positional arg change, create new method (#4266)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-01 22:06:37 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source (#4201) 2022-02-28 17:37:22 -08:00
Vishal Shah
93ff09517b
feat(ingest): add lineage_client_project_id field to the BigQuery config (#4138)
* feat(ingest): add lineage_client_project_id field to the bigquery config

* fix linting issues

* add type annotation for arguments
2022-02-28 11:19:23 -08:00
ksrinath
60c12d04be
docs(lineage): add fine-grained lineage docs and examples (#4260) 2022-02-25 07:35:48 -08:00
Edward Vaisman
6ff551cbcd
feat(ingest): lineage-file - add ability to provide lineage manually through a file (#4116) 2022-02-24 17:02:38 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model (#4248)
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
Swaroop Jagadish
eaf7b02b2a
docs(model): auto-generated docs and hand-written docs for the metadata model (#4189) 2022-02-18 09:45:45 -08:00
Amanda Ng
d17f2bf014
feat(ui): Host platform images on datahub-web-react (#4118)
* feat(react-images): host platform images on datahub-web-react

* feat(react-images): update data_platforms logoUrl

* feat(react-images): add explanation for CopyWebpackPlugin

Co-authored-by: Amanda Ng <amanda.ng@grabtaxi.com>
2022-02-16 11:28:06 -08:00
John Joyce
3668de85e0
Fixing domains double icon on profile (#4093) 2022-02-08 15:21:07 -08:00
John Joyce
2a9a076fc1
feat(ingest): Adding Tableau Source Connector [BETA] (#4063) 2022-02-08 14:26:44 -08:00
ksrinath
4c24f386a6
feat(model): data quality model (#3787)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-02-02 22:56:08 -08:00
John Joyce
169cd4fde9
feat(containers): Adding Containers UI (as demo'd in Jan Townhall) (#4037) 2022-02-02 13:51:39 -08:00
John Joyce
7fef9a514a
feat(containers): Backend for Asset Containers (as demo'd in townhall) (#4019) 2022-02-01 11:07:34 -08:00
Tamas Nemeth
928ab74f33
feat(ingest): bigquery - profile only the latest partition/shard (#3930) 2022-02-01 10:05:35 -08:00
John Joyce
27c543a3aa
feat(domains): UI for Asset Domains (p2) (#3995) 2022-01-27 22:02:41 -08:00
dipeshmaurya
ad0019cb22
fix(docs): typo in bigquery_to_datahub.yml (#3988) 2022-01-27 15:01:59 -08:00
John Joyce
282851eeed
feat(domains): Adding backend for Asset Domains (p1) (#3952) 2022-01-27 13:07:11 -08:00
Aseem Bansal
b6a340d46b
fix(example): fix typo (#3907) 2022-01-25 19:06:58 -08:00
John Joyce
0da1a6b53d
fix(graphQL): Fixing set ordering in batchGet of entities (#3950) 2022-01-23 11:24:09 -08:00
John Joyce
8b716ad2b4
Adding SampleHiveDataset bootstrap metadata (#3947) 2022-01-21 14:39:51 -08:00
Ravindra Lanka
a44b48a6b8
feat(ingest): elasticsearch - add Elasticsearch Source (#3893)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-14 13:10:12 -08:00
Tamas Nemeth
0f20d60bfc
feat(profiler): using approximate queries for profiling (#3752) 2022-01-05 12:42:15 -08:00
Tamas Nemeth
450cdc1739
feat(snowflake-usage): Generate email address if not exists (#3791) 2021-12-29 08:14:18 -08:00
Tamas Nemeth
5df5150e51
feat(ingest): Add config option to set Bigquery credential in source config (#3786) 2021-12-27 05:48:45 -08:00
jawadqu
b4eaa9e09e
feat(ingestion): Mode retry wait logic to avoid hitting Mode API rate limit (#3761) 2021-12-16 19:17:12 -08:00
jawadqu
578590e795
feat(ingestion) : Add Metabase Source Connector (#3602)
Co-authored-by: Jawad Qureshi <jqureshi@petabloc.com>
2021-12-13 23:02:47 -08:00
Gabe Lyons
8394fc62b0
feat(mode): add mode analytics ingestion source (#3710) 2021-12-09 16:10:08 -08:00
mayurinehate
bd4ecbc7b9
fix(nifi): add env in nifi config, add unit tests, fix nifi doc (#3703) 2021-12-09 13:34:13 -08:00
Gabe Lyons
46850324d2
fix(ingest): revert accidental change to example recipe file_to_datahub_rest.yml (#3698) 2021-12-08 16:56:08 -08:00