yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-06 16:49:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,076 Commits 189 Branches 118 Tags
Commit Graph

276 Commits

Author SHA1 Message Date
Harshal Sheth
dfc5c6bfce
chore(ingest): remove inferred args to MCPW, part 1 (#6819) 2022-12-30 01:26:47 -05:00
Harshal Sheth
667ca8632d
feat(ingest): avoid embedding serialized json in metadata files (#6742) 2022-12-28 19:28:38 -05:00
mohdsiddique
9daa8ed56f
feat(ingestion): Business Glossary# Add domain support in GlossaryTerm ingestion (#6829) 
* lint fix

* domain in term

* domain in term

* review comments

* add todo

Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-12-22 17:47:57 -05:00
Tamas Nemeth
e41b455e14
fix(ingest): bigquery - sharded table support improvements (#6789) 2022-12-19 18:57:37 +01:00
mohdsiddique
c4dcd268a6
feat(ingest): support knowledge links in business glossary (#6375) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-12-07 18:09:50 -05:00
Harshal Sheth
fceef480a2
chore(ingest): remove feast-legacy (#6661) 2022-12-06 14:19:38 -08:00
Harshal Sheth
6fe9ad4fbb
feat(ingest/bigquery): avoid creating/deleting tables for profiling (#6578) 2022-12-01 14:05:29 -05:00
Mayuri Nehate
22847a987a
feat(ingest): automated term classification for snowflake (#6376) 2022-11-23 00:43:30 -05:00
jakobhanna
3daeaccb2b
fix(docs): Ownership Type is deprecated (#6477) 
The ownership type is deprecated (described in OwnershipTypeClass), thats why it should be changed from DATAOWNER to TECHNICAL_OWNER.
 2022-11-17 12:20:40 -08:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server (#5369) 2022-11-01 16:05:42 -07:00
mohdsiddique
fbb1b7271c
feat(ingestion): business-glossary - Add values and relatedTerms support (#6148) 
* WIP

* updated snapshot

* merge

* while creating BusinessGlossaryConfig object, the version field always get set to None

* WIP

* lint fix

* remove field

* doc update

* rename the fields

* review comments

* lintFix

* Fix the business glossary example link

* small fixes to examples and docs

* some small tweaks to the model annotations

Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
 2022-11-01 15:17:30 -07:00
John Joyce
3ff49d4499
refactor(bootstrap): Adding assertions data to bootstrap (#6324) 2022-11-01 12:46:04 -07:00
Harshal Sheth
95d1e01195
feat(ingest): infer aspect name from type in get_aspect (#6033) 2022-10-11 13:35:41 -07:00
Thomas Tauber-Marshall
6b83cab82c
feat(ingest): add CorpUser and CorpGroup to the Python SDK (#5930) 
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-10-04 12:13:38 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source (#5923) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2022-09-15 09:53:54 -07:00
Harshal Sheth
954397a078
fix(ingest): remove dbt disable_dbt_node_creation and load_schema options (#5877) 2022-09-09 14:07:55 -07:00
mohdsiddique
2f65e2f226
feat(transformers): Add semantics & transform_aspect support in transformers (#5514) 
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-09-06 14:44:14 -07:00
John Joyce
10672c3464
fix(bootstrap): Remove malformed test in bootstrap.json (#5747) 2022-08-26 11:19:48 -07:00
John Joyce
be22455ebb
feat(ui): Adding slack handle to corp group info (#5645) 2022-08-15 14:35:57 -07:00
xiphl
16ff4aaa94
feat(ingest) Allow ingestion of Elasticsearch index template (#5444) 
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
 2022-08-03 20:58:07 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
Pedro Silva
b2edd44b6a
Adds support for Domains in CSV source (#5372) 2022-07-15 14:20:41 +05:30
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation (#5196) 2022-07-13 10:17:38 -07:00
Aezo
ff0aa3f24b
feat(sdk): python - add get_aspects_for_entity (#5255) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2022-07-12 10:10:07 -07:00
Aditya Radhakrishnan
fc8e59387d
feat(ingest): update CSV source to support description and ownership type (#5346) 2022-07-06 21:29:29 +05:30
Vincent Koc
d60f789519
chore: Refactor Python Codebase (#5113) 2022-07-06 16:09:27 +05:30
Aseem Bansal
32e598df2b
feat(ingest): working with multiple bigquery projects (#5240) 2022-06-27 14:21:54 +05:30
Aditya Radhakrishnan
82ca92f8f9
feat(ingest): adds csv enricher ingestion source (#5221) 2022-06-22 12:25:39 +05:30
Tamas Nemeth
039e98e8cf
feat(docs): Updating example files with the new ingestion recipe suffix (#5103) 2022-06-07 15:52:26 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376) 
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
 2022-05-26 03:42:50 -07:00
Ebu (えぶ)
2911e1ed1b
feat(ingest): Add Source from Vertica (#4555) 
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
 2022-05-26 03:26:28 -07:00
John Joyce
944be9a1da
feat(Tests): Metadata Tests Models + APIs + UI (Part 1) (#4989) 2022-05-25 08:55:08 -07:00
mayurinehate
65cf0053a3
feat(model): add created, lastModified auditstamps to SchemaField (#4943) 2022-05-24 22:51:26 -07:00
mayurinehate
d316fc47ff
docs(transformer): update custom transform example to add missing super init (#4912) 2022-05-13 12:12:32 +05:30
Aseem Bansal
15438f62f1
fix(doc): update doc url to generated docs (#4860) 2022-05-13 10:19:46 +05:30
Cristian Calugaru
2a19a85f97
ssl configuration support for elasticsearch source (#4843) 2022-05-06 11:22:33 -07:00
mitchelllovessoftware123
27ed4508ef
Create sample_pii_glossary.yml (#4795) 2022-05-02 21:09:01 -07:00
Shirshanka Das
a9ad138172
feat(ingest): docs - overhaul source connector docs to make it code driven (#4798) 
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
 2022-05-02 00:18:15 -07:00
Danilo Peixoto
d2a6bc06dc
feat(ingest): feast - add support for Feast 0.18, deprecate older integration (#4094) 2022-04-26 14:35:02 -07:00
Aseem Bansal
c66ef7c1fe
fix(snowflake): deprecate config, update examples (#4644) 
* fix(snowflake): deprecate config, update examples

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
 2022-04-20 15:21:09 -07:00
Tamas Nemeth
f99d27fd8c
feat(ingest): airflow - add support to capture airflow executions, add high level dataflow jobs api to python sdk (#4615) 
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
 2022-04-12 23:19:39 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557) 
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
 2022-04-04 14:39:30 -05:00
mayurinehate
e2723bc981
feat(assertion): update python example, assertion entity doc (#4507) 2022-03-29 13:25:51 -07:00
MugdhaHardikar-GSLab
37aedfc87c
feat(s3): add s3 source (#4490) 
* feat(data-lake): add containers and folder level dataset support

* docs(data-lake): Update readme for data lake

* doc(data-lake): fix examples, update doc

* lint fix

* feat(s3): add s3 source, restore old data-lake source

Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
 2022-03-29 11:52:57 +02:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Gabe Lyons
1ab3ad3986
feat(gql): make gql layer resistant to unresolvable relationships (#4424) 
* query for custom properties on containers

* dont break gql if fine grained lineage is present
 2022-03-16 14:19:10 -07:00
Aseem Bansal
f0230b05f5
fix: add missing logo (#4386) 2022-03-14 09:05:50 -07:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type (#4361) 2022-03-09 20:06:02 -08:00
Swaroop Jagadish
35b187a8d4
feat(ingest): transformers - add support for processing MCP-s (#4337) 2022-03-07 13:14:29 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA (#4305) 2022-03-04 11:51:31 -08:00