yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-07 09:11:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,753 Commits 190 Branches 118 Tags
Commit Graph

263 Commits

Author SHA1 Message Date
Gabe Lyons
67af68284f
dcs(ml-models): enhancing ml model documentation (#8848) 2023-09-19 09:02:24 -07:00
Hyejin Yoon
31abf383d1
ci: add markdown-link-check (#8771) 2023-09-14 11:34:21 +09:00
Mayuri Nehate
47571e6257
fix(examples): fix typo in business glossary bootstrap yml (#8703) 2023-08-28 15:02:47 +05:30
Aseem Bansal
cc46729137
chore(ingest): add example of training metric/hyper parameters (#8491) 2023-07-25 13:53:16 +05:30
Ellie O'Neil
ac4af259f2
docs(lineage): add read lineage example (#8322) 2023-06-30 08:48:05 -07:00
Ellie O'Neil
8880b47ca1
docs(business glossary) Update business glossary docs (#8287) 2023-06-26 11:00:09 -07:00
Ellie O'Neil
795b185f59
docs(ingest/lineage): Update fine grained file lineage docs (#8283) 2023-06-23 12:29:54 +05:30
Shubham Jagtap
35a4434490
fix(sdk/dataflow): deprecate cluster and use env and platform_instance instead (#8201) 
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2023-06-15 14:06:28 -07:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045) 
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-05-26 17:54:09 +01:00
Aseem Bansal
96f364802b
feat(lineage source): add fine grained lineage support (#7904) 2023-05-26 17:09:32 +05:30
Harshal Sheth
afd65e16fb
feat(cli): delete cli v2 (#8068) 2023-05-23 14:43:44 -05:00
Indy Prentice
0612c70a63
fix(sample data): Update timestamps in bootstrap_mce.json to more recent (#8103) 
Co-authored-by: Indy Prentice <indy@Indys-MBP.hsd1.ca.comcast.net>
 2023-05-23 14:09:27 -05:00
Hyejin Yoon
a8b622a016
feat: add docs on column-level linage (#8062) 2023-05-19 07:59:30 +09:00
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties (#7974) 
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
 2023-05-17 11:03:08 -07:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039) 
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
 2023-05-17 07:17:25 +00:00
Hyejin Yoon
25450ac82c
feat(docs): add guide on integration ML system via SDKs (#8029) 
Co-authored-by: socar-dini <dini@socar.kr>
 2023-05-17 10:21:39 +09:00
Harshal Sheth
ca5dffa54d
refactor(ingest/biz-glossary): simplify business glossary source (#7912) 2023-05-03 17:01:58 -07:00
Hyejin Yoon
8a7aeac9d9
feat: add missing python sdk guides based on DatahubGraph (#7875) 
Co-authored-by: socar-dini <dini@socar.kr>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2023-05-03 07:32:23 +09:00
Harshal Sheth
f37ca4e49c
docs(ingest): fix CorpGroup example (#7816) 2023-04-20 21:09:12 -07:00
Aseem Bansal
535e1abe44
chore(ci): fix CI failing due to lint (#7863) 2023-04-20 16:53:36 +05:30
Hyejin Yoon
e5d06733f2
feat(docs): consolidate api guides (#7857) 
Co-authored-by: socar-dini <dini@socar.kr>
 2023-04-20 12:17:11 +09:00
Hyejin Yoon
ea4036c1c8
feat: enriching guide on creating dataset (#7777) 
Co-authored-by: Hyejin Yoon <hyejin.yoon@acryl.io>
Co-authored-by: socar-dini <dini@socar.kr>
 2023-04-19 12:58:03 +09:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver (#7840) 2023-04-18 09:10:04 -07:00
RyanHolstien
0d5873db2a
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk (#7495) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
Co-authored-by: David Leifker <david.leifker@acryl.io>
 2023-04-13 15:46:35 -05:00
Hyejin Yoon
294c5ff507
feat(docs): refactor guide on graphql (#7745) 
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <hyejin.yoon@acryl.io>
 2023-04-08 08:26:58 +09:00
Harshal Sheth
e71c0d3490
feat(sdk): fix ownership emission for groups (#7751) 2023-04-05 11:15:06 +05:30
Hyejin Yoon
918718e7d0
feat(docs-website): add docs on creating users and groups (#7574) 
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2023-03-24 11:52:12 +09:00
Hyejin Yoon
864ac2da9f
docs: add guides on deleting entities (#7636) 
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
 2023-03-24 08:49:34 +09:00
Shirshanka Das
f872ca9cba
feat(cli): add user and group commands to create users and groups (#7595) 
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2023-03-22 18:44:01 -07:00
Hyejin Yoon
38555385e1
docs: add new code examples on creating entities & fix minor typos (#7613) 
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
 2023-03-17 10:07:24 +09:00
Harsha Mandadi
bf36c935fa
feat(ingest/s3): support path_specs of different S3 buckets in the same recipe (#7514) 2023-03-14 21:55:57 -07:00
John Joyce
08a215951c
feat(queries): Overhaul Queries Tab (#7366) 2023-02-20 11:10:18 -08:00
Aseem Bansal
5690560b6e
feat(cli): make deprecations, renames easier to notice (#7310) 2023-02-17 22:50:41 +05:30
John Joyce
c150ef04d6
feat(ui): Supporting display of columns and storage count in previews (#7198) 2023-02-02 09:38:06 -08:00
Peter Szalai
951364b9f2
fix(bootstrapdata): update timestamp to be in the last 1 year (#7206) 2023-02-01 18:07:43 +05:30
Aseem Bansal
21869adb83
chore(sample): add status removed aspect for sample data (#7203) 2023-02-01 15:07:15 +05:30
Harshal Sheth
f0432ee101
chore(ingest): remove duplicate data_platform.json file (#7026) 2023-01-12 20:47:08 -08:00
Harshal Sheth
dfc5c6bfce
chore(ingest): remove inferred args to MCPW, part 1 (#6819) 2022-12-30 01:26:47 -05:00
Harshal Sheth
667ca8632d
feat(ingest): avoid embedding serialized json in metadata files (#6742) 2022-12-28 19:28:38 -05:00
mohdsiddique
9daa8ed56f
feat(ingestion): Business Glossary# Add domain support in GlossaryTerm ingestion (#6829) 
* lint fix

* domain in term

* domain in term

* review comments

* add todo

Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-12-22 17:47:57 -05:00
Tamas Nemeth
e41b455e14
fix(ingest): bigquery - sharded table support improvements (#6789) 2022-12-19 18:57:37 +01:00
mohdsiddique
c4dcd268a6
feat(ingest): support knowledge links in business glossary (#6375) 
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
 2022-12-07 18:09:50 -05:00
Harshal Sheth
fceef480a2
chore(ingest): remove feast-legacy (#6661) 2022-12-06 14:19:38 -08:00
Harshal Sheth
6fe9ad4fbb
feat(ingest/bigquery): avoid creating/deleting tables for profiling (#6578) 2022-12-01 14:05:29 -05:00
Mayuri Nehate
22847a987a
feat(ingest): automated term classification for snowflake (#6376) 2022-11-23 00:43:30 -05:00
jakobhanna
3daeaccb2b
fix(docs): Ownership Type is deprecated (#6477) 
The ownership type is deprecated (described in OwnershipTypeClass), thats why it should be changed from DATAOWNER to TECHNICAL_OWNER.
 2022-11-17 12:20:40 -08:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server (#5369) 2022-11-01 16:05:42 -07:00
mohdsiddique
fbb1b7271c
feat(ingestion): business-glossary - Add values and relatedTerms support (#6148) 
* WIP

* updated snapshot

* merge

* while creating BusinessGlossaryConfig object, the version field always get set to None

* WIP

* lint fix

* remove field

* doc update

* rename the fields

* review comments

* lintFix

* Fix the business glossary example link

* small fixes to examples and docs

* some small tweaks to the model annotations

Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
 2022-11-01 15:17:30 -07:00
John Joyce
3ff49d4499
refactor(bootstrap): Adding assertions data to bootstrap (#6324) 2022-11-01 12:46:04 -07:00
Harshal Sheth
95d1e01195
feat(ingest): infer aspect name from type in get_aspect (#6033) 2022-10-11 13:35:41 -07:00