yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-13 04:02:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/docs/how/metadata-modelling.md
Mars Lan 1283dd3ff4
refactor(pdl): convert all pdsc to pdl (#1678) 
Use the automated tool in https://linkedin.github.io/rest.li/pdl_migration
Also update all relevant docs
2020-05-21 10:49:23 -07:00

962 B
Raw Blame History

How to model metadata ?

GMA uses rest.li, which is LinkedIn's open source REST framework. All metadata in GMA needs to be modelled using Pegasus schema (PDL) which is the data schema for rest.li.

Conceptually we’re modelling metadata as a hybrid graph of nodes (entities) and edges (relationships), with additional documents (metadata aspects) attached to each node. You can also think of it as a modified Entity-Relationship Model.

Here is an example graph consisting of 3 types of entities (User, Group, Dataset), 3 types of relationships (OwnedBy, HasAdmin, HasMember), and 3 types of metadata aspects (Ownership, Profile, and Membership).

metadata-modeling