yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-11-03 20:27:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/wherehows-docs/roadmap.md
Mars Lan 98bff89ba8 Add initial road map doc. (#608)
2017-07-21 16:13:09 -07:00

627 B
Raw Blame History

WhereHows Roadmap

Short term:

  • Improve search algorithm
  • Convert most of the ETL jobs to using Gobblin
  • Allow data platforms to push metadata changes to WhereHows directly via Kafka events

Medium term:

  • Store lineage metadata in graph DBs and allow querying
  • Generalize storage backend to support NoSQL, Ground etc.
  • Add an admin interface

Long Term:

  • Support column-level lineage
  • Fully support other types of entities, such as metrics, dashboards, experiments etc. as well as general relationships.