yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-08-25 09:38:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,004 Commits 238 Branches 125 Tags
Commit Graph

3975 Commits

Author SHA1 Message Date
Chris Lee
f344b31f49 Built docker-compose in mce ingestion. 2019-12-16 17:44:12 -08:00
Chris Lee
e7ec56096a Provided primitive fieldPaths against the platform. 2019-12-09 12:07:03 -08:00
Chris Lee
250ced5eeb Introduced RDBMS ETL as a metadata ingestion example. 2019-12-04 16:47:31 -08:00
Chris Lee
89c6e35502 Performed --user flag to avoid the permission issue on requirement installation. 2019-11-13 17:01:32 -08:00
Chris Lee
1d6484da60 Released mySQL ETL in metadata-ingestion. 2019-10-24 05:17:28 -07:00
Kerem Sahin
8928e7a147 Add more samples to bootstrap data to be able to show upstreams/downstreams support 2019-09-27 11:47:59 -07:00
Chris Lee
646630b599 Enabled the kafka ingestion pipeline. 2019-09-24 16:41:06 -07:00
Chris Lee
49534ea590 Aligned the long type in time format. 2019-09-19 09:48:43 -07:00
Chris Lee
600c2f04ab Organized the output layout. 2019-09-18 11:03:48 -07:00
Kerem Sahin
162d52a421 Updated DataHub wiki link conf 2019-09-17 16:30:37 -07:00
Chris Lee
72b18aa890 Introduced the hive ETL pipeline. 2019-09-17 16:14:09 -07:00
Chris Lee
57976cc901 Introduced the hive ETL pipeline. 2019-09-17 16:13:35 -07:00
Chris Lee
9cc7a1e2f8 Imported the confluent-kafka[avro] as a requirement. 2019-09-17 15:06:56 -07:00
Chris Lee
5c2e03b162 Imported the confluent-kafka[avro] as a requirement. 2019-09-17 15:03:25 -07:00
Chris Lee
493cbe16d6 Added the runbook for the requirements.txt. 2019-09-16 13:27:16 -07:00
Chris Lee
bd32ec20a1 Supplied the requirements.txt for metadata-ingestion. 2019-09-16 13:13:42 -07:00
Chris Lee
81a38f87f7 Classified the ETL jobs in metadata-ingestion. 2019-09-16 12:52:37 -07:00
Chris Lee
430f13108d Enabled the configuration lists in the LDAP ETL. 2019-09-12 10:16:41 -07:00
Chris Lee
9df9d336c9 Ingested metadata from LDAP server to Data Hub. 2019-09-10 18:58:22 -07:00
Kerem Sahin
8bfb086e09 Set displayName fields for corp user MCEs 2019-09-09 00:31:09 -07:00
Kerem Sahin
0dc5bd9fe0 Add documentation 2019-09-08 20:25:58 -07:00
Kerem Sahin
693ee97c6c Fix ingestion script by pointing to correct MCE schema 
Refactor for metadata-ingestion module
Adding readme for metadata-ingestion
 2019-09-08 05:27:19 -07:00
Chris Lee
fd7350decc Resolved union type in avro serialization. 2019-09-05 14:27:59 -07:00
Kerem Sahin
216e24c164 Fix Kafka topic name for MCE ingestion CLI 2019-09-01 16:15:11 -07:00
Kerem Sahin
23339df23a Initial commit for Data Hub 2019-08-31 20:51:14 -07:00