4417 Commits

Author SHA1 Message Date
Chris Lee
600c2f04ab Organized the output layout. 2019-09-18 11:03:48 -07:00
Kerem Sahin
162d52a421 Updated DataHub wiki link conf 2019-09-17 16:30:37 -07:00
Chris Lee
72b18aa890 Introduced the hive ETL pipeline. 2019-09-17 16:14:09 -07:00
Chris Lee
57976cc901 Introduced the hive ETL pipeline. 2019-09-17 16:13:35 -07:00
Chris Lee
9cc7a1e2f8 Imported the confluent-kafka[avro] as a requirement. 2019-09-17 15:06:56 -07:00
Chris Lee
5c2e03b162 Imported the confluent-kafka[avro] as a requirement. 2019-09-17 15:03:25 -07:00
Chris Lee
493cbe16d6 Added the runbook for the requirements.txt. 2019-09-16 13:27:16 -07:00
Chris Lee
bd32ec20a1 Supplied the requirements.txt for metadata-ingestion. 2019-09-16 13:13:42 -07:00
Chris Lee
81a38f87f7 Classified the ETL jobs in metadata-ingestion. 2019-09-16 12:52:37 -07:00
Chris Lee
430f13108d Enabled the configuration lists in the LDAP ETL. 2019-09-12 10:16:41 -07:00
Chris Lee
9df9d336c9 Ingested metadata from LDAP server to Data Hub. 2019-09-10 18:58:22 -07:00
Kerem Sahin
8bfb086e09 Set displayName fields for corp user MCEs 2019-09-09 00:31:09 -07:00
Kerem Sahin
0dc5bd9fe0 Add documentation 2019-09-08 20:25:58 -07:00
Kerem Sahin
693ee97c6c Fix ingestion script by pointing to correct MCE schema
Refactor for metadata-ingestion module
Adding readme for metadata-ingestion
2019-09-08 05:27:19 -07:00
Chris Lee
fd7350decc Resolved union type in avro serialization. 2019-09-05 14:27:59 -07:00
Kerem Sahin
216e24c164 Fix Kafka topic name for MCE ingestion CLI 2019-09-01 16:15:11 -07:00
Kerem Sahin
23339df23a Initial commit for Data Hub 2019-08-31 20:51:14 -07:00