8 Commits

Author SHA1 Message Date
Yi (Alan) Wang
fe0d2ea5f9 Modify multiproduct ETL to set is_active for owner, return is_active to frontend ownership API (#437) 2017-07-10 13:42:15 -07:00
Yi (Alan) Wang
91926f9540 Fix table creation DDL bug for MySQL 5.7 (#375)
Primary key fields needs to be "NOT NULL".
2017-03-29 15:57:34 -07:00
Yi Wang
51f911b400 Map git repo and owners to Oracle/espresso/dali datasets 2016-11-22 10:51:00 -08:00
Na Zhang
043dc25e89 Get owners for espresso and oracle, and fix a bug for teradata 2016-10-19 11:13:32 -07:00
Yi Wang
81f891bfab Map scm repo owner to dataset owner table 2016-08-30 15:35:28 -07:00
Yi (Alan) Wang
078e90e8bd Add multiproduct and git repo metadata etl job (#202)
* Add multiproduct and git repo metadata etl job

* implement the dataset availability section

* Extract commit hash use it when querying acl

* Use FileWriter to write records into CSV file

* Remove unnecessary log entries from kafka processor

* Fix the incompatibility between integer repo_id in db and string field in record
2016-08-12 12:26:55 -07:00
Zhen Chen
d6f77a6f06 fix ldap org hierachy is empty bug and minor changes 2015-12-16 17:01:55 -08:00
Zhen Chen
af04ff6efc add git file commit history etl 2015-12-11 11:02:29 -08:00