7 Commits

Author SHA1 Message Date
Yi (Alan) Wang
28b83b8e7b Add BaseJob in wherehows-common, make ETLjob extends from it (#681) 2017-08-16 21:24:38 -07:00
Yi (Alan) Wang
d52edaf3e1 Allow ETL jobs to be disabled at run time (#622) 2017-07-26 21:13:56 -07:00
Yi (Alan) Wang
6a8fe66ef9 Add active, deprecated flag to dataset, modify ETL to update is_active (#604) 2017-07-19 17:07:28 -07:00
Mars Lan
deb98480a3 Completely retire wh_property table and associated codes. (#583) 2017-07-10 13:44:35 -07:00
Mars Lan
53a30d5a77 Major refactoring of ETL scheduling & configuration (#542)
* Major refactoring
- Move job-spcific properties from wh_etl_job_property table to .job files
- Use the job file name instead of numeric IDs to identify ETL jobs
- Use reflection to create ETL job class at run time instead of relying hard-coded enums
- Drop ETL job-related APIs as they're no longer needed
- Drop wh_etl_job, wh_etl_job_property, wh_etl_job_execution tables
- Add wh_etl_schedule & wh_etl_history tables
2017-07-10 13:44:33 -07:00
Mars Lan
d3a92b7d2c Expand GobblinTrackingAuditProcessor to handle metadata audit events. (#521)
* Expand GobblinTrackingAuditProcessor to handle metadata audit events.

* Fix formating
2017-07-10 13:42:59 -07:00
Mars Lan
5f5c0937d1 Rename web, backend-service (#490)
* Rename web to wherehows-api and update README.

* Rename backend-service to wherehows-backend

* Rename metadata-etl to wherehows-etl

* Rename hadoop-dataset-extractor-standalone to wherehows-hadoop
2017-07-10 13:42:56 -07:00