21 Commits

Author SHA1 Message Date
Kiran
601cd258e1 Failed to open file 'ETL_DDL/kafka_tracking.sql (#844)
ERROR at line 26: Failed to open file 'ETL_DDL/kafka_tracking.sql', error: 2
2017-11-07 11:31:57 -08:00
Yi (Alan) Wang
3cde8a5597 Fix issue with docker ports and DDL (#822) 2017-10-26 10:41:12 -07:00
Yi (Alan) Wang
776f83e893 Modify compliance API to access purge note (#807) 2017-10-19 10:26:45 -07:00
Yi (Alan) Wang
ae6937af41 Increase urn length to 500 in DDL (#804) 2017-10-18 14:57:58 -07:00
Yi (Alan) Wang
ddc9171eba Add binary_json to dataset table storage type (#802) 2017-10-17 12:48:42 -07:00
Na Zhang
ca34cd920d ump metric ETL 2017-08-16 16:43:46 -07:00
Mars Lan
6153565968 Add missing DDLs for LDAP-related ETL. (#664) 2017-08-11 11:41:40 -07:00
Yi (Alan) Wang
068acf0a46 Remove deprecated compliance and security related frontend API (#654) 2017-08-09 17:10:58 -07:00
Yi (Alan) Wang
d52edaf3e1 Allow ETL jobs to be disabled at run time (#622) 2017-07-26 21:13:56 -07:00
Mars Lan
67e6986c68 Add license header 2017-07-25 21:55:53 -07:00
Mars Lan
d161a072a2 Add DDL for log_jira__hdfs_directory_to_owner_map table. 2017-07-25 18:09:49 -07:00
Mars Lan
04f61e13f1 Add DDL for job_execution_script. 2017-07-25 14:19:47 -07:00
Yi (Alan) Wang
6a8fe66ef9 Add active, deprecated flag to dataset, modify ETL to update is_active (#604) 2017-07-19 17:07:28 -07:00
Mars Lan
3887c71c37 Rename readme.MD to README.md 2017-07-18 15:44:53 -07:00
Mars Lan
ec0b5ac309 Fix and significatly simplify the docker build process. (#593) 2017-07-13 09:39:59 -07:00
Mars Lan
bb5f483be9 Clean up comments and DDL for obsolete tables. (#586) 2017-07-10 13:44:35 -07:00
Yi (Alan) Wang
98ffbfb65f track last modified person of compliance info (#554) 2017-07-10 13:44:33 -07:00
Mars Lan
53a30d5a77 Major refactoring of ETL scheduling & configuration (#542)
* Major refactoring
- Move job-spcific properties from wh_etl_job_property table to .job files
- Use the job file name instead of numeric IDs to identify ETL jobs
- Use reflection to create ETL job class at run time instead of relying hard-coded enums
- Drop ETL job-related APIs as they're no longer needed
- Drop wh_etl_job, wh_etl_job_property, wh_etl_job_execution tables
- Add wh_etl_schedule & wh_etl_history tables
2017-07-10 13:44:33 -07:00
Yi (Alan) Wang
445a574a87 Change compliance column type to MEDIUMTEXT (#530) 2017-07-10 13:43:00 -07:00
Yi (Alan) Wang
b2736e281b Create dataset_compliance table to combine compliance and security (#512) 2017-07-10 13:42:58 -07:00
Mars Lan
d75ae54b4b Rename data-model to wherehows-data-model. (#492) 2017-07-10 13:42:57 -07:00