Shridhar Sattur
f85bc8a081
Updated jobs documentation to include apache common changes. ( #865 )
...
* Updated jobs documentation to include apache common changes.
* Update README.md
2017-11-15 15:57:43 -08:00
na zhang
54237ff5ca
support elasticsearch auto re-index with zero downtime via alias switch
2017-10-25 15:50:03 -07:00
Yi (Alan) Wang
8084e35303
Modify HIVE extract, disable schema fetching from HDFS, add DB reconnect, refactor code ( #718 )
2017-08-30 17:34:31 -07:00
wenhuaOpenx
f7ec09e19a
Add etl job to extract/load druid metadata ( #680 )
...
* test
* test
* add druid etl code
* remove comments
* remove comments
* remove test doc"
* add job template for DRUID_METADATA_ETL
* add druid metadata etl configs to local_test.properties.template
* refactor logger
* remove comments
* fix typos
* add unit test for druid metadata etl job
* refactor unit test code
* import testgn package
* import new package
* reformat the druid etl code based on LinkedIn code style
* add README for druid metadata etl
* add README for druid metadata etl
* add README for druid metadata etl
2017-08-21 16:34:49 -07:00
Na Zhang
ca34cd920d
ump metric ETL
2017-08-16 16:43:46 -07:00
Mars Lan
4b4cae2148
Add base class for all pure jython ETLs ( #663 )
2017-08-10 17:40:19 -07:00
Mars Lan
6447cb4538
Update LDAP_USER_ETL.job
2017-08-03 15:20:26 -07:00
Mars Lan
2967489f18
Update ETL docs.
2017-07-26 16:32:44 -07:00
Mars Lan
fd8b0eac4c
Update README.md
2017-07-26 14:46:27 -07:00
Mars Lan
c025ba8494
Add template job config files. ( #597 )
2017-07-17 17:58:17 -07:00
Mars Lan
53a30d5a77
Major refactoring of ETL scheduling & configuration ( #542 )
...
* Major refactoring
- Move job-spcific properties from wh_etl_job_property table to .job files
- Use the job file name instead of numeric IDs to identify ETL jobs
- Use reflection to create ETL job class at run time instead of relying hard-coded enums
- Drop ETL job-related APIs as they're no longer needed
- Drop wh_etl_job, wh_etl_job_property, wh_etl_job_execution tables
- Add wh_etl_schedule & wh_etl_history tables
2017-07-10 13:44:33 -07:00
