6 Commits

Author	SHA1	Message	Date
Mars Lan	35c0781f59	Use WH_APP_FOLDER property as the base directory for temp files for various ETL jobs (#451) ... * Use WH_APP_FOLDER property as the base directory for temp files in Oracle ETL, instead of the full path defined in wh_etl_job_property, which is often /var/tmp/{something}. * Move common code to FileUtil.py and move Voldamort's temp files too. * Move Kafaka ETL temp files. * Move Espresso ETL temp files. * Move Multiproduct ETL temp files. * Move CodeSearch ETL temp files. * Move teradata ETL temp files.	2017-07-10 13:42:51 -07:00
Eric Sun	eee2fbf230	only add "key:" prefix to fields[] but not to combined_schema (#360) ... The combined_schema.keySchema will not need the "key:" prefix for Espresso	2017-07-10 09:54:09 -07:00
Eric Sun	976e4e5d49	- add "key:" prefix to Espresso keySchema (e.g. "key:fieldName01")\n- support input json with empty "documentSchema" (#356)	2017-07-10 09:54:08 -07:00
Yi Wang	3c6415390a	skip KAFKA topics starting with 'test' when fetching from Nuage	2017-07-10 09:53:27 -07:00
Yi Wang	d4b1182aca	Update Nuage load process, fix owner subtype and source	2017-07-10 09:53:27 -07:00
Yi Wang	cf49ae375c	ADD ESPRESSO_DATASET_METADATA_ETL job to fetch Espresso metadata from Nuage	2017-07-10 09:53:27 -07:00