10 Commits

Author	SHA1	Message	Date
Mars Lan	c75fa5e6dc	Use environmental variables to set ETL & Kafka job IDs. (#418) ... This will allow us to set different job IDs in staging & production via cfg2.	2017-07-10 09:57:51 -07:00
Yi Wang	b4f5e438e2	Add JobExecutionLineageEvent and kafka processor	2016-11-08 19:11:37 -08:00
Yi Wang	3227412339	Login authentication support multiple LDAP servers, add login history	2016-10-13 14:30:43 -07:00
Yi Wang	fcd6cf149e	Update MetastoreAuditProcessor to reduce storage, also refactor some code	2016-10-11 11:26:36 -07:00
Yi Wang	5049c847fa	Update Kafka consumer actors to reduce memory usage	2016-10-10 14:49:14 -07:00
Yi Wang	c0cfe1f5ca	Modify KafkaConsumerMaster to handle more than one kafka config, add error handling	2016-08-04 13:07:19 -07:00
Yi Wang	3d3b2a8075	Get kafka job id from applicatoin.conf and then get ref_id and configs from DB	2016-08-03 18:55:07 -07:00
Yi Wang	74ed769bab	add Oracle dataset metadata ETL job	2016-07-28 14:07:07 -07:00
Yi Wang	7edacc9a9f	get kafka config from wh_etl_job_property	2016-07-26 12:16:34 -07:00
Yi Wang	6d4706bc62	Ingest Gobblin tracking events into wherehows using Kafka consumer client	2016-07-25 15:03:29 -07:00