17 Commits

Author	SHA1	Message	Date
SunZhaonan	4574e89de9	Fix bug of sample data schema inconsistant. Add clean up. Parameterize number of Actor	2016-02-22 17:40:07 -08:00
SunZhaonan	dfeefba213	Parameterize dataset source derived process.	2016-02-17 16:06:24 -08:00
SunZhaonan	c3da00003e	Fix bugs. Reenforce logging. Format jython scripts. Add missing table DDL.	2016-02-03 19:22:18 -08:00
SunZhaonan	0eddd8accf	close connection appropriatly, minior fix	2015-12-21 12:07:08 -08:00
SunZhaonan	05d54b3070	Add Hive metadata ETL process	2015-12-21 12:07:08 -08:00
Zhen Chen	7fca60a527	add ref flow id for sub flow jobs	2015-12-17 16:26:15 -08:00
Zhen Chen	d6f77a6f06	fix ldap org hierachy is empty bug and minor changes	2015-12-16 17:01:55 -08:00
SunZhaonan	cd44daba5d	Merge with master	2015-12-16 15:54:50 -08:00
Zhen Chen	9ebe0b22ad	move close connection into finally block	2015-12-16 14:47:03 -08:00
SunZhaonan	57a09c64f6	Format sql	2015-12-16 12:10:06 -08:00
SunZhaonan	7bf3ecdb4a	Change flowPath, jobName format. ... Fix sql nullable value comparison bug. Formating.	2015-12-15 17:15:43 -08:00
SunZhaonan	07c46304b5	Fix bug of duplicate field loading. Fix bug of subflow process in azkaban lineage ETL.	2015-12-11 19:46:35 -08:00
Zhen Chen	e21a6b8e75	remove unused variable, change load script and add etl type in backend service	2015-12-11 13:52:23 -08:00
Zhen Chen	af04ff6efc	add git file commit history etl	2015-12-11 11:02:29 -08:00
Zhen Chen	ebbf9ec629	add ldap user and group metadata etl	2015-12-10 16:26:57 -08:00
Zhen Chen	5a08134b8d	add dataset owner metadata etl	2015-12-07 15:17:01 -08:00
SunZhaonan	d5c3d87d00	Initial commit	2015-11-19 14:39:21 -08:00