12076 Commits

Author SHA1 Message Date
SunZhaonan
05d54b3070 Add Hive metadata ETL process 2015-12-21 12:07:08 -08:00
SunZhaonan
059dfb1e1a Merge pull request #10 from czbernard/master
fix ldap org hierarchy bug and add sub flow reference id
2015-12-18 12:00:16 -08:00
Zhen Chen
7fca60a527 add ref flow id for sub flow jobs 2015-12-17 16:26:15 -08:00
Zhen Chen
d6f77a6f06 fix ldap org hierachy is empty bug and minor changes 2015-12-16 17:01:55 -08:00
SunZhaonan
85202d5c8e Merge branch 'linkedin' 2015-12-16 15:57:15 -08:00
SunZhaonan
cd44daba5d Merge with master 2015-12-16 15:54:50 -08:00
SunZhaonan
9eb7f14aa6 Merge pull request #7 from czbernard/linkedin
changes to gitorious crawler and put close connection into finally block in jythons
2015-12-16 14:56:18 -08:00
Zhen Chen
9ebe0b22ad move close connection into finally block 2015-12-16 14:47:03 -08:00
Zhen Chen
27f1a2481d Merge pull request #6 from SunZhaonan/master
Fix bugs
2015-12-16 12:12:41 -08:00
SunZhaonan
57a09c64f6 Format sql 2015-12-16 12:10:06 -08:00
SunZhaonan
7bf3ecdb4a Change flowPath, jobName format.
Fix sql nullable value comparison bug.
Formating.
2015-12-15 17:15:43 -08:00
Zhen Chen
3c51365e12 parse the xml format of gitorious project page instead of the html page 2015-12-15 11:44:05 -08:00
SunZhaonan
8bc741d37c Merge pull request #5 from czbernard/linkedin
add git file commit history etl
2015-12-14 16:59:25 -08:00
SunZhaonan
07c46304b5 Fix bug of duplicate field loading. Fix bug of subflow process in azkaban lineage ETL. 2015-12-11 19:46:35 -08:00
Zhen Chen
e21a6b8e75 remove unused variable, change load script and add etl type in backend service 2015-12-11 13:52:23 -08:00
Zhen Chen
af04ff6efc add git file commit history etl 2015-12-11 11:02:29 -08:00
SunZhaonan
0b168dc16b Merge pull request #4 from czbernard/linkedin
add ldap user and group metadata etl
2015-12-10 17:19:29 -08:00
Zhen Chen
ebbf9ec629 add ldap user and group metadata etl 2015-12-10 16:26:57 -08:00
SunZhaonan
6a121c51a0 Merge pull request #3 from czbernard/linkedin
Add dataset ownership metadata collection
2015-12-09 16:53:38 -08:00
Zhen Chen
5a08134b8d add dataset owner metadata etl 2015-12-07 15:17:01 -08:00
Zhen Chen
5bfb5adb71 close input stream and fix import older version jar in the standalone module 2015-12-03 16:59:38 -08:00
SunZhaonan
5946f355ff Fix multithread caused default database id bug 2015-12-01 16:39:58 -08:00
SunZhaonan
9a315a7f57 Merge pull request #2 from SunZhaonan/master
Exclude tests that need configurations
2015-11-19 15:03:14 -08:00
SunZhaonan
b83c0a4322 Exclude tests that need configurations 2015-11-19 14:56:20 -08:00
SunZhaonan
d5c3d87d00 Initial commit 2015-11-19 14:39:21 -08:00
SunZhaonan
ec440f09a2 first commit 2015-11-18 10:10:04 -08:00