yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-08-19 22:58:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
97 Commits 251 Branches 123 Tags
Commit Graph

30 Commits

Author SHA1 Message Date
SunZhaonan
5e9ae37952 Change to multi processing instead of multi thread. Fix hive ETL bug 2016-02-29 16:37:03 -08:00
SunZhaonan
8a76f9f931 Move test config file to a external file 2016-02-29 16:37:03 -08:00
SunZhaonan
4574e89de9 Fix bug of sample data schema inconsistant. Add clean up. Parameterize number of Actor 2016-02-22 17:40:07 -08:00
Zhaonan Sun
8921cc0375 Merge pull request #33 from SunZhaonan/master 
Parameterize dataset source derived process. Fix bug in API. Exclude conf file when build.
 2016-02-18 16:45:45 -08:00
Eric Sun
dea72d3e5e Update and rename downloadYourExtraLibHere.md to readme.md 2016-02-17 21:24:16 -08:00
SunZhaonan
01b62763b7 Exclude test configuration file when build 2016-02-17 17:20:36 -08:00
SunZhaonan
dfeefba213 Parameterize dataset source derived process. 2016-02-17 16:06:24 -08:00
SunZhaonan
de4d4cd0c1 Add documentation on important Constants and Classes 2016-02-12 16:57:12 -08:00
Eric Sun
28cd729716 refactor: configuration 
change application.conf - rename entry to dataset.hdfs_browser.link
 2016-02-10 15:39:45 -08:00
SunZhaonan
b5d7c38b7d Eclipse integration. Resolve circular dependency. wherehows-common-test configure. 2016-02-09 15:50:49 -08:00
SunZhaonan
c3da00003e Fix bugs. Reenforce logging. Format jython scripts. Add missing table DDL. 2016-02-03 19:22:18 -08:00
SunZhaonan
32e2547035 Add license to the new files 2015-12-21 14:10:30 -08:00
SunZhaonan
0eddd8accf close connection appropriatly, minior fix 2015-12-21 12:07:08 -08:00
SunZhaonan
05d54b3070 Add Hive metadata ETL process 2015-12-21 12:07:08 -08:00
Zhen Chen
7fca60a527 add ref flow id for sub flow jobs 2015-12-17 16:26:15 -08:00
Zhen Chen
d6f77a6f06 fix ldap org hierachy is empty bug and minor changes 2015-12-16 17:01:55 -08:00
SunZhaonan
cd44daba5d Merge with master 2015-12-16 15:54:50 -08:00
Zhen Chen
9ebe0b22ad move close connection into finally block 2015-12-16 14:47:03 -08:00
SunZhaonan
57a09c64f6 Format sql 2015-12-16 12:10:06 -08:00
SunZhaonan
7bf3ecdb4a Change flowPath, jobName format. 
Fix sql nullable value comparison bug.
Formating.
 2015-12-15 17:15:43 -08:00
Zhen Chen
3c51365e12 parse the xml format of gitorious project page instead of the html page 2015-12-15 11:44:05 -08:00
SunZhaonan
07c46304b5 Fix bug of duplicate field loading. Fix bug of subflow process in azkaban lineage ETL. 2015-12-11 19:46:35 -08:00
Zhen Chen
e21a6b8e75 remove unused variable, change load script and add etl type in backend service 2015-12-11 13:52:23 -08:00
Zhen Chen
af04ff6efc add git file commit history etl 2015-12-11 11:02:29 -08:00
Zhen Chen
ebbf9ec629 add ldap user and group metadata etl 2015-12-10 16:26:57 -08:00
Zhen Chen
5a08134b8d add dataset owner metadata etl 2015-12-07 15:17:01 -08:00
Zhen Chen
5bfb5adb71 close input stream and fix import older version jar in the standalone module 2015-12-03 16:59:38 -08:00
SunZhaonan
5946f355ff Fix multithread caused default database id bug 2015-12-01 16:39:58 -08:00
SunZhaonan
b83c0a4322 Exclude tests that need configurations 2015-11-19 14:56:20 -08:00
SunZhaonan
d5c3d87d00 Initial commit 2015-11-19 14:39:21 -08:00