26 Commits

Author SHA1 Message Date
Mars Lan
250393833c Change the limit from 500 to 400 characters for dataset names (#813) 2017-10-20 16:39:11 -07:00
Mars Lan
32d565a3ff Allow configuring the number of workers for each kafka consumer job. (#810) 2017-10-20 11:18:35 -07:00
Yi (Alan) Wang
916e2a940d Modify BaseDao, add dataset name length check (#806) 2017-10-18 15:01:19 -07:00
Yi Wang
e738179eea Fix FieldDAO for null feild schema 2017-10-13 18:25:36 -07:00
Yi (Alan) Wang
74f4aa2cb5 Adjust logging level for kafka consumer (#794) 2017-10-13 15:09:07 -07:00
Yi (Alan) Wang
50e37279c6 Add compliance to MCE processor (#786) 2017-10-05 09:43:40 -07:00
Yi (Alan) Wang
53a6caec15 Modify MCE procesor (#782) 2017-10-03 18:16:57 -07:00
Yi (Alan) Wang
6895423498 Update Field detail and Owner Dao (#770) 2017-09-28 09:28:24 -07:00
Yi (Alan) Wang
fce70ebe25 Update MCE processor (#764) 2017-09-25 17:22:04 -07:00
Yi (Alan) Wang
3a16b6e280 Refactor BaseDao to add generic functions (#749) 2017-09-14 15:41:44 -07:00
Mars Lan
7f01b017c2 Cut down log spam by doing info level logging (#746) 2017-09-13 15:46:07 -07:00
Mars Lan
9f7341f542 Clean up the log4j vs slf4j mess and consolidate the dependency resolution into a gradle script (#745) 2017-09-13 15:37:29 -07:00
Yi (Alan) Wang
fbf518d9ee Remove obsolete kafka processors and actors (#737) 2017-09-11 17:46:32 -07:00
Yi (Alan) Wang
55e26e8508 Remove unused avro schemas, move avro resolution (#735) 2017-09-11 16:37:32 -07:00
Yi (Alan) Wang
d2a3fe58db Add schema and generated java to data model, refactor Gobblin audit processor (#732) 2017-09-11 15:26:06 -07:00
Mars Lan
6e87040768 Check the existence of dataset based on URN before creating new ones (#733) 2017-09-08 17:55:01 -07:00
Yi (Alan) Wang
d1e53c765f Rewrite Kafka client master and worker (#731) 2017-09-07 17:48:39 -07:00
Yi (Alan) Wang
e0e2acf6bf Move JobsUtil to WH common, fix some tests (#730) 2017-09-06 11:45:52 -07:00
Mars Lan
26015aee8a Leave the actor system running continuously instead of killing it (#729) 2017-09-06 11:00:06 -07:00
Mars Lan
862b893d6e Write PID to the path specified by pidfile.path system property. (#727) 2017-09-05 14:05:13 -07:00
Yi (Alan) Wang
cd5f72b7ee Rename DAO and model into table and view sub-package (#722) 2017-09-05 09:59:35 -07:00
hzhang2
d4ab77677f move DB call from main class to kafka consumer master 2017-08-31 10:28:38 -07:00
hzhang2
4b57ab898a remove empty lines, unused dependecy/ logic 2017-08-23 13:10:32 -07:00
hzhang2
7145edee92 pull changes from origin 2017-08-22 22:39:09 -07:00
hzhang2
7c87b89e73 refactor based on comments 2017-08-22 22:35:27 -07:00
hzhang2
2ca851753a remove backend changes for this PR 2017-08-22 22:35:27 -07:00