Mars Lan
|
1ebba29d97
|
Handle the case when whitelist is empty string properly (#979)
|
2018-02-20 17:02:54 -08:00 |
|
Mars Lan
|
782b125884
|
Move getWhitelistedActors from KafkaMessageProcessor to ProcessorUtil and add tests (#976)
|
2018-02-20 14:27:15 -08:00 |
|
Yi (Alan) Wang
|
b81e3e82da
|
Minor modification on v2 API (#973)
|
2018-02-20 11:56:37 -08:00 |
|
Mars Lan
|
6fe1f268cf
|
Validate linage and throws exception on self lineage (#971)
Make Kafka processors testable
|
2018-02-16 16:17:03 -08:00 |
|
Yi (Alan) Wang
|
477a89c9ed
|
Add MIE consumer (#960)
|
2018-02-08 16:26:50 -08:00 |
|
Yi (Alan) Wang
|
06ccf1c99d
|
Fix MCE null pointer when dataset is null (#955)
|
2018-02-01 14:24:44 -08:00 |
|
Yi (Alan) Wang
|
31bd6f7da1
|
Add Kafka log compation converter (#939)
|
2018-01-18 17:38:13 -08:00 |
|
mars-lan
|
78413e56c0
|
Add and throw explicit UnauthoriazedException for whiltelist check
|
2018-01-16 18:07:08 -08:00 |
|
Yi (Alan) Wang
|
0cd9d68258
|
Use changeAuditStamp for MCE/MLE whitelist validation (#928)
|
2018-01-05 11:21:56 -08:00 |
|
Yi (Alan) Wang
|
7274eaf0ae
|
Add whitelist for kafka processor (#927)
|
2018-01-03 16:21:40 -08:00 |
|
Yi (Alan) Wang
|
67913fd752
|
Support MCE save Schemaless (#908)
|
2017-12-10 11:47:50 -08:00 |
|
Yi (Alan) Wang
|
c9cd9b3676
|
Support MCE dataset remove (#906)
|
2017-12-08 18:22:27 -08:00 |
|
Yi (Alan) Wang
|
cb034c4cae
|
Add Lineage agent to MLE processor (#889)
|
2017-12-01 14:15:13 -08:00 |
|
Yi (Alan) Wang
|
a12b7dfbe1
|
Fix MCE processor now that Schema may have two types (#885)
|
2017-11-29 17:07:49 -08:00 |
|
Mars Lan
|
94a9c02d32
|
Downgrade spammy log messages to debug (#877)
|
2017-11-21 16:08:41 -08:00 |
|
Andrew Park
|
7bae62c6b0
|
Adding invalid MLE event handler and unknown dataset method def. (#876)
* adding MLE processor and rely on operators
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
Improves SQL coding style 2nd
* Fixed merging issues
* fixed RB comment
* Fixed typo for MetadataLineageProcessor comment
* remove an empty line
|
2017-11-21 10:03:05 -08:00 |
|
Mars Lan
|
65cf843236
|
Fix a few low-hanging findbugs issues (#862)
|
2017-11-15 17:50:56 -08:00 |
|
Andrew Park
|
c870d598ce
|
Added a metadata lineage processor and a MetadataLineageEvent.avsc (#841)
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
|
2017-11-08 11:06:22 -08:00 |
|
Mars Lan
|
931a866972
|
Handle deserialization error gracefully (#839)
|
2017-11-03 16:23:56 -07:00 |
|
Mars Lan
|
d31832fd18
|
Divert failed-to-process MCEs to a different topic (#837)
|
2017-11-03 11:12:54 -07:00 |
|
Yi (Alan) Wang
|
f2c90c57bd
|
Move Offset by 1 when kafka consumer poll error (#836)
|
2017-11-02 11:41:11 -07:00 |
|
Yi (Alan) Wang
|
a6b726d26c
|
Remove kafka Gobblin event and processor (#835)
|
2017-11-01 15:32:19 -07:00 |
|
Mars Lan
|
250393833c
|
Change the limit from 500 to 400 characters for dataset names (#813)
|
2017-10-20 16:39:11 -07:00 |
|
Mars Lan
|
32d565a3ff
|
Allow configuring the number of workers for each kafka consumer job. (#810)
|
2017-10-20 11:18:35 -07:00 |
|
Yi (Alan) Wang
|
916e2a940d
|
Modify BaseDao, add dataset name length check (#806)
|
2017-10-18 15:01:19 -07:00 |
|
Yi Wang
|
e738179eea
|
Fix FieldDAO for null feild schema
|
2017-10-13 18:25:36 -07:00 |
|
Yi (Alan) Wang
|
74f4aa2cb5
|
Adjust logging level for kafka consumer (#794)
|
2017-10-13 15:09:07 -07:00 |
|
Yi (Alan) Wang
|
50e37279c6
|
Add compliance to MCE processor (#786)
|
2017-10-05 09:43:40 -07:00 |
|
Yi (Alan) Wang
|
53a6caec15
|
Modify MCE procesor (#782)
|
2017-10-03 18:16:57 -07:00 |
|
Yi (Alan) Wang
|
6895423498
|
Update Field detail and Owner Dao (#770)
|
2017-09-28 09:28:24 -07:00 |
|
Yi (Alan) Wang
|
fce70ebe25
|
Update MCE processor (#764)
|
2017-09-25 17:22:04 -07:00 |
|
Yi (Alan) Wang
|
3a16b6e280
|
Refactor BaseDao to add generic functions (#749)
|
2017-09-14 15:41:44 -07:00 |
|
Mars Lan
|
7f01b017c2
|
Cut down log spam by doing info level logging (#746)
|
2017-09-13 15:46:07 -07:00 |
|
Mars Lan
|
9f7341f542
|
Clean up the log4j vs slf4j mess and consolidate the dependency resolution into a gradle script (#745)
|
2017-09-13 15:37:29 -07:00 |
|
Yi (Alan) Wang
|
fbf518d9ee
|
Remove obsolete kafka processors and actors (#737)
|
2017-09-11 17:46:32 -07:00 |
|
Yi (Alan) Wang
|
55e26e8508
|
Remove unused avro schemas, move avro resolution (#735)
|
2017-09-11 16:37:32 -07:00 |
|
Yi (Alan) Wang
|
d2a3fe58db
|
Add schema and generated java to data model, refactor Gobblin audit processor (#732)
|
2017-09-11 15:26:06 -07:00 |
|
Mars Lan
|
6e87040768
|
Check the existence of dataset based on URN before creating new ones (#733)
|
2017-09-08 17:55:01 -07:00 |
|
Yi (Alan) Wang
|
d1e53c765f
|
Rewrite Kafka client master and worker (#731)
|
2017-09-07 17:48:39 -07:00 |
|
Yi (Alan) Wang
|
e0e2acf6bf
|
Move JobsUtil to WH common, fix some tests (#730)
|
2017-09-06 11:45:52 -07:00 |
|
Mars Lan
|
26015aee8a
|
Leave the actor system running continuously instead of killing it (#729)
|
2017-09-06 11:00:06 -07:00 |
|
Mars Lan
|
862b893d6e
|
Write PID to the path specified by pidfile.path system property. (#727)
|
2017-09-05 14:05:13 -07:00 |
|
Yi (Alan) Wang
|
cd5f72b7ee
|
Rename DAO and model into table and view sub-package (#722)
|
2017-09-05 09:59:35 -07:00 |
|
hzhang2
|
d4ab77677f
|
move DB call from main class to kafka consumer master
|
2017-08-31 10:28:38 -07:00 |
|
hzhang2
|
4b57ab898a
|
remove empty lines, unused dependecy/ logic
|
2017-08-23 13:10:32 -07:00 |
|
hzhang2
|
7145edee92
|
pull changes from origin
|
2017-08-22 22:39:09 -07:00 |
|
hzhang2
|
7c87b89e73
|
refactor based on comments
|
2017-08-22 22:35:27 -07:00 |
|
hzhang2
|
2ca851753a
|
remove backend changes for this PR
|
2017-08-22 22:35:27 -07:00 |
|