Yi (Alan) Wang
|
5c8a029d69
|
remove wherehows-common from wherehows-ingestion dependency (#1378)
|
2018-09-12 17:12:23 -07:00 |
|
Yi (Alan) Wang
|
ffa80b8b9f
|
Move kafka processors to module wherehows-ingestion (#1377)
|
2018-09-12 12:08:52 -07:00 |
|
Yi (Alan) Wang
|
3db6a1f460
|
Add deployment when saving schema from MCE (#1366)
|
2018-09-07 11:42:06 -07:00 |
|
Yi (Alan) Wang
|
021ee00c7b
|
Add MCE actor in MIE processor (#1300)
|
2018-08-06 15:21:18 -07:00 |
|
Yi (Alan) Wang
|
b6347971fc
|
Modigy MCE processor log info (#1285)
|
2018-08-01 14:14:51 -07:00 |
|
Yi (Alan) Wang
|
a7a3a16236
|
MCE processor take Retention first with fallback to Compliance PurgePolicy (#1261)
|
2018-07-18 12:03:49 -07:00 |
|
Yi (Alan) Wang
|
d22383240f
|
Discard MLE when job status not SUCCEEDED, instead of throwing exception (#1245)
|
2018-06-29 15:50:23 -07:00 |
|
Yi (Alan) Wang
|
00ad604db3
|
Prefer auditstamp actor over agent for MLE actor (#1244)
|
2018-06-29 15:13:14 -07:00 |
|
Yi (Alan) Wang
|
2c1e1fa240
|
MIE consumer to use platform specific listName API (#1214)
|
2018-06-18 15:41:11 -07:00 |
|
Yi (Alan) Wang
|
5e7a4c414e
|
MCE processor to update dataset deployment info (#1212)
|
2018-06-18 13:22:07 -07:00 |
|
Yi (Alan) Wang
|
af0840f11a
|
Add dedupe and modify validation in MLE processor (#1204)
|
2018-06-12 16:07:22 -07:00 |
|
Yi (Alan) Wang
|
fdc3ba03d1
|
Refactor MIE consumer to be used in Samza (#1203)
|
2018-06-12 15:58:33 -07:00 |
|
Yi (Alan) Wang
|
3f6fa2d092
|
Fix hibernate config, make MXE processor public (#1162)
|
2018-05-14 17:15:19 -07:00 |
|
Yi (Alan) Wang
|
3b88be4a30
|
Modify dependencies and versions, tune log for MLE (#1157)
* Modify dependencies and versions
* Tune the log for MLE
|
2018-05-14 13:46:53 -07:00 |
|
Yi (Alan) Wang
|
241b8e8570
|
make MXE processing function public (#1152)
|
2018-05-10 16:01:23 -07:00 |
|
Andrew Park
|
3134709a26
|
Accept MLE event - SUCCEEDED job status (#1070)
|
2018-04-05 10:17:55 -07:00 |
|
Yi (Alan) Wang
|
9f05a96478
|
Move exceptions in wherehows-common (#1052)
|
2018-03-22 14:44:51 -07:00 |
|
Mars Lan
|
1ebba29d97
|
Handle the case when whitelist is empty string properly (#979)
|
2018-02-20 17:02:54 -08:00 |
|
Mars Lan
|
782b125884
|
Move getWhitelistedActors from KafkaMessageProcessor to ProcessorUtil and add tests (#976)
|
2018-02-20 14:27:15 -08:00 |
|
Yi (Alan) Wang
|
b81e3e82da
|
Minor modification on v2 API (#973)
|
2018-02-20 11:56:37 -08:00 |
|
Mars Lan
|
6fe1f268cf
|
Validate linage and throws exception on self lineage (#971)
Make Kafka processors testable
|
2018-02-16 16:17:03 -08:00 |
|
Yi (Alan) Wang
|
477a89c9ed
|
Add MIE consumer (#960)
|
2018-02-08 16:26:50 -08:00 |
|
Yi (Alan) Wang
|
06ccf1c99d
|
Fix MCE null pointer when dataset is null (#955)
|
2018-02-01 14:24:44 -08:00 |
|
Yi (Alan) Wang
|
31bd6f7da1
|
Add Kafka log compation converter (#939)
|
2018-01-18 17:38:13 -08:00 |
|
mars-lan
|
78413e56c0
|
Add and throw explicit UnauthoriazedException for whiltelist check
|
2018-01-16 18:07:08 -08:00 |
|
Yi (Alan) Wang
|
0cd9d68258
|
Use changeAuditStamp for MCE/MLE whitelist validation (#928)
|
2018-01-05 11:21:56 -08:00 |
|
Yi (Alan) Wang
|
7274eaf0ae
|
Add whitelist for kafka processor (#927)
|
2018-01-03 16:21:40 -08:00 |
|
Yi (Alan) Wang
|
67913fd752
|
Support MCE save Schemaless (#908)
|
2017-12-10 11:47:50 -08:00 |
|
Yi (Alan) Wang
|
c9cd9b3676
|
Support MCE dataset remove (#906)
|
2017-12-08 18:22:27 -08:00 |
|
Yi (Alan) Wang
|
cb034c4cae
|
Add Lineage agent to MLE processor (#889)
|
2017-12-01 14:15:13 -08:00 |
|
Yi (Alan) Wang
|
a12b7dfbe1
|
Fix MCE processor now that Schema may have two types (#885)
|
2017-11-29 17:07:49 -08:00 |
|
Mars Lan
|
94a9c02d32
|
Downgrade spammy log messages to debug (#877)
|
2017-11-21 16:08:41 -08:00 |
|
Andrew Park
|
7bae62c6b0
|
Adding invalid MLE event handler and unknown dataset method def. (#876)
* adding MLE processor and rely on operators
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
Improves SQL coding style 2nd
* Fixed merging issues
* fixed RB comment
* Fixed typo for MetadataLineageProcessor comment
* remove an empty line
|
2017-11-21 10:03:05 -08:00 |
|
Mars Lan
|
65cf843236
|
Fix a few low-hanging findbugs issues (#862)
|
2017-11-15 17:50:56 -08:00 |
|
Andrew Park
|
c870d598ce
|
Added a metadata lineage processor and a MetadataLineageEvent.avsc (#841)
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
|
2017-11-08 11:06:22 -08:00 |
|
Mars Lan
|
931a866972
|
Handle deserialization error gracefully (#839)
|
2017-11-03 16:23:56 -07:00 |
|
Mars Lan
|
d31832fd18
|
Divert failed-to-process MCEs to a different topic (#837)
|
2017-11-03 11:12:54 -07:00 |
|
Yi (Alan) Wang
|
f2c90c57bd
|
Move Offset by 1 when kafka consumer poll error (#836)
|
2017-11-02 11:41:11 -07:00 |
|
Yi (Alan) Wang
|
a6b726d26c
|
Remove kafka Gobblin event and processor (#835)
|
2017-11-01 15:32:19 -07:00 |
|
Mars Lan
|
250393833c
|
Change the limit from 500 to 400 characters for dataset names (#813)
|
2017-10-20 16:39:11 -07:00 |
|
Mars Lan
|
32d565a3ff
|
Allow configuring the number of workers for each kafka consumer job. (#810)
|
2017-10-20 11:18:35 -07:00 |
|
Yi (Alan) Wang
|
916e2a940d
|
Modify BaseDao, add dataset name length check (#806)
|
2017-10-18 15:01:19 -07:00 |
|
Yi Wang
|
e738179eea
|
Fix FieldDAO for null feild schema
|
2017-10-13 18:25:36 -07:00 |
|
Yi (Alan) Wang
|
74f4aa2cb5
|
Adjust logging level for kafka consumer (#794)
|
2017-10-13 15:09:07 -07:00 |
|
Yi (Alan) Wang
|
50e37279c6
|
Add compliance to MCE processor (#786)
|
2017-10-05 09:43:40 -07:00 |
|
Yi (Alan) Wang
|
53a6caec15
|
Modify MCE procesor (#782)
|
2017-10-03 18:16:57 -07:00 |
|
Yi (Alan) Wang
|
6895423498
|
Update Field detail and Owner Dao (#770)
|
2017-09-28 09:28:24 -07:00 |
|
Yi (Alan) Wang
|
fce70ebe25
|
Update MCE processor (#764)
|
2017-09-25 17:22:04 -07:00 |
|
Yi (Alan) Wang
|
3a16b6e280
|
Refactor BaseDao to add generic functions (#749)
|
2017-09-14 15:41:44 -07:00 |
|
Mars Lan
|
7f01b017c2
|
Cut down log spam by doing info level logging (#746)
|
2017-09-13 15:46:07 -07:00 |
|