80 Commits

Author SHA1 Message Date
Yi (Alan) Wang
793fd05821
Add optional flags in compliance field (#996) 2018-02-27 11:18:33 -08:00
Yi (Alan) Wang
1ea4137238
Add decommissionTime to dataset deprecation (#994) 2018-02-26 11:07:35 -08:00
Yi (Alan) Wang
0b1c840230
Fix get schema nullpointer issue (#989) 2018-02-22 09:00:44 -08:00
Yi (Alan) Wang
ed8ba02bed
Made deprecation note nonnull (#982) 2018-02-21 15:51:20 -08:00
Yi (Alan) Wang
b81e3e82da
Minor modification on v2 API (#973) 2018-02-20 11:56:37 -08:00
Yi (Alan) Wang
bbbbfbe4ed
Migrate frontend v2 APIs using urn (#964) 2018-02-14 13:07:26 -08:00
Yi (Alan) Wang
477a89c9ed
Add MIE consumer (#960) 2018-02-08 16:26:50 -08:00
Yi (Alan) Wang
d6d4b8f574
Modify frontend v2 APIs for datasets (#958) 2018-02-07 17:17:13 -08:00
Yi (Alan) Wang
06ccf1c99d
Fix MCE null pointer when dataset is null (#955) 2018-02-01 14:24:44 -08:00
Mars Lan
5987ab5ed0
Update MCE schema and test (#954) 2018-02-01 11:12:59 -08:00
Yi (Alan) Wang
aebb2797d5
Add refresh the dataset Property in MCE, and fix tests (#947) 2018-01-24 15:05:24 -08:00
Yi (Alan) Wang
675a8e0f68
Add V2 API for counting total datasets (#938) 2018-01-18 10:53:00 -08:00
Yi (Alan) Wang
b1f237393e
Modify list datasets API to return pagination info (#936) 2018-01-18 08:31:31 -08:00
Yi (Alan) Wang
603f20eecf
Add dataset listNames and searchPrefix function in v2 API (#934) 2018-01-12 17:44:08 -08:00
Yi (Alan) Wang
0cd9d68258
Use changeAuditStamp for MCE/MLE whitelist validation (#928) 2018-01-05 11:21:56 -08:00
Yi (Alan) Wang
afa73045e9
Add support for nonOwner flag in compliance field (#913) 2017-12-11 19:03:56 -08:00
Yi (Alan) Wang
67913fd752
Support MCE save Schemaless (#908) 2017-12-10 11:47:50 -08:00
Yi (Alan) Wang
c9cd9b3676
Support MCE dataset remove (#906) 2017-12-08 18:22:27 -08:00
Yi (Alan) Wang
83a1082b93
Add FE API for getting all compliance types and platforms (#905) 2017-12-08 14:09:27 -08:00
Yi (Alan) Wang
031db4f657
Add schemaless in FE columns API response (#895) 2017-12-05 15:06:13 -08:00
Yi (Alan) Wang
cb034c4cae
Add Lineage agent to MLE processor (#889) 2017-12-01 14:15:13 -08:00
Yi (Alan) Wang
e4c9915953
Add containingPersonalData to Compliance API (#888) 2017-11-30 16:50:54 -08:00
Yi (Alan) Wang
bd5f95e964
Fix duplicate fields if having multiple comments (#884) 2017-11-28 10:28:33 -08:00
Andrew Park
7bae62c6b0 Adding invalid MLE event handler and unknown dataset method def. (#876)
* adding MLE processor and rely on operators

* adding MLE processor and rely on operators

* Added Lineage Processor impl. and Kafka Event avro schema

Improves SQL coding style 2nd

* Fixed merging issues

* fixed RB comment

* Fixed typo for MetadataLineageProcessor comment

* remove an empty line
2017-11-21 10:03:05 -08:00
Yi (Alan) Wang
66dd83f165
Move owner types API to DAO module (#875) 2017-11-17 14:22:55 -08:00
Yi (Alan) Wang
0b9262eaba
Modify owners and compliance API exceptions (#858) 2017-11-13 17:11:45 -08:00
Yi (Alan) Wang
0eca55bcff
Mark DatasetProperty nullable (#848) 2017-11-08 18:10:57 -08:00
Andrew Park
c870d598ce Added a metadata lineage processor and a MetadataLineageEvent.avsc (#841)
* adding MLE processor and rely on operators
* Added Lineage Processor impl. and Kafka Event avro schema
2017-11-08 11:06:22 -08:00
Yi (Alan) Wang
0a9461b49e Fix issue when compliance POST doesn't have modified time (#823) 2017-10-26 14:48:12 -07:00
Yi (Alan) Wang
f18ddd92b5 Fix MCE to DB owner categroy mapping (#820) 2017-10-25 14:47:02 -07:00
Yi (Alan) Wang
d466cb8cb3 Update compliance purge in MCE (#817) 2017-10-24 16:05:49 -07:00
Yi (Alan) Wang
cb82e36948 Fix bug in Dict dataset source (#816) 2017-10-24 13:00:47 -07:00
Yi (Alan) Wang
cfb29deb68 Add dataset deprecation frontend API (#812) 2017-10-20 11:16:09 -07:00
Yi (Alan) Wang
be51e6d68e Fix DAO test by removing quotes before comparing json string (#809) 2017-10-19 14:59:25 -07:00
Yi (Alan) Wang
776f83e893 Modify compliance API to access purge note (#807) 2017-10-19 10:26:45 -07:00
Yi (Alan) Wang
916e2a940d Modify BaseDao, add dataset name length check (#806) 2017-10-18 15:01:19 -07:00
Yi Wang
ecbcdd920f Fix issue with ownership null value when writing to DB 2017-10-17 15:24:12 -07:00
Yi (Alan) Wang
7b8715e7ec Modify FE compliance suggestion API response (#800) 2017-10-16 21:34:01 -07:00
Yi (Alan) Wang
48c274ede3 Include findbugs plugin, add nullable annotation to DAO functions (#797) 2017-10-16 16:57:52 -07:00
Yi Wang
e738179eea Fix FieldDAO for null feild schema 2017-10-13 18:25:36 -07:00
Yi (Alan) Wang
74f4aa2cb5 Adjust logging level for kafka consumer (#794) 2017-10-13 15:09:07 -07:00
Shridhar Sattur
2a16298639 Removed all manual logger instantiations with lombok's @Slf4j. (#791) 2017-10-11 15:25:47 -07:00
Yi (Alan) Wang
02d19a26fc Add WH urn split to util (#788) 2017-10-08 17:51:35 -07:00
Yi (Alan) Wang
6aa12ac521 Modify frontend Compliance suggestion API (#787) 2017-10-05 16:47:40 -07:00
Yi (Alan) Wang
50e37279c6 Add compliance to MCE processor (#786) 2017-10-05 09:43:40 -07:00
Yi (Alan) Wang
53a6caec15 Modify MCE procesor (#782) 2017-10-03 18:16:57 -07:00
Yi (Alan) Wang
6895423498 Update Field detail and Owner Dao (#770) 2017-09-28 09:28:24 -07:00
Yi (Alan) Wang
fce70ebe25 Update MCE processor (#764) 2017-09-25 17:22:04 -07:00
Yi (Alan) Wang
69e2d4d7a3 Add Frontend find ID by URN api (#759) 2017-09-20 08:49:31 -07:00
Yi (Alan) Wang
3a16b6e280 Refactor BaseDao to add generic functions (#749) 2017-09-14 15:41:44 -07:00