264 Commits

Author SHA1 Message Date
Arun Vasudevan
9f119d3898
feat: Enable Failed Metadata Change Event for MCE Processor (#1575)
* feat: Enable Failed Metadata Change Event for MCE Processor

No Failed MCE was sent when a MCE was rejected by the system
- Added FailedMetadataChangeEvent kafka topic
- Created FailedMCE event from the MCE record
- Added Kafka Producer to send FailedMCE to the FailedMetadataChangeEvent Topic

* fix: Review Comment
- Added Nonnull Annotations
- Made Local variables as final

* bug: added pegasus2avro test json

- Added pegasus2avro test fmce json

* feat: Add Tests for Event Utils Avro2pegasusfmce

- Added Tests for avro2Pegasusfmce
2020-02-26 14:18:08 -08:00
Kerem Sahin
b17b91f24a Bump gradle to 5.6.4 and pegasus to 27.7.18 2020-02-12 17:10:49 -08:00
Kerem Sahin
6c99764fb1 Rename elasticsearch-index to mae-consumer in MaeStreamTask 2019-12-19 17:46:19 -08:00
Kerem Sahin
165d4aef95 Documentation update part-1 2019-12-18 18:57:18 -08:00
Kerem Sahin
8c0e5a2eb0 Use graph to get downstream dataset relationships instead of search index 2019-11-27 00:51:28 -08:00
Kerem Sahin
7e2e6b5c93 Enable datahub-mae-consumer job to build graph as well 2019-11-26 22:19:46 -08:00
Kerem Sahin
22eefc966b Rename ElasticSearchStreamTask to MaeStreamTask 2019-11-20 18:22:54 -08:00
Kerem Sahin
c64c5d384d Rename elasticsearch-index-job to mae-consumer-job 2019-11-20 18:19:31 -08:00
Kerem Sahin
8e809e383d Fix Kafka topic names 2019-10-02 16:28:03 -07:00
Kerem Sahin
6716e38279 Update documentation 2019-09-09 01:45:49 -07:00
Kerem Sahin
0dc5bd9fe0 Add documentation 2019-09-08 20:25:58 -07:00
Kerem Sahin
e9c557f0e3 Start reading configuration from environment variables for mce-consumer 2019-09-08 00:07:02 -07:00
Kerem Sahin
2584793cb5 Start reading configuration from environment variables for mae-consumer 2019-09-07 23:38:56 -07:00
Kerem Sahin
23339df23a Initial commit for Data Hub 2019-08-31 20:51:14 -07:00