Arun Vasudevan
9f119d3898
feat: Enable Failed Metadata Change Event for MCE Processor ( #1575 )
...
* feat: Enable Failed Metadata Change Event for MCE Processor
No Failed MCE was sent when a MCE was rejected by the system
- Added FailedMetadataChangeEvent kafka topic
- Created FailedMCE event from the MCE record
- Added Kafka Producer to send FailedMCE to the FailedMetadataChangeEvent Topic
* fix: Review Comment
- Added Nonnull Annotations
- Made Local variables as final
* bug: added pegasus2avro test json
- Added pegasus2avro test fmce json
* feat: Add Tests for Event Utils Avro2pegasusfmce
- Added Tests for avro2Pegasusfmce
2020-02-26 14:18:08 -08:00
Kerem Sahin
73173a6a29
Change mysql data source URL to suppress server identity verification warning
2020-02-06 17:36:56 -08:00
Kerem Sahin
165d4aef95
Documentation update part-1
2019-12-18 18:57:18 -08:00
Kerem Sahin
8c0e5a2eb0
Use graph to get downstream dataset relationships instead of search index
2019-11-27 00:51:28 -08:00
Kerem Sahin
7e2e6b5c93
Enable datahub-mae-consumer job to build graph as well
2019-11-26 22:19:46 -08:00
Kerem Sahin
c64c5d384d
Rename elasticsearch-index-job to mae-consumer-job
2019-11-20 18:19:31 -08:00
Kerem Sahin
f9be551feb
Add docker-compose scripts for Neo4j
2019-11-20 18:05:33 -08:00
Kerem Sahin
7d4a1456af
Increase timeout for kafka-setup to 60 seconds
2019-11-19 23:37:26 -08:00
Kerem Sahin
bae624eaf3
Move init commands out of Dockerfile and put it inside docker-compose.yml and increase timeout for datahub-gms to 240s
2019-11-12 19:13:56 -08:00
Kerem Sahin
4500e9ce7b
Set Elasticsearch Docker container max heap size to 1GB and increase timeout to 120s for Elasticsearch to be ready
2019-11-12 18:13:37 -08:00
Kerem Sahin
bb38a9467a
Add --build flag when using docker-compose up to always build elasticsearch-setup image
2019-10-05 15:28:54 -07:00
Kerem Sahin
b48ea27c26
Bump docker image versions to latest in quickstart after fixing issues
2019-10-05 15:28:12 -07:00
Kerem Sahin
201f2e0fb5
Changed dependency versions of Data Hub Docker images to release-0.1.1-alpha in quickstart docker-compose
2019-10-03 13:44:19 -07:00
Kerem Sahin
28b876f323
Update docs: No need for running initialization script for creating search indices
2019-09-12 19:06:35 -07:00
Kerem Sahin
1a3ddff4a4
Creating an image for elasticsearch-setup to automatically create indices
2019-09-12 19:04:29 -07:00
Kerem Sahin
1bf0ff72b4
Doc update: adding docker-compose pull before up to always get the latest version of images
2019-09-10 17:51:17 -07:00
Kerem Sahin
6716e38279
Update documentation
2019-09-09 01:45:49 -07:00
Kerem Sahin
0dc5bd9fe0
Add documentation
2019-09-08 20:25:58 -07:00
Kerem Sahin
e3e6dc1d30
Remove kafka rest-proxy container which is not required
2019-09-08 01:10:38 -07:00
Kerem Sahin
9f43305fe9
Add mce-consumer to quickstart docker-compose
2019-09-08 00:57:04 -07:00
Kerem Sahin
b82cb7df69
Add dependency to kafka-setup container for mae-consumer job
2019-09-08 00:56:31 -07:00
Kerem Sahin
3a5e34d744
Add mae-consumer to quickstart docker-compose
2019-09-07 23:44:41 -07:00
Kerem Sahin
958c376354
Bump confluent kafka images to 5.3.0 and create another container for Kafka topics initialization
2019-09-07 23:41:59 -07:00
Kerem Sahin
a67bf284fa
Fix quickstart docker-compose by setting renamed environment variables
2019-09-04 20:31:56 -07:00
Kerem Sahin
2a5a375c0b
Start using community edition of confluent's kafka docker image
2019-09-03 18:37:33 -07:00
Kerem Sahin
7fd197657b
Pass updated environment variables to datahub-gms docker container
2019-09-03 12:56:20 -07:00
Kerem Sahin
ecb8486f4f
Fix docker compose for datahub-frontend by initializing required environment variables
2019-09-03 03:02:23 -07:00
Kerem Sahin
e07c397b82
Add docker compose for datahub-frontend
2019-09-02 23:21:37 -07:00
Kerem Sahin
3f4048e2a7
Add docker compose for GMS and update other docker compose files
2019-09-02 16:44:34 -07:00
Kerem Sahin
23339df23a
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
