Arun Vasudevan
9f119d3898
feat: Enable Failed Metadata Change Event for MCE Processor ( #1575 )
...
* feat: Enable Failed Metadata Change Event for MCE Processor
No Failed MCE was sent when a MCE was rejected by the system
- Added FailedMetadataChangeEvent kafka topic
- Created FailedMCE event from the MCE record
- Added Kafka Producer to send FailedMCE to the FailedMetadataChangeEvent Topic
* fix: Review Comment
- Added Nonnull Annotations
- Made Local variables as final
* bug: added pegasus2avro test json
- Added pegasus2avro test fmce json
* feat: Add Tests for Event Utils Avro2pegasusfmce
- Added Tests for avro2Pegasusfmce
2020-02-26 14:18:08 -08:00
Kerem Sahin
73173a6a29
Change mysql data source URL to suppress server identity verification warning
2020-02-06 17:36:56 -08:00
Kerem Sahin
c009326bae
Fix lowercase_keyword analyzer settings for people entity
2020-02-06 01:39:05 -08:00
Kerem Sahin
e56b6a2871
Add forward slash escape for Elasticsearch queries
2020-02-05 19:05:49 -08:00
Kerem Sahin
c8576ba503
Add some debuggin help & update default profile image link
2020-01-27 15:59:34 -08:00
Arun Vasudevan
55e17e64ef
Minor Documentation Fixes
2020-01-10 15:48:46 -08:00
Chris Lee
244271b578
Enabled ingestion docker.
2020-01-02 14:18:37 -08:00
Kerem Sahin
165d4aef95
Documentation update part-1
2019-12-18 18:57:18 -08:00
Chris Lee
f344b31f49
Built docker-compose in mce ingestion.
2019-12-16 17:44:12 -08:00
Chris Lee
00612524b4
Brought up ingestion docker image.
2019-12-16 12:06:25 -08:00
Kerem Sahin
8c0e5a2eb0
Use graph to get downstream dataset relationships instead of search index
2019-11-27 00:51:28 -08:00
Kerem Sahin
7e2e6b5c93
Enable datahub-mae-consumer job to build graph as well
2019-11-26 22:19:46 -08:00
Kerem Sahin
c64c5d384d
Rename elasticsearch-index-job to mae-consumer-job
2019-11-20 18:19:31 -08:00
Kerem Sahin
f9be551feb
Add docker-compose scripts for Neo4j
2019-11-20 18:05:33 -08:00
Kerem Sahin
88778d8cf5
Add creation of default user to MySQL initialization
2019-11-20 00:52:54 -08:00
Kerem Sahin
7d4a1456af
Increase timeout for kafka-setup to 60 seconds
2019-11-19 23:37:26 -08:00
Kerem Sahin
bae624eaf3
Move init commands out of Dockerfile and put it inside docker-compose.yml and increase timeout for datahub-gms to 240s
2019-11-12 19:13:56 -08:00
Kerem Sahin
4500e9ce7b
Set Elasticsearch Docker container max heap size to 1GB and increase timeout to 120s for Elasticsearch to be ready
2019-11-12 18:13:37 -08:00
Kerem Sahin
bb38a9467a
Add --build flag when using docker-compose up to always build elasticsearch-setup image
2019-10-05 15:28:54 -07:00
Kerem Sahin
b48ea27c26
Bump docker image versions to latest in quickstart after fixing issues
2019-10-05 15:28:12 -07:00
Kerem Sahin
c65a65c0b7
Update corp user search index mapping
2019-10-03 19:26:28 -07:00
Kerem Sahin
201f2e0fb5
Changed dependency versions of Data Hub Docker images to release-0.1.1-alpha in quickstart docker-compose
2019-10-03 13:44:19 -07:00
Kerem Sahin
ea15628912
Add upstreams field to dataset search index mapping
2019-09-26 20:54:03 -07:00
Kerem Sahin
28b876f323
Update docs: No need for running initialization script for creating search indices
2019-09-12 19:06:35 -07:00
Kerem Sahin
1a3ddff4a4
Creating an image for elasticsearch-setup to automatically create indices
2019-09-12 19:04:29 -07:00
Kerem Sahin
1bf0ff72b4
Doc update: adding docker-compose pull before up to always get the latest version of images
2019-09-10 17:51:17 -07:00
Kerem Sahin
6716e38279
Update documentation
2019-09-09 01:45:49 -07:00
Kerem Sahin
0dc5bd9fe0
Add documentation
2019-09-08 20:25:58 -07:00
Kerem Sahin
e3e6dc1d30
Remove kafka rest-proxy container which is not required
2019-09-08 01:10:38 -07:00
Kerem Sahin
9f43305fe9
Add mce-consumer to quickstart docker-compose
2019-09-08 00:57:04 -07:00
Kerem Sahin
b82cb7df69
Add dependency to kafka-setup container for mae-consumer job
2019-09-08 00:56:31 -07:00
Kerem Sahin
fea754c5be
Implement docker build & docker-compose for mce-consumer job
2019-09-08 00:54:03 -07:00
Kerem Sahin
3a5e34d744
Add mae-consumer to quickstart docker-compose
2019-09-07 23:44:41 -07:00
Kerem Sahin
9090ac48d1
Implement docker build & docker-compose for mae-consumer job
2019-09-07 23:43:33 -07:00
Kerem Sahin
958c376354
Bump confluent kafka images to 5.3.0 and create another container for Kafka topics initialization
2019-09-07 23:41:59 -07:00
Kerem Sahin
a67bf284fa
Fix quickstart docker-compose by setting renamed environment variables
2019-09-04 20:31:56 -07:00
Kerem Sahin
7cbd728bd3
No need to use wait-for-it for datahub-frontend Docker container
2019-09-04 20:30:37 -07:00
Kerem Sahin
4eaf86c0dd
Rename environment variables for datahub-frontend
2019-09-04 20:29:36 -07:00
Kerem Sahin
6b230872a4
Fix dockerbuild & docker-compose for datahub-gms and start using Dockerize instead of wait-for-it for orchestration
2019-09-04 20:27:11 -07:00
Kerem Sahin
2a5a375c0b
Start using community edition of confluent's kafka docker image
2019-09-03 18:37:33 -07:00
Kerem Sahin
7fd197657b
Pass updated environment variables to datahub-gms docker container
2019-09-03 12:56:20 -07:00
Kerem Sahin
09eec752c0
Make datahub-gms docker container wait for Elasticserch & Kafka broker containers
2019-09-03 12:55:28 -07:00
Kerem Sahin
140dfaf990
Fix docker build for datahub-frontend by adding JAVA_OPTS environment variable
2019-09-03 10:38:13 -07:00
Kerem Sahin
ecb8486f4f
Fix docker compose for datahub-frontend by initializing required environment variables
2019-09-03 03:02:23 -07:00
Kerem Sahin
a10f59be45
Fix docker build for datahub-frontend by adding command line arguments to run command
2019-09-03 03:01:21 -07:00
Kerem Sahin
5827401c25
Fix docker build for datahub-frontend by adding chrome install before build
2019-09-03 00:46:12 -07:00
Kerem Sahin
e07c397b82
Add docker compose for datahub-frontend
2019-09-02 23:21:37 -07:00
Kerem Sahin
d00edf1f79
Add docker build file for datahub-frontend
2019-09-02 23:21:01 -07:00
Kerem Sahin
121af11ad2
Fix GMS docker compose file by removing dependencies
2019-09-02 18:35:32 -07:00
Kerem Sahin
bf3de63a03
Remove src folder after build for GMS docker build to optimize docker image size
2019-09-02 18:34:47 -07:00
