Kerem Sahin
34d1ba3f63
build(quickstart): Small fix in quickstart.sh & doc update
...
1. Use "source" while executing quickstart.sh to bring env var to the context of calling shell
2. Use sudo while running chown in quickstart.sh
3. Update main readme
4. Add missing container names
2020-03-23 16:11:35 -07:00
Albert Franzi
5ac098fbdd
feature: 🐳 - Allow to store Quickstart dockers data in a folder for persistance ( #1568 )
...
* feature: 🐳 - Allow to store Quickstart dockers data in a folder for persistance
* bump: Update Kafka dockers to 5.4.0
* feature: 🐳 - Add kafka-topics-ui docker to the kafka docker folder
* refactor: Provide a quickstart.sh script to start all dockers
2020-03-23 13:43:51 -07:00
Kerem Sahin
6ab2ab6f78
build(mysql): Change mysql dependency from latest to 5.7
2020-03-22 15:52:31 -07:00
Arun Vasudevan
9f119d3898
feat: Enable Failed Metadata Change Event for MCE Processor ( #1575 )
...
* feat: Enable Failed Metadata Change Event for MCE Processor
No Failed MCE was sent when a MCE was rejected by the system
- Added FailedMetadataChangeEvent kafka topic
- Created FailedMCE event from the MCE record
- Added Kafka Producer to send FailedMCE to the FailedMetadataChangeEvent Topic
* fix: Review Comment
- Added Nonnull Annotations
- Made Local variables as final
* bug: added pegasus2avro test json
- Added pegasus2avro test fmce json
* feat: Add Tests for Event Utils Avro2pegasusfmce
- Added Tests for avro2Pegasusfmce
2020-02-26 14:18:08 -08:00
Kerem Sahin
73173a6a29
Change mysql data source URL to suppress server identity verification warning
2020-02-06 17:36:56 -08:00
Kerem Sahin
165d4aef95
Documentation update part-1
2019-12-18 18:57:18 -08:00
Kerem Sahin
8c0e5a2eb0
Use graph to get downstream dataset relationships instead of search index
2019-11-27 00:51:28 -08:00
Kerem Sahin
7e2e6b5c93
Enable datahub-mae-consumer job to build graph as well
2019-11-26 22:19:46 -08:00
Kerem Sahin
c64c5d384d
Rename elasticsearch-index-job to mae-consumer-job
2019-11-20 18:19:31 -08:00
Kerem Sahin
f9be551feb
Add docker-compose scripts for Neo4j
2019-11-20 18:05:33 -08:00
Kerem Sahin
7d4a1456af
Increase timeout for kafka-setup to 60 seconds
2019-11-19 23:37:26 -08:00
Kerem Sahin
bae624eaf3
Move init commands out of Dockerfile and put it inside docker-compose.yml and increase timeout for datahub-gms to 240s
2019-11-12 19:13:56 -08:00
Kerem Sahin
4500e9ce7b
Set Elasticsearch Docker container max heap size to 1GB and increase timeout to 120s for Elasticsearch to be ready
2019-11-12 18:13:37 -08:00
Kerem Sahin
bb38a9467a
Add --build flag when using docker-compose up to always build elasticsearch-setup image
2019-10-05 15:28:54 -07:00
Kerem Sahin
b48ea27c26
Bump docker image versions to latest in quickstart after fixing issues
2019-10-05 15:28:12 -07:00
Kerem Sahin
201f2e0fb5
Changed dependency versions of Data Hub Docker images to release-0.1.1-alpha in quickstart docker-compose
2019-10-03 13:44:19 -07:00
Kerem Sahin
28b876f323
Update docs: No need for running initialization script for creating search indices
2019-09-12 19:06:35 -07:00
Kerem Sahin
1a3ddff4a4
Creating an image for elasticsearch-setup to automatically create indices
2019-09-12 19:04:29 -07:00
Kerem Sahin
1bf0ff72b4
Doc update: adding docker-compose pull before up to always get the latest version of images
2019-09-10 17:51:17 -07:00
Kerem Sahin
6716e38279
Update documentation
2019-09-09 01:45:49 -07:00
Kerem Sahin
0dc5bd9fe0
Add documentation
2019-09-08 20:25:58 -07:00
Kerem Sahin
e3e6dc1d30
Remove kafka rest-proxy container which is not required
2019-09-08 01:10:38 -07:00
Kerem Sahin
9f43305fe9
Add mce-consumer to quickstart docker-compose
2019-09-08 00:57:04 -07:00
Kerem Sahin
b82cb7df69
Add dependency to kafka-setup container for mae-consumer job
2019-09-08 00:56:31 -07:00
Kerem Sahin
3a5e34d744
Add mae-consumer to quickstart docker-compose
2019-09-07 23:44:41 -07:00
Kerem Sahin
958c376354
Bump confluent kafka images to 5.3.0 and create another container for Kafka topics initialization
2019-09-07 23:41:59 -07:00
Kerem Sahin
a67bf284fa
Fix quickstart docker-compose by setting renamed environment variables
2019-09-04 20:31:56 -07:00
Kerem Sahin
2a5a375c0b
Start using community edition of confluent's kafka docker image
2019-09-03 18:37:33 -07:00
Kerem Sahin
7fd197657b
Pass updated environment variables to datahub-gms docker container
2019-09-03 12:56:20 -07:00
Kerem Sahin
ecb8486f4f
Fix docker compose for datahub-frontend by initializing required environment variables
2019-09-03 03:02:23 -07:00
Kerem Sahin
e07c397b82
Add docker compose for datahub-frontend
2019-09-02 23:21:37 -07:00
Kerem Sahin
3f4048e2a7
Add docker compose for GMS and update other docker compose files
2019-09-02 16:44:34 -07:00
Kerem Sahin
23339df23a
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
