3044 Commits

Author SHA1 Message Date
Kerem Sahin
339c9bea86 Update default pictureLink 2019-09-16 15:55:11 -07:00
Chris Lee
493cbe16d6 Added the runbook for the requirements.txt. 2019-09-16 13:27:16 -07:00
Chris Lee
bd32ec20a1 Supplied the requirements.txt for metadata-ingestion. 2019-09-16 13:13:42 -07:00
Chris Lee
81a38f87f7 Classified the ETL jobs in metadata-ingestion. 2019-09-16 12:52:37 -07:00
Kerem Sahin
28b876f323 Update docs: No need for running initialization script for creating search indices 2019-09-12 19:06:35 -07:00
Kerem Sahin
1a3ddff4a4 Creating an image for elasticsearch-setup to automatically create indices 2019-09-12 19:04:29 -07:00
Chris Lee
430f13108d Enabled the configuration lists in the LDAP ETL. 2019-09-12 10:16:41 -07:00
Chris Lee
9df9d336c9 Ingested metadata from LDAP server to Data Hub. 2019-09-10 18:58:22 -07:00
Kerem Sahin
1bf0ff72b4 Doc update: adding docker-compose pull before up to always get the latest version of images 2019-09-10 17:51:17 -07:00
Kerem Sahin
c365c406e1 Normalize browse paths for datasets 2019-09-10 15:14:40 -07:00
Kerem Sahin
6716e38279 Update documentation 2019-09-09 01:45:49 -07:00
Kerem Sahin
8bfb086e09 Set displayName fields for corp user MCEs 2019-09-09 00:31:09 -07:00
Kerem Sahin
822dc22d8e Add pictureLink to DatasetOwner view 2019-09-08 23:59:25 -07:00
Kerem Sahin
fcd1b46f41 Add dataset urn to dataset client API value model 2019-09-08 23:02:44 -07:00
Kerem Sahin
0dc5bd9fe0 Add documentation 2019-09-08 20:25:58 -07:00
Kerem Sahin
693ee97c6c Fix ingestion script by pointing to correct MCE schema
Refactor for metadata-ingestion module
Adding readme for metadata-ingestion
2019-09-08 05:27:19 -07:00
Kerem Sahin
e3e6dc1d30 Remove kafka rest-proxy container which is not required 2019-09-08 01:10:38 -07:00
Kerem Sahin
9f43305fe9 Add mce-consumer to quickstart docker-compose 2019-09-08 00:57:04 -07:00
Kerem Sahin
b82cb7df69 Add dependency to kafka-setup container for mae-consumer job 2019-09-08 00:56:31 -07:00
Kerem Sahin
fea754c5be Implement docker build & docker-compose for mce-consumer job 2019-09-08 00:54:03 -07:00
Kerem Sahin
e9c557f0e3 Start reading configuration from environment variables for mce-consumer 2019-09-08 00:07:02 -07:00
Kerem Sahin
3a5e34d744 Add mae-consumer to quickstart docker-compose 2019-09-07 23:44:41 -07:00
Kerem Sahin
9090ac48d1 Implement docker build & docker-compose for mae-consumer job 2019-09-07 23:43:33 -07:00
Kerem Sahin
958c376354 Bump confluent kafka images to 5.3.0 and create another container for Kafka topics initialization 2019-09-07 23:41:59 -07:00
Kerem Sahin
2584793cb5 Start reading configuration from environment variables for mae-consumer 2019-09-07 23:38:56 -07:00
Kerem Sahin
cc93351b63 Bump kafka-clients & kafka-streams to 2.3.0 2019-09-07 23:35:23 -07:00
Chris Lee
fd7350decc Resolved union type in avro serialization. 2019-09-05 14:27:59 -07:00
Ignacio Bona
2d4cd66354 Minor and conf fixes 2019-09-05 10:53:55 -07:00
Ignacio Bona
e207d31729 fix image 2019-09-04 22:02:08 -07:00
Ignacio Bona
e2f985a298 Manual merge with more internal changes 2019-09-04 21:46:33 -07:00
Kerem Sahin
a67bf284fa Fix quickstart docker-compose by setting renamed environment variables 2019-09-04 20:31:56 -07:00
Kerem Sahin
7cbd728bd3 No need to use wait-for-it for datahub-frontend Docker container 2019-09-04 20:30:37 -07:00
Kerem Sahin
4eaf86c0dd Rename environment variables for datahub-frontend 2019-09-04 20:29:36 -07:00
Kerem Sahin
6b230872a4 Fix dockerbuild & docker-compose for datahub-gms and start using Dockerize instead of wait-for-it for orchestration 2019-09-04 20:27:11 -07:00
Kerem Sahin
7a09f49396 Rename environment variables & start reading environment variables using Spring's @Value annotation 2019-09-04 20:24:52 -07:00
Kerem Sahin
3f92af3928 Bump spring dependency to 5.1.6 2019-09-04 20:19:45 -07:00
Kerem Sahin
2a5a375c0b Start using community edition of confluent's kafka docker image 2019-09-03 18:37:33 -07:00
Kerem Sahin
d49c9af486 Simplify travis build configuration 2019-09-03 14:59:19 -07:00
Kerem Sahin
7fd197657b Pass updated environment variables to datahub-gms docker container 2019-09-03 12:56:20 -07:00
Kerem Sahin
09eec752c0 Make datahub-gms docker container wait for Elasticserch & Kafka broker containers 2019-09-03 12:55:28 -07:00
Kerem Sahin
1b703191b1 Add back gms.properties (ignoreIfNotExists) to enable Dockerless deployment of datahub-gms 2019-09-03 12:53:03 -07:00
Kerem Sahin
a3c78b7311 Bump spring framework to 4.1.9 2019-09-03 12:24:08 -07:00
Kerem Sahin
140dfaf990 Fix docker build for datahub-frontend by adding JAVA_OPTS environment variable 2019-09-03 10:38:13 -07:00
Kerem Sahin
ecb8486f4f Fix docker compose for datahub-frontend by initializing required environment variables 2019-09-03 03:02:23 -07:00
Kerem Sahin
a10f59be45 Fix docker build for datahub-frontend by adding command line arguments to run command 2019-09-03 03:01:21 -07:00
Kerem Sahin
657a7afc9a Merge branch 'datahub' of https://github.com/linkedin/WhereHows into datahub 2019-09-03 00:46:19 -07:00
Kerem Sahin
5827401c25 Fix docker build for datahub-frontend by adding chrome install before build 2019-09-03 00:46:12 -07:00
Kerem Sahin
4ef22927df
Add docker build status badge to main README for datahub-frontend docker image build 2019-09-02 23:30:01 -07:00
Kerem Sahin
c750acf4a4 Merge branch 'datahub' of https://github.com/linkedin/WhereHows into datahub 2019-09-02 23:21:44 -07:00
Kerem Sahin
e07c397b82 Add docker compose for datahub-frontend 2019-09-02 23:21:37 -07:00