12076 Commits

Author SHA1 Message Date
Kerem Sahin
e8ada47d61 Fix autocomplete on origin/platform fields for dataset search 2019-12-12 11:27:29 -08:00
Kerem Sahin
0ff23e62d1 Set linkedin.internal flag to false to disable 2FA banner 2019-12-12 10:48:02 -08:00
Kerem Sahin
4691a7493e
Add note about Java 8 dependency 2019-12-11 19:53:34 -08:00
Chris Lee
cb60ad8d45 Merge branch 'datahub' of https://github.com/linkedin/WhereHows into datahub 2019-12-09 12:10:21 -08:00
Chris Lee
e7ec56096a Provided primitive fieldPaths against the platform. 2019-12-09 12:07:03 -08:00
Kerem Sahin
b7f305cbb4 Stop using PaginationContext 2019-12-05 11:20:50 -08:00
Kerem Sahin
c302cd592f Move DatasetBrowseConfig to gms/impl 2019-12-05 10:37:45 -08:00
Kerem Sahin
6b137a862b Removing unnecessary classes for mxe-registration 2019-12-04 17:53:19 -08:00
Chris Lee
250ced5eeb Introduced RDBMS ETL as a metadata ingestion example. 2019-12-04 16:47:31 -08:00
Kerem Sahin
1a16f5fb2a Remove unused dataset models v0.2.0-alpha 2019-12-02 12:15:17 -08:00
Chris Lee
f5e497274f Enabled local user requirement installation. 2019-11-27 09:15:35 -08:00
Kerem Sahin
1c35fe5b7d
Neo4j graph query is now being used for finding downstream datasets use case 2019-11-27 00:53:50 -08:00
Kerem Sahin
8c0e5a2eb0 Use graph to get downstream dataset relationships instead of search index 2019-11-27 00:51:28 -08:00
Kerem Sahin
7e2e6b5c93 Enable datahub-mae-consumer job to build graph as well 2019-11-26 22:19:46 -08:00
Kerem Sahin
22eefc966b Rename ElasticSearchStreamTask to MaeStreamTask 2019-11-20 18:22:54 -08:00
Kerem Sahin
c64c5d384d Rename elasticsearch-index-job to mae-consumer-job 2019-11-20 18:19:31 -08:00
Kerem Sahin
f9be551feb Add docker-compose scripts for Neo4j 2019-11-20 18:05:33 -08:00
Kerem Sahin
88778d8cf5 Add creation of default user to MySQL initialization 2019-11-20 00:52:54 -08:00
Kerem Sahin
7d4a1456af Increase timeout for kafka-setup to 60 seconds 2019-11-19 23:37:26 -08:00
Kerem Sahin
c766165b84 Adding missing CorpGroupSearchDaoFactory 2019-11-19 14:09:19 -08:00
Kerem Sahin
e905822034 Fix some changes which came with automatic commit 2019-11-19 03:08:00 -08:00
Kerem Sahin
e2ad0f2adf corp-identity-gms 1.0.26 -> 1.0.40:
1.0.34: Downrank inactive users in user search query
    1.0.33: Refactor clients to remove snapshot builder
    1.0.32: Adding client & integration test for get_all
    1.0.30: Implement other clients for corp groups
    1.0.28: Add resources for search and autocomplete for corp groups
    1.0.27: Start using BaseClient from metadata-models
    1.0.26: Add get_all resource for CorpUsers

metadata-models 38.1.12 -> 50.0.6:
    50.0.2: Fix removed field update logic for all entities
    49.0.1: Add dataset graph builder with DownstreamOf relationship
    48.0.3: support query dao with traverse paths
    47.0.2: refactor the query dao with relationship filter model
    47.0.1: Fix for creating duplicate nodes when label for the node is missing
   46.0.21: extend filter model with relationship direction
   46.0.19: add unit test for entities partial update
   46.0.16: Allow relationship filter in the model and query dao
   46.0.15: support relationship directions for multi hop query
   46.0.14: Implementing reportsto relationship builder and corpuser graph builder
   46.0.10: refactor query dao interface using nullable to replace optional
    46.0.9: Rename Mock Utils to Test Utils in Metadata-models mp
    46.0.6: Remove search index config from metadata models
    46.0.2: neo4j query DAO with relationships directions support
    45.1.7: refactoring the graph relationship builders
    45.1.5: Use correct total count in search response
    45.1.3: Fix issue with empty search query filter
    45.1.2: Fix a bug with autocomplete limit param
    45.0.3: Change platform field type in the dataset search document
    45.0.2: implement multi hops query DAO with interface 5
    45.0.1: Moving dataset browsePaths build logic from wherehows-samza
    44.0.2: implement interface 2 in query DAO
    40.0.2: Only return records which exist in the DB after getting search hits
    39.0.0: Add a getAuditor method to BaseSnapshotResource rather than taking it in as a constructor argument
   38.1.13: Move BaseClient to metadata-models out of GMS template
   38.1.12: Remove default filtering on removed field for get_all

MP_VERSION=corp-identity-gms:1.0.40
MP_VERSION=metadata-models:50.0.6
MP_VERSION=wherehows-samza:1.0.56

This commit is automatically generated by li-opensource tool.
2019-11-19 02:27:28 -08:00
Chris Lee
89c6e35502 Performed --user flag to avoid the permission issue on requirement installation. 2019-11-13 17:01:32 -08:00
Kerem Sahin
d8dfa2ddf0
Add install requirements step in the quickstart section 2019-11-13 15:10:22 -08:00
Kerem Sahin
bae624eaf3 Move init commands out of Dockerfile and put it inside docker-compose.yml and increase timeout for datahub-gms to 240s 2019-11-12 19:13:56 -08:00
Kerem Sahin
4500e9ce7b Set Elasticsearch Docker container max heap size to 1GB and increase timeout to 120s for Elasticsearch to be ready 2019-11-12 18:13:37 -08:00
Kerem Sahin
8ff0b954ca
Update quickstart section in README.md 2019-11-11 12:38:05 -08:00
Chris Lee
1d6484da60 Released mySQL ETL in metadata-ingestion. 2019-10-24 05:17:28 -07:00
Mars Lan
5193304678 Update build.gradle 2019-10-22 10:45:14 -07:00
Mars Lan
8956ed89c4 Set Java 8 compatibility in gradle 2019-10-22 10:45:14 -07:00
Mars Lan
3a57d324ad
Update README.md 2019-10-21 05:47:17 -07:00
Seyi Adebajo
46c55c2635
Merge pull request #1506 from theseyi/datahub
Remove local facet construction for platform and origin autocomplete …
2019-10-16 20:03:51 -07:00
Seyi Adebajo
1119f4b28b Remove local facet construction for platform and origin autocomplete facets, update tests for autocomplete platform and origin 2019-10-16 16:15:59 -07:00
Kerem Sahin
3b27762d12 Remove unused data models 2019-10-08 18:28:24 -07:00
Seyi Adebajo
f3727edaac
Merge pull request #1503 from theseyi/datahub
Reverts accidental deletion of tests/acceptance/login-test.js, refact…
2019-10-07 16:05:40 -07:00
Kerem Sahin
77bb9b93db Update travis configuration to optimize build time 2019-10-07 15:38:12 -07:00
Seyi Adebajo
8f1f786e2a Miscellaneous fixes from last meeting on OSS 2019-10-07 12:08:35 -07:00
Seyi Adebajo
95cc71d407 Reverts accidental deletion of tests/acceptance/login-test.js, refactors and converts to ts 2019-10-07 09:39:23 -07:00
Kerem Sahin
bb38a9467a Add --build flag when using docker-compose up to always build elasticsearch-setup image 2019-10-05 15:28:54 -07:00
Kerem Sahin
b48ea27c26 Bump docker image versions to latest in quickstart after fixing issues 2019-10-05 15:28:12 -07:00
Kerem Sahin
d4df2b3e12 Removed unused data models 2019-10-05 15:20:58 -07:00
Kerem Sahin
d3e2ab2bf8 Remove unused search templates & configs 2019-10-04 19:28:11 -07:00
Kerem Sahin
9878cfe632 corp-identity-gms 1.0.25 -> 1.0.26:
1.0.26: Add get_all resource for CorpUsers

metadata-models 38.1.8 -> 38.1.12:
   38.1.12: Remove default filtering on removed field for get_all
   38.1.11: Add index builders for datasets and corp groups
    38.1.8: Add getFilter method as a search util

MP_VERSION=corp-identity-gms:1.0.26
MP_VERSION=metadata-models:38.1.12
MP_VERSION=wherehows-samza:1.0.31
2019-10-04 19:22:34 -07:00
Kerem Sahin
878cb6dde2 Get overwritten changes back 2019-10-03 19:27:41 -07:00
Kerem Sahin
c65a65c0b7 Update corp user search index mapping 2019-10-03 19:26:28 -07:00
Kerem Sahin
54270f12f0 Rename serach query templates for dataset search 2019-10-03 19:25:57 -07:00
Kerem Sahin
201f2e0fb5 Changed dependency versions of Data Hub Docker images to release-0.1.1-alpha in quickstart docker-compose 2019-10-03 13:44:19 -07:00
Kerem Sahin
f29a88c365 metadata-models 38.1.6 -> 38.1.8:
38.1.8: Add getFilter method as a search util
    38.1.7: Add index builder for corp groups

MP_VERSION=corp-identity-gms:1.0.25
MP_VERSION=metadata-models:38.1.8
MP_VERSION=wherehows-samza:1.0.30

This commit is automaticaly generated by li-opensource tool.
2019-10-02 18:04:53 -07:00
Kerem Sahin
8e809e383d Fix Kafka topic names 2019-10-02 16:28:03 -07:00
Kerem Sahin
9f4e6320c5 Fix case bug for CorpUser search bean 2019-10-02 15:56:37 -07:00