* implement search feature
* add test for dataprocessIndexBuilder; refactor code based on feedback
* update based on PR feedback
* Update DataProcessDocument.pdl
fixed typo wording.
* add not null check for data process info
* add job info as aspect of a dataset
* add job urn def., aspect and entity
* job entity with upstream and downstream lineage
* use job urn in upstream & downstream
* add Job entity rest APIs
* rest.li api, impl and factory for job entity
* code cleanup
* use pdl; onboard data process entity
* add es index json
* fix gradlew build ignored tasks
* add a comment about data process info field
* fix style warning issues
* update content based on PR
* checked in generated snapshot json
* updated based on PR feedback
* update data process data format
* updated based on code review feedback
* revert back gms & mce-job docker image
* delete temp files
* update based pr feedback
* file name and a typo
* format with linkedin style
Co-authored-by: Liangjun <liajiang@expediagroup.com>
58.0.1: Remove all keys that can be moved back to respective GMS
58.0.0: Revert "Reverting the commit range: f0c894b490d3df047837cf2fb7b9911c86188cae..4b5f31ed8844f818d7db0880d30c8dc8c7ac0087."
57.0.16: Reverting the commit range: f0c894b490d3df047837cf2fb7b9911c86188cae..4b5f31ed8844f818d7db0880d30c8dc8c7ac0087.
57.0.15: Disable filtering removed entities in browse until META-10900 is solved
57.0.14: (resubmit) add graph index builder for ai-metadata entities and relationships
57.0.13: Reverting the commit range: 830e63b4b40cf701db216952c34d731a7a82ea1d..4255871452062c2fd14651cb4fffb7d337bad300.
57.0.12: add graph index builder for ai-metadata entities and relationships
57.0.11: Fix bug which sets removed field to always true while building DatasetDocument
57.0.10: Change p12 file name to new ina group name
57.0.9: Add removal field in field compliance to flag the proposal as removal or not.
57.0.8: Adding action Builder for DatasetInstance entity
57.0.7: Adding GMA entities and relations for GridWorkflow and GridWorkflowExecution
57.0.6: Adding dataType and dataClassification to the search document
57.0.5: Rename graph entity MlTrainedModel to MlTrainedModelEntity
57.0.4: Code to form the FollowedBy Graph based on the Follow Aspect
57.0.3: add graph entity and relationship models for ai-metadata
57.0.2: Refactor incorrect use of mock in variable names
57.0.1: Add support for <, <=, >, >= conditions for the filter API
57.0.0: Update Conditions model for <, <=, >, >= conditions
56.0.5: update version of pegasus metadata plugin
56.0.4: update container dependency
56.0.3: Move mlFeatures from SnapshotRequestBuilders to ActionRequestbuilder
56.0.2: Adding reserved versions aspect
56.0.1: Create search filter for compliance pending review proposal.
56.0.0: Add Likes aspect resource in metadata restli utils
55.0.6: Fix a bug with getAll API
55.0.5: Move applicable metadata-store SnapshotRequestBuilders to ActionRequestbuilder
55.0.4: EspressoDAO: Updated to expect a separator between entityType and aspectName for config mapping keys
55.0.3: Added EspressoRecordSerializer and EspressoDAOUtils
55.0.2: Rewrote EspressoLocalDAOTest with a mocked EspressoAccessor
55.0.1: Migrate metric-gms SnapshotRequestBuilders to ActionRequestBuilder
55.0.0: [Wormhole] Deprecate Holdem-centric locations in favor of the more general CORP locations, which contain Holdem.
54.0.1: Migrate job-gms SnapshotRequestBuilders to ActionRequestBuilder
wherehows-samza 1.0.56 -> 1.0.56:
1.0.56: Gradle5 migration
MP_VERSION=metadata-models:58.0.1
MP_VERSION=wherehows-samza:1.0.56
This commit is automatically generated by li-opensource tool.
1.0.34: Downrank inactive users in user search query
1.0.33: Refactor clients to remove snapshot builder
1.0.32: Adding client & integration test for get_all
1.0.30: Implement other clients for corp groups
1.0.28: Add resources for search and autocomplete for corp groups
1.0.27: Start using BaseClient from metadata-models
1.0.26: Add get_all resource for CorpUsers
metadata-models 38.1.12 -> 50.0.6:
50.0.2: Fix removed field update logic for all entities
49.0.1: Add dataset graph builder with DownstreamOf relationship
48.0.3: support query dao with traverse paths
47.0.2: refactor the query dao with relationship filter model
47.0.1: Fix for creating duplicate nodes when label for the node is missing
46.0.21: extend filter model with relationship direction
46.0.19: add unit test for entities partial update
46.0.16: Allow relationship filter in the model and query dao
46.0.15: support relationship directions for multi hop query
46.0.14: Implementing reportsto relationship builder and corpuser graph builder
46.0.10: refactor query dao interface using nullable to replace optional
46.0.9: Rename Mock Utils to Test Utils in Metadata-models mp
46.0.6: Remove search index config from metadata models
46.0.2: neo4j query DAO with relationships directions support
45.1.7: refactoring the graph relationship builders
45.1.5: Use correct total count in search response
45.1.3: Fix issue with empty search query filter
45.1.2: Fix a bug with autocomplete limit param
45.0.3: Change platform field type in the dataset search document
45.0.2: implement multi hops query DAO with interface 5
45.0.1: Moving dataset browsePaths build logic from wherehows-samza
44.0.2: implement interface 2 in query DAO
40.0.2: Only return records which exist in the DB after getting search hits
39.0.0: Add a getAuditor method to BaseSnapshotResource rather than taking it in as a constructor argument
38.1.13: Move BaseClient to metadata-models out of GMS template
38.1.12: Remove default filtering on removed field for get_all
MP_VERSION=corp-identity-gms:1.0.40
MP_VERSION=metadata-models:50.0.6
MP_VERSION=wherehows-samza:1.0.56
This commit is automatically generated by li-opensource tool.
38.1.8: Add getFilter method as a search util
38.1.7: Add index builder for corp groups
MP_VERSION=corp-identity-gms:1.0.25
MP_VERSION=metadata-models:38.1.8
MP_VERSION=wherehows-samza:1.0.30
This commit is automaticaly generated by li-opensource tool.
1.0.24: Corp user search across teams and skills
1.0.21: Make /corpGroups /gridUsers /gridGroups extend BaseEntityResource
1.0.17: Use correct util function to load resource file
1.0.16: Add ingest, backfill & getSnapshot action methods to all top-level resources in corp-identity-gms
1.0.13: Onboard search query templates on corp-identity-gms
1.0.9: Fix batch get and add client for batch get
1.0.8: Change package name for corpuser search config
1.0.7: Use search config to get autocomplete field
1.0.6: Implement searchable client
1.0.5: Auto-complete backend support
1.0.3: Add search API
metadata-models 24.0.0 -> 38.1.6:
38.1.3: Index active status to corp user search index
38.1.2: Change update response to create response for create API
38.0.10: Mark BaseAspectResource as deprecated
38.0.9: Allow TYPEREF items which have primitive types for arrays in models
38.0.7: Add get-and-set-if-absent function to Local DAO
38.0.6: Add find entities with one relationship in query dao
38.0.4: Fix the inconsistency use of constants and urn params in query dao
38.0.2: Parse source map to obtain the urn
38.0.1: Search document validator in Index Builder
38.0.0: Add urns to search result metadata
37.0.7: Refactor the query dao
37.0.6: Use test models in neo4j dao
37.0.5: Drop metadata model structural assumptions made in neo4j DAOs
37.0.2: Return empty list from getBrowsePaths if browsePaths field doesn't exist
36.0.3: Drop elasticsearch-dao's metadata-models dependency
35.0.10: ES Search DAO to handle null values
35.0.5: Ebean local Dao query string match
35.0.4: Drop all search & browse configs that have been moved to individual GMS
35.0.3: Add ReportTo relationship model
35.0.0: Load resource file properly
34.0.9: Make RestliAuditor injectable
34.0.8: Use encoded query in the test resource
34.0.4: Handle empty aspects param correctly for backfill & getSnapshot actions
34.0.1: Remove corp user specific files from metadata-models
34.0.0: Add backfill & getSnapshot actions to BaseEntityResource
32.0.16: Merge data template classes into metadata-dao's main artifact
32.0.14: Replace "update" method with "ingest" action in BaseEntityResource
32.0.13: Make fliter & sortCriteria parameters optional as they should have been
32.0.12: Move AspectVersion & SnapshotKey back to their original namespaces
32.0.11: Break metadata-dao's dependency on metadata-models
32.0.10: Move model validators to a separate module
32.0.9: Extract principal from the request context for user AuditStamp
32.0.8: Fixing nullability annotations for search/autocomplete/browse resources & daos
32.0.7: Move DAO-specific models to metadata-dao module
32.0.4: Fix search finder not returning total search results count
32.0.3: Implement get_all using search index
32.0.2: Add missing nullability annotation
32.0.1: Use more consistent naming for the test models
31.0.1: Use test-specific metadata models in metadata-dao
31.0.0: Add sort order to Search Dao
30.0.2: Rename Aspect test model to AspectUnion to avoid confusion
30.0.1: Committing migration for metadata-models.
30.0.0: Add default autocomplete field in search config
29.0.16: Modify testcase to account for empty filters
29.0.15: Add searchable interface that clients can use
29.0.14: Use test-specific metadata models in ebean-dao
29.0.12: Move TestUtils to metadata-test-models module
29.0.11: Refactor all tests in metadata-restli to use test models
29.0.10: Move li-metadata-test-utils, metadata-test-models, metadata-test-utils into a new metadata-testing directory to improve code organization.
Note that this is a backward compatible change as this doesn't alter the produced artifacts.
29.0.9: Move test-specific models to a stand-alone module
29.0.2: Refactor the rest of validators
28.0.3: Refactor validateSchema for aspect
28.0.2: Implement searchDao for CorpUserInfo.
27.0.16: Refactor for ModelValidation tests
27.0.10: Add new relationship union to model utils
27.0.9: Add plugin to rest client factory
27.0.6: Add rest high level factory
27.0.5: Fix a test bug when reviewing the code
27.0.4: Add create via lambda API to BaseVersionedAspectResource
27.0.2: Change return type of search finder to capture search result metadata in BaseSearchableEntityResource
27.0.1: Drop the unnecessary get method from BaseEntityResource
27.0.0: Add BaseBrowsableEntityResource
26.0.15: Add autocomplete action to BaseSearchableEntityResource
26.0.14: Add BaseSearchableEntityResource
26.0.13: Add getUrnFromDocument & urnClassForDocument util methods that are needed in future RBs
26.0.11: Add BaseVersionedAspectResource
26.0.9: Index signals associated with dataset relevance
26.0.4: Support namespace for ID generation
26.0.1: Fix inconsistent instance variable naming in SearchResult
25.0.6: Add entity-snapshot conversion
25.0.5: Use test-specific metadata models in metadata-restli
25.0.3: Add aspect filtering to BaseEntityResource
24.0.9: Add update method to BaseEntityResource
24.0.7: Fix for parameter types of getBrowsePaths action method
MP_VERSION=corp-identity-gms:1.0.25
MP_VERSION=metadata-models:38.1.6
MP_VERSION=wherehows-samza:1.0.29
