yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-11-03 20:27:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
datahub/settings.gradle

80 lines
3.1 KiB
Groovy
Raw Normal View History

feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'datahub-web-react'
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
include 'datahub-frontend'
feat(GQL Queries): Productionalizing GraphQL Part 1: Dataset Query support + adding shared GraphQL module (#2066) * Productionalizing GraphQL Part 1: Dataset Query support + introducing common datahub-graphql-core module. Co-authored-by: John Joyce <jjoyce0510@gmail.com>
2021-01-22 15:44:00 -08:00
include 'datahub-graphql-core'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'metadata-service:war'
include 'metadata-service:servlet'
include 'metadata-service:factories'
fix(build): rename conflicting module `auth-api` (#6728) * fix(build): rename conflicting module `auth-api`
2022-12-09 18:06:51 -06:00
include 'metadata-service:auth-config'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'metadata-service:auth-impl'
include 'metadata-service:auth-filter'
include 'metadata-service:auth-servlet-impl'
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) (#3131)
2021-08-20 10:58:07 -07:00
include 'metadata-service:restli-api'
feat(auth): view authorization (#10066)
2024-03-23 06:15:36 -05:00
include 'metadata-service:restli-client-api'
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) (#3131)
2021-08-20 10:58:07 -07:00
include 'metadata-service:restli-client'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'metadata-service:restli-servlet-impl'
include 'metadata-service:graphql-servlet-impl'
feat(platform): add timeline api for dataset entity (#4252)
2022-02-24 19:40:55 -08:00
include 'metadata-service:openapi-servlet'
feat(openapi): entity endpoints & analytics raw (#8537)
2023-09-07 17:09:52 -05:00
include 'metadata-service:openapi-entity-servlet'
include 'metadata-service:openapi-entity-servlet:generators'
include 'metadata-service:openapi-analytics-servlet'
feat(gms): Pluggable Authentication & Authorization Framework (#6634)
2022-12-06 23:52:41 +05:30
include 'metadata-service:plugin'
include 'metadata-service:plugin:src:test:sample-test-plugins'
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
include 'metadata-dao-impl:kafka-producer'
feat(avro): upgrade avro to 1.11 (#9031)
2023-10-18 13:45:46 -05:00
include 'metadata-events:mxe-avro'
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
include 'metadata-events:mxe-registration'
include 'metadata-events:mxe-schemas'
feat(avro): upgrade avro to 1.11 (#9031)
2023-10-18 13:45:46 -05:00
include 'metadata-events:mxe-utils-avro'
build(ingest): add metadata-ingestion to gradle build (#2510)
2021-05-06 22:10:49 -07:00
include 'metadata-ingestion'
feat(gms): Merge MAE, MCE consumers into GMS (#2690)
2021-06-15 08:44:15 -07:00
include 'metadata-jobs:mae-consumer'
include 'metadata-jobs:mce-consumer'
feat(metadata service): Introducing Platform Events (#4477)
2022-03-29 18:32:04 -07:00
include 'metadata-jobs:pe-consumer'
Rename elasticsearch-index-job to mae-consumer-job
2019-11-20 18:19:31 -08:00
include 'metadata-jobs:mae-consumer-job'
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
include 'metadata-jobs:mce-consumer-job'
refactor(restli-mce-consumer) (#6744) * fix(security): commons-text in frontend * refactor(restli): set threads based on cpu cores feat(mce-consumers): hit local restli endpoint * testing docker build * Add retry configuration options for entity client * Kafka debugging * fix(kafka-setup): parallelize topic creation * Adjust docker build * Docker build updates * WIP * fix(lint): metadata-ingestion lint * fix(gradle-docker): fix docker frontend dep * fix(elastic): fix race condition between gms and mae for index creation * Revert "fix(elastic): fix race condition between gms and mae for index creation" This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3. * fix(test): fix datahub frontend test for clean/test cycle * fix(test): datahub-frontend missing assets in test * fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer * gitingore update * fix(docker): remove platform on docker base image, set by buildx * refactor(kafka-producer): update kafka producer tracking/logging * updates per PR feedback * Add documentation around mce standalone consumer Kafka consumer concurrency to follow thread count for restli & sql connection pool Co-authored-by: leifker <dleifker@gmail.com> Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 10:09:08 -06:00
include ':docker'
include ':docker:elasticsearch-setup'
include ':docker:mysql-setup'
Dockerize updates (#7387)
2023-02-22 04:13:11 -06:00
include ':docker:postgres-setup'
refactor(restli-mce-consumer) (#6744) * fix(security): commons-text in frontend * refactor(restli): set threads based on cpu cores feat(mce-consumers): hit local restli endpoint * testing docker build * Add retry configuration options for entity client * Kafka debugging * fix(kafka-setup): parallelize topic creation * Adjust docker build * Docker build updates * WIP * fix(lint): metadata-ingestion lint * fix(gradle-docker): fix docker frontend dep * fix(elastic): fix race condition between gms and mae for index creation * Revert "fix(elastic): fix race condition between gms and mae for index creation" This reverts commit 9629d12c3bdb3c0dab87604d409ca4c642c9c6d3. * fix(test): fix datahub frontend test for clean/test cycle * fix(test): datahub-frontend missing assets in test * fix(security): set protobuf lib datahub-upgrade & mce/mae-consumer * gitingore update * fix(docker): remove platform on docker base image, set by buildx * refactor(kafka-producer): update kafka producer tracking/logging * updates per PR feedback * Add documentation around mce standalone consumer Kafka consumer concurrency to follow thread count for restli & sql connection pool Co-authored-by: leifker <dleifker@gmail.com> Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-26 10:09:08 -06:00
include ':docker:kafka-setup'
build(docker): metadata-ingestion images build and add slim version (#7412)
2023-03-20 18:06:35 -05:00
include ':docker:datahub-ingestion'
include ':docker:datahub-ingestion-base'
Initial commit for Data Hub
2019-08-31 20:51:14 -07:00
include 'metadata-models'
feat: No Code Metadata Modeling (#2629) Co-authored-by: Dexter Lee <dexter@acryl.io> Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com> Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
include 'metadata-models-validator'
Fix build after sync. - Add build files for new module. - Correctly edit TestUtils since it isn't synced. - Reference new test utils. - Delete duplicate pdl files. SYNC=metadata-models_100.0.1
2020-09-21 16:50:02 -07:00
include 'metadata-testing:metadata-models-test-utils'
corp-identity-gms 1.0.0 -> 1.0.25: 1.0.24: Corp user search across teams and skills 1.0.21: Make /corpGroups /gridUsers /gridGroups extend BaseEntityResource 1.0.17: Use correct util function to load resource file 1.0.16: Add ingest, backfill & getSnapshot action methods to all top-level resources in corp-identity-gms 1.0.13: Onboard search query templates on corp-identity-gms 1.0.9: Fix batch get and add client for batch get 1.0.8: Change package name for corpuser search config 1.0.7: Use search config to get autocomplete field 1.0.6: Implement searchable client 1.0.5: Auto-complete backend support 1.0.3: Add search API metadata-models 24.0.0 -> 38.1.6: 38.1.3: Index active status to corp user search index 38.1.2: Change update response to create response for create API 38.0.10: Mark BaseAspectResource as deprecated 38.0.9: Allow TYPEREF items which have primitive types for arrays in models 38.0.7: Add get-and-set-if-absent function to Local DAO 38.0.6: Add find entities with one relationship in query dao 38.0.4: Fix the inconsistency use of constants and urn params in query dao 38.0.2: Parse source map to obtain the urn 38.0.1: Search document validator in Index Builder 38.0.0: Add urns to search result metadata 37.0.7: Refactor the query dao 37.0.6: Use test models in neo4j dao 37.0.5: Drop metadata model structural assumptions made in neo4j DAOs 37.0.2: Return empty list from getBrowsePaths if browsePaths field doesn't exist 36.0.3: Drop elasticsearch-dao's metadata-models dependency 35.0.10: ES Search DAO to handle null values 35.0.5: Ebean local Dao query string match 35.0.4: Drop all search & browse configs that have been moved to individual GMS 35.0.3: Add ReportTo relationship model 35.0.0: Load resource file properly 34.0.9: Make RestliAuditor injectable 34.0.8: Use encoded query in the test resource 34.0.4: Handle empty aspects param correctly for backfill & getSnapshot actions 34.0.1: Remove corp user specific files from metadata-models 34.0.0: Add backfill & getSnapshot actions to BaseEntityResource 32.0.16: Merge data template classes into metadata-dao's main artifact 32.0.14: Replace "update" method with "ingest" action in BaseEntityResource 32.0.13: Make fliter & sortCriteria parameters optional as they should have been 32.0.12: Move AspectVersion & SnapshotKey back to their original namespaces 32.0.11: Break metadata-dao's dependency on metadata-models 32.0.10: Move model validators to a separate module 32.0.9: Extract principal from the request context for user AuditStamp 32.0.8: Fixing nullability annotations for search/autocomplete/browse resources & daos 32.0.7: Move DAO-specific models to metadata-dao module 32.0.4: Fix search finder not returning total search results count 32.0.3: Implement get_all using search index 32.0.2: Add missing nullability annotation 32.0.1: Use more consistent naming for the test models 31.0.1: Use test-specific metadata models in metadata-dao 31.0.0: Add sort order to Search Dao 30.0.2: Rename Aspect test model to AspectUnion to avoid confusion 30.0.1: Committing migration for metadata-models. 30.0.0: Add default autocomplete field in search config 29.0.16: Modify testcase to account for empty filters 29.0.15: Add searchable interface that clients can use 29.0.14: Use test-specific metadata models in ebean-dao 29.0.12: Move TestUtils to metadata-test-models module 29.0.11: Refactor all tests in metadata-restli to use test models 29.0.10: Move li-metadata-test-utils, metadata-test-models, metadata-test-utils into a new metadata-testing directory to improve code organization. Note that this is a backward compatible change as this doesn't alter the produced artifacts. 29.0.9: Move test-specific models to a stand-alone module 29.0.2: Refactor the rest of validators 28.0.3: Refactor validateSchema for aspect 28.0.2: Implement searchDao for CorpUserInfo. 27.0.16: Refactor for ModelValidation tests 27.0.10: Add new relationship union to model utils 27.0.9: Add plugin to rest client factory 27.0.6: Add rest high level factory 27.0.5: Fix a test bug when reviewing the code 27.0.4: Add create via lambda API to BaseVersionedAspectResource 27.0.2: Change return type of search finder to capture search result metadata in BaseSearchableEntityResource 27.0.1: Drop the unnecessary get method from BaseEntityResource 27.0.0: Add BaseBrowsableEntityResource 26.0.15: Add autocomplete action to BaseSearchableEntityResource 26.0.14: Add BaseSearchableEntityResource 26.0.13: Add getUrnFromDocument & urnClassForDocument util methods that are needed in future RBs 26.0.11: Add BaseVersionedAspectResource 26.0.9: Index signals associated with dataset relevance 26.0.4: Support namespace for ID generation 26.0.1: Fix inconsistent instance variable naming in SearchResult 25.0.6: Add entity-snapshot conversion 25.0.5: Use test-specific metadata models in metadata-restli 25.0.3: Add aspect filtering to BaseEntityResource 24.0.9: Add update method to BaseEntityResource 24.0.7: Fix for parameter types of getBrowsePaths action method MP_VERSION=corp-identity-gms:1.0.25 MP_VERSION=metadata-models:38.1.6 MP_VERSION=wherehows-samza:1.0.29
2019-10-02 11:08:52 -07:00
include 'metadata-testing:metadata-test-utils'
feat: No Code Metadata Modeling (#2629) Co-authored-by: Dexter Lee <dexter@acryl.io> Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com> Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
include 'entity-registry'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'metadata-io'
feat(plugins): spring custom plugins (#10389) Co-authored-by: Kevin Chun <kevinchun@netflix.com> Co-authored-by: Kevin Chun <kevin1chun@gmail.com>
2024-05-09 14:56:03 -05:00
include 'metadata-io:metadata-io-api'
feat: No Code Metadata Modeling (#2629) Co-authored-by: Dexter Lee <dexter@acryl.io> Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com> Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
include 'datahub-upgrade'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'metadata-utils'
include 'li-utils'
feat: No Code Metadata Modeling (#2629) Co-authored-by: Dexter Lee <dexter@acryl.io> Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com> Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
include 'test-models'
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983) Co-authored-by: Dexter Lee <dexter@acryl.io> Co-authored-by: Harshal Sheth <hsheth2@gmail.com> Co-authored-by: Ravindra Lanka <rlanka@acryl.io> Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
include 'metadata-perf'
feat(auth): Metadata Service Authentication! (#3598)
2021-11-22 16:33:14 -08:00
include 'docs-website'
feat(metadata-service): support for custom model extensions without forks (#3630)
2021-11-28 21:06:27 -08:00
include 'metadata-models-custom'
include 'entity-registry:custom-test-model'
feat(ingest/spark): Promote beta plugin (#10881) Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
include 'metadata-integration:java:spark-lineage-legacy'
feat(datahub-client): add Java REST emitter (#3781)
2022-01-02 22:48:38 +05:30
include 'metadata-integration:java:datahub-client'
feat(plugins): spring custom plugins (#10389) Co-authored-by: Kevin Chun <kevinchun@netflix.com> Co-authored-by: Kevin Chun <kevin1chun@gmail.com>
2024-05-09 14:56:03 -05:00
include 'metadata-integration:java:custom-plugin-lib'
Openlineage endpoint and Spark Lineage Beta Plugin (#9870) Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 16:31:21 +01:00
include 'metadata-integration:java:datahub-event'
feat(ingestion): add java protobuf schema ingestion (#4178) Co-authored-by: leifker <david.leifker@landsend.com>
2022-03-11 12:13:00 -06:00
include 'metadata-integration:java:datahub-protobuf'
Openlineage endpoint and Spark Lineage Beta Plugin (#9870) Co-authored-by: David Leifker <david.leifker@acryl.io>
2024-03-01 16:31:21 +01:00
include 'metadata-integration:java:openlineage-converter'
feat(ingest/spark): Promote beta plugin (#10881) Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
include 'metadata-integration:java:acryl-spark-lineage'
feat(airflow): Airflow lineage ingestion plugin (#4833) feat(airflow): Airflow lineage ingestion plugin (#4833)
2022-05-25 09:12:11 +02:00
include 'ingestion-scheduler'
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms (#4999)
2022-08-01 22:17:08 +05:30
include 'metadata-ingestion-modules:airflow-plugin'
feat: separate great-expectations action package (#11096) Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 21:43:36 +05:30
include 'metadata-ingestion-modules:gx-plugin'
feat(ingest/dagster): Dagster source (#10071) Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com>
2024-03-25 13:28:35 +01:00
include 'metadata-ingestion-modules:dagster-plugin'
fix(ingestion/prefect-plugin): Prefect plugin (#10643) Co-authored-by: shubhamjagtap639 <shubham.jagtap@gslab.com> Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-08-29 15:40:10 +02:00
include 'metadata-ingestion-modules:prefect-plugin'
chore: remove unnecessary modules from codebase (#5420)
2022-07-17 22:02:45 -07:00
include 'smoke-test'
feat(gms): Pluggable Authentication & Authorization Framework (#6634)
2022-12-06 23:52:41 +05:30
include 'metadata-auth:auth-api'
feat(schema-registry): replace confluent schema registry (#7930) Co-authored-by: Pedro Silva <pedro@acryl.io> Co-authored-by: Shirshanka Das <shirshanka@apache.org> Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
include 'metadata-service:schema-registry-api'
include 'metadata-service:schema-registry-servlet'
feat(patch): patch support for flow info and job info and refactor patchbuilders for java sdk (#7495) Co-authored-by: Shirshanka Das <shirshanka@apache.org> Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com> Co-authored-by: David Leifker <david.leifker@acryl.io>
2023-04-13 15:46:35 -05:00
include 'metadata-integration:java:examples'
fix(async): submit additional default aspects only when not in async mode (#8320)
2023-06-30 15:56:12 -05:00
include 'mock-entity-registry'
feat(io): refactor metadata-io module (#8306)
2023-07-19 20:09:14 -05:00
include 'metadata-service:services'
include 'metadata-service:configuration'
feat(kafka): add health indicator for kafka (#9662)
2024-01-19 13:44:48 -06:00
include ':metadata-jobs:common'
feat(search): search access controls (#9892) Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
include ':metadata-operation-context'
feeat(openapi): add batch endpoint to v2 using requestbody (#10100)
2024-03-21 15:15:29 -05:00
include ':metadata-service:openapi-servlet:models'
feat(schematron): add java capabilities for schema translation (#11963)
2024-11-26 14:03:22 -08:00
include ':metadata-integration:java:datahub-schematron:lib'
include ':metadata-integration:java:datahub-schematron:cli'
Reference in New Issue Copy Permalink