Ram Narayan Balaji
cf559c4fe3
Added alter table queries in 1.6.0 to avoid cached plan queries in flowable
2025-09-25 12:40:04 +05:30
Ram Narayan Balaji
b462268f70
Merge branch 'refs/heads/main' into feature/custom-workflows
...
# Conflicts:
# openmetadata-service/src/main/java/org/openmetadata/service/migration/mysql/v1100/Migration.java
# openmetadata-service/src/main/java/org/openmetadata/service/migration/postgres/v1100/Migration.java
# openmetadata-service/src/main/java/org/openmetadata/service/migration/utils/v1100/MigrationUtil.java
# openmetadata-ui/src/main/resources/ui/src/generated/api/governance/createWorkflowDefinition.ts
2025-09-24 19:10:06 +05:30
Sriharsha Chintalapani
e77d1940cb
Domain policy must be evaluated during PolicyEvaluator ( #23302 )
...
* Domain Only Access Role to be evaluated as part of PolicyEvaluator
* Domain Only Access Role to be evaluated as part of PolicyEvaluator
* Cleanup unnecessary comments
* Add migration fix for domain only policy
* fix playwright domain rbac
* fix hasDomain role issues for TestCaseResourceContext
* allow user to create only with their domain
* move DomainOnlyAccessPolicy migrations to 1.9.10 from 1.9.9
* For resources that don't support domains (like DataInsights), always returns true
* fix adding test case to bundleSuite
* revert supportsDomains changes in RuleEvaluator and handle it in postFiltering steps
* Inherit domains when creating task from test case incident, and skip few entities for domain check + other remaining DQ related domain fixes
* for CreateResourceContext consider assigned domains + inherited domains
* fix permission for table metrics page
* remove SKIP_DOMAIN_CHECK_ENTITY_LIST
* fix test
---------
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2025-09-24 09:56:55 +05:30
Ram Narayan Balaji
ee66ebdb5f
Merge branch 'main' into feature/custom-workflows
2025-09-24 08:43:39 +05:30
Keshav Mohta
cb26c91442
Revert "Fixes #23356 : Databricks OAuth & Azure AD Auth ( #23482 )" ( #23530 )
...
This reverts commit f1afe8f5f114ee58090168fd7ae5d66b38a01ab0.
2025-09-23 17:44:16 +02:00
Ram Narayan Balaji
b49c4bd7e0
Merge branch 'refs/heads/main' into feature/custom-workflows
...
# Conflicts:
# openmetadata-ui/src/main/resources/ui/src/generated/settings/settings.ts
2025-09-23 18:25:56 +05:30
Keshav Mohta
f1afe8f5f1
Fixes #23356 : Databricks OAuth & Azure AD Auth ( #23482 )
...
* feat: databricks oauth and azure ad auth setup
* refactor: add auth type changes in databricks.md
* fix: test after oauth changes
* refactor: unity catalog connection to databricks connection code
2025-09-23 15:22:50 +05:30
Ram Narayan Balaji
f0a6c3ea05
Merge branch 'main' into feature/custom-workflows
2025-09-23 00:25:41 +05:30
Teddy
71f993a2fc
Minor fix broken 1.9.8 migrations ( #23487 )
...
* chore: fix duplicate migrations from 1.9.8
* fix: psql update query
2025-09-22 13:13:25 +00:00
Ram Narayan Balaji
6751bce988
Merge branch 'main' into feature/custom-workflows
2025-09-19 20:29:45 +05:30
Teddy
4be7d65fbf
Minor my sql migration ( #23476 )
...
* chore: fix migration performance MySQL
* fix: remove comment
2025-09-18 20:59:42 +02:00
Ram Narayan Balaji
b01941ba28
Merge branch 'main' into feature/custom-workflows
2025-09-18 15:51:15 +05:30
Teddy
f8f57fc4af
chore: change memory engine to innodb in migrations ( #23460 )
2025-09-18 09:53:49 +02:00
Sriharsha Chintalapani
ffc4dcf643
Fix post profiler time series migration ( #23444 )
...
* Fix post profiler time series migration
* add prefix index
* Update prefix index length for entityFQNHash
* Update prefix index length for LIKE queries
* add prefix index
* fix mysql syntax
2025-09-17 19:17:25 -07:00
Ram Narayan Balaji
3dafd6f104
Merge branch 'refs/heads/main' into feature/custom-workflows
...
# Conflicts:
# bootstrap/sql/migrations/native/1.10.0/mysql/schemaChanges.sql
# bootstrap/sql/migrations/native/1.10.0/postgres/schemaChanges.sql
2025-09-16 20:15:21 +05:30
Adrià Manero
840f7e2a68
Setup NotificationTemplate CRUD ( #23293 )
2025-09-16 15:21:11 +02:00
Ram Narayan Balaji
2cddf1858f
Merge branch 'main' into feature/custom-workflows
...
# Conflicts:
# bootstrap/sql/migrations/native/1.10.0/mysql/schemaChanges.sql
# bootstrap/sql/migrations/native/1.10.0/postgres/schemaChanges.sql
2025-09-16 16:58:42 +05:30
sonika-shah
cc18ba1554
feat: Add configurable filters aggregation for tag source segregation in search ( #23363 )
...
* feat: Add configurable filters aggregation for tag source segregation in search
* Update generated TypeScript types
* use script based aggregation
* use script based aggregation
* Update generated TypeScript types
* update aggregations with script
* add migrations to fetch updated searchSettings
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-16 15:16:06 +05:30
Ram Narayan Balaji
39a693f554
Merge branch 'main' into feature/custom-workflows
...
# Conflicts:
# bootstrap/sql/migrations/native/1.10.0/mysql/schemaChanges.sql
# bootstrap/sql/migrations/native/1.10.0/postgres/schemaChanges.sql
2025-09-11 22:30:39 +05:30
Ram Narayan Balaji
9fd34c8f89
Feat #20586 Implementation of Custom Metrics Measurement Units ( #22876 )
...
* Initial Implementation of Custom Metrics Measurement Units
* Update generated TypeScript types
* Removed Regex patterns and length validations as they are not needed
* Add a new column with index for custom units
* Remove comments in the sql
* update ui and add playwright
* fix metric selector
* fix tests
* address feedbacks
* remove unused field
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-11 15:14:38 +05:30
Ram Narayan Balaji
8deff55f9e
Increase the Flowable's polling time to 60 seconds to poll timer and async jobs table
2025-09-07 19:41:22 +05:30
Ram Narayan Balaji
52c3c82ead
Merge branch 'main' into feature/custom-workflows
2025-09-05 21:30:21 +05:30
Teddy
1ef191a2aa
ISSUE #1534 - Profiler Refactor for Metadata Extraction Application ( #23200 )
...
* feat: added exporter app config
* refactor: added entityprofile resource & added backward compatibility to existing API
* feat: added tests to get_profile_data_by_type
* feat: remove non supported event types
* chore: added migrations to 1.9.7
* chore: added application creation readme
* chore: move migrations to 1.9.8
* fix: failing java test
* style: ran java linting
2025-09-05 13:07:04 +02:00
Ram Narayan Balaji
87f02be3eb
Merge branch 'main' into feature/custom-workflows
...
# Conflicts:
# bootstrap/sql/migrations/native/1.10.0/mysql/schemaChanges.sql
# bootstrap/sql/migrations/native/1.10.0/postgres/schemaChanges.sql
# openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/DataProductRepository.java
2025-09-02 16:41:43 +05:30
Sriharsha Chintalapani
cb42409999
GlossaryTerm Search endpoint ( #23005 )
...
* Glossary Term load issues
* Glossary Term load issues
* Fix #20081 : Infinite scroll Pagination support for Glossary Term Table in UI
* Fix #20081 : Infinite scroll Pagination support for Glossary Term Table in UI
* fixed glossary infinite scroll
* removed script
* fixed glossary fialing playwright
* fixed expand and collapse for entire hierarchy
* Add search endpoint to support glossary term search
* Add search endpoint to support glossary term search
* fixed fetchAllTerm glitch (#23037 )
* resolve conflicts and fix style
* minor prettier fix
* Fix(ui): Infinity Scroll Playwright (#23088 )
* fixed comments
* removed unncessary files
* addressed ui issue
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Fix(ui):Infinite Scroll Unit Tests (#23131 )
* fixed failing unit tests
* fixed mock type field
* Minor: Move migrations to 1.9.6
* Revert unintended changes in 1.9.5 migration files
* fix build
---------
Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-09-02 09:32:16 +05:30
Pere Miquel Brull
abcdc4e3d6
MINOR - Domain Independent DP Rule ( #23067 )
...
* MINOR - Domain Independent DP Rule
* handle DP
* Handle DP
* add migration
* improve rule mgmt
* improve rule mgmt
* add test for bulk op
* fix test
* handle in bulk
---------
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-29 17:28:29 +02:00
Ram Narayan Balaji
666b666d63
Merge branch 'refs/heads/main' into feature/custom-workflows
...
# Conflicts:
# openmetadata-service/src/main/java/org/openmetadata/service/resources/governance/WorkflowDefinitionResource.java
2025-08-28 18:10:44 +05:30
Pere Miquel Brull
8c028b81c0
MINOR - Move migrations to 1.9.5 ( #23095 )
2025-08-28 09:23:21 +02:00
Ram Narayan Balaji
e8db9825c8
Merge branch 'main' into feature/custom-workflows
2025-08-26 23:54:07 +05:30
Pere Miquel Brull
d054f386c7
MINOR - tag_usage performance ( #22950 )
...
* MINOR WIP - tag_usage performance
* Update EntityRepository.java
remove unnecessary call
* update query and indexes
* Merge 1.9.3 migration queries from main branch
- Add performance indexes for tag_usage and entity_relationship tables
- Add entity relationship update for dataContract relations
- Merge queries from both main and tag-usage-perf branches
Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>
---------
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <pmbrull@users.noreply.github.com>
2025-08-25 17:45:39 +02:00
Ram Narayan Balaji
873635ef04
Merge branch 'main' into feature/custom-workflows
2025-08-22 23:25:05 +05:30
Pere Miquel Brull
bdf3659b41
MINOR - Data Contract fixes and improvements ( #23043 )
...
* fix change event handling for alerts
* contract is deleted when asset is deleted
* add support for custom properties
* Update generated TypeScript types
* handle suite index deletion
* validate owner is not coming back if not requested
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-22 12:58:06 +02:00
Ram Narayan Balaji
96f1693e79
Removed the comments in the schemaChanges
2025-08-22 10:52:57 +05:30
Ram Narayan Balaji
cc589a863d
Merge branch 'main' into feature/custom-workflows
2025-08-21 15:21:10 +05:30
Ram Narayan Balaji
dd67fb59b3
Transaction handling fix, id truncation fix by migration, feed repo fix for multi reviewer pattern, copilot comments
2025-08-21 15:07:57 +05:30
sonika-shah
b1a7d4d8ae
Add missing domain migrations for entity version history ( #23032 )
2025-08-21 14:33:37 +05:30
Teddy
d58b8a63d6
ISSUE #1753 - Add Row Count to Custom SQL Test ( #22697 )
...
* feat: add count rows support for custom SQL
* style: ran python linting
* feat: added logic for partitioned custom sql row count
* migration: partitionExpression parameter
* chore: resolve conflicts
2025-08-19 06:40:49 +02:00
Pere Miquel Brull
8607f10d95
MINOR - Add Tests & fix migrations ( #22714 )
2025-08-03 15:19:54 +02:00
sonika-shah
d5515ded3b
Add migrations to update widget descriptions ( #22707 )
...
* Add migrations to update widget descriptions
* move to postDataMigrationSQLScript.sql
* move to postDataMigrationSQLScript.sql
* move to postDataMigrationSQLScript.sql
2025-08-02 16:55:02 +05:30
sonika-shah
4cf5a410fe
Feed migrations to support multi-domain ( #22601 )
...
* WIP : feed migrations to support multi-domain
* fix domain field in ChangeEvent and thread.json , move to maintaining list<uuid>
rather than list<entityRef>
* Update generated TypeScript types
* fix query migrations
* add default for domains field in thread and changeEvent
* add backend test , and allow domain param in createThread
* Update generated TypeScript types
* Apply suggestions from code review
handling null issue in JSON_ARRAY
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix flakiness in test, add pending migration
* fix sql query
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-08-02 04:59:05 +05:30
Copilot
5057f29efc
Fix alert events ordering to show latest events first ( #22309 )
...
* Initial plan
* Initial analysis: identify ordering issue in alert events
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* Fix PostgreSQL query ordering in listAllEventsWithStatuses
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* Add comprehensive test coverage and performance indexes for event ordering
- Add CollectionDAOEventOrderingTest with 4 comprehensive test methods
- Test chronological ordering, pagination, edge cases, and cross-database consistency
- Add critical timestamp indexes for consumers_dlq and successful_sent_change_events tables
- Indexes prevent table scans on ORDER BY timestamp DESC queries
- Migration 1.9.1 includes both MySQL and PostgreSQL index definitions
Addresses performance concerns and test coverage gaps identified in PR review.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com>
* Fix tests
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2025-07-31 13:31:53 +02:00
Keshav Mohta
f8b588e6f0
Feature: Security Service ( #22450 )
...
* feat: security service initial code
* support secrity type for service from ui
* refactor: added missing java files for security service and require json files
* refactor: added doc file, oneOf java changes for ranger
* Merge branch 'main' of https://github.com/open-metadata/OpenMetadata into issue-20145
* update the security services schema to have domains instead of domain
* fix: added security service metadata pipeline
* Make changes for security service UI
* Update missing translation
* update type
* Fix the java checkstyle
* fix: added ingestionRunner in security service json
* Hide security service for OSS
* fix: reverse metadata documentation
* refactor: added securityConnection in test connection
* fix: documentation and ts file changes
* fix: deleted __init__ file and added SSISConnection again in the workflowclassconverter.java
* fix: convert domain to domains
* fix: added new file for basicAuth for ranger and change in rangerConnectionClassConverter.java file
* fix: java checkstyle
* fix: mysql security service sql
* fix: security service index mapping
* fix: moved migrations in new version and fix classConverterFactory
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-31 06:38:21 +02:00
sonika-shah
79e00ebc94
Add missing migrations for changes related to searchSettings introduced in version 1.8.7. ( #22634 )
2025-07-29 18:49:19 +05:30
IceS2
bad772db39
FIX #22099 : enable 'Column values to be in set' test case for boolean columns ( #22491 )
...
* fix(dq): enable ''Column values to be in set'' test case for boolean columns
Add BOOLEAN to supportedDataTypes array in columnValuesToBeInSet.json
to allow boolean column validation with predefined allowed values.
This enables users to enforce strict true/false validation on boolean
columns directly at the column level, resolving issue #22099 .
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
* Add tests to the new feature
* Add migrations and columnValuesToBeNotInSet
---------
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: IceS2 <IceS2@users.noreply.github.com>
2025-07-25 15:17:38 +02:00
Sriharsha Chintalapani
d1bf66052b
Fix #22422 : Classification term count showing 0 in UI … ( #22470 )
...
* Fix #22422 : Classification term count showing 0 in UI │
│ │
│ - Added bulk fetch methods to ClassificationDAO for efficient term count retrieval │
│ - Implemented proper batch fetching in ClassificationRepository.setFieldsInBulk │
│ - Added ConnectionAwareSqlQuery annotations for MySQL and PostgreSQL compatibility │
│ - Fixed duplicate key error in TagRepository.batchFetchUsageCounts │
│ - Added Playwright test to verify classification term counts display correctly
* Fix java checkstyle
* remove unused query
* refactor query : switch to join-based classification hash matching and add generated column for classificationHash
---------
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-07-24 11:38:49 +05:30
Sriharsha Chintalapani
e3ba945630
Update databaseServiceMetadataPipeline.json ( #22518 )
...
* Update databaseServiceMetadataPipeline.json
markDeletedSchemas and markDeletedDatabases should be false by default
* add migrations
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-07-23 11:14:18 +02:00
Chirag Madlani
b098395602
Data contracts support for tables & Multi Domain Migration ( #22108 )
...
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* rules
* rules
* rules
* fix retrieval by entity
* test dc
* test dc
* WIP: Data contract feature
* destructure component to it's own files
* WIP contract tab
* update local
* fix test
* First iteration for multi domain support
* fix inheritance fields
* fix inheritance fields
* fix create interface
* fix few more tests
* fix indexing updates
* fix domain rel
* update domain --> domains
* merge
* fix merge
* fix csv tests and createEntity interface
* Update generated TypeScript types
* Trigger Build
* migrations
* fix tests
* fix tests
* fix tests
* Update generated TypeScript types
* Trigger Build
* handle drive service
* fix pg migration
* fix domains ref after merge and clean python tests
* Update generated TypeScript types
* fix merge domains
* format
* add missing migrations
* Update generated TypeScript types
* tests
* Update generated TypeScript types
* Trigger Build
* tests
* tests
* fix py test
* migrate domain to domains and fix compilation errors
* fix domain assignement
* fix domain spec
* fix py tests
* fix data product creation issue
* fix domain tests
* fix bulk import
* fix tests
* fix tests
* fix query and domain migration
* fix py test
* fix playwrights
* fix getEntitiesWithDisplayName indexing quotes
* fix domain prapogation tests
* fix domain propagation
* Fix patch api
* fix domain schema build edit playwright
* fix test
* fix test
* fix domain selection issue and console errors
* quick fix landing page changes
* fix remaining tests
* fix ui tests
* Fix adding data products
* format
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-22 09:34:50 +02:00
sonika-shah
4d473c8204
Fix 1.7.3 pending migrations ( #22434 )
...
* Fix 1.7.3 pending migrations
* move to 1.8.7
* move to 1.8.7
2025-07-21 20:58:11 -07:00
Sriharsha Chintalapani
e3e248ef0a
Fix #22440 : Performance Optimization for Database Service Cascade Deletion ( #22441 )
...
* Fix #22440 : Performance Optimization for Database Service Cascade Deletion
* Fix stylecheck
* Fix #22440 : Performance Optimization for Database Service Cascade Deletion
* Fix stylecheck
* Fix styling
2025-07-20 07:32:48 -07:00
Sriharsha Chintalapani
1c092ea743
Fix #22403 : Smart Reindex ( #22404 )
...
* Fix #22403 : Smart Reindex
* Update generated TypeScript types
* Docs: Artifacts Removal (#22442 )
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
* Docs: Meta Tags Updation (#22444 )
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
* Fixes #22363 #22369 : Stored procedure temp table processing and lineage filtering with db & schema (#22416 )
* Process temp table graph in stored procedure processor and add db/schema filtering on lineage
* Add tests for stored procedure lineage processing
* Fix tests and py_format
* Fix the filters and log stored proc query count info
* Playwright Update: Bulk Import (#22436 )
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
* Docs: Databrick Features Updation (#22448 )
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
* Docs: Meta Updation (#22451 )
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
* Docs: 18.4 to 1.8.6 Release Updation (#22455 )
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
* fix the flaky glossary bulk edit failure (#22446 )
* Move schema changes to 1.8.7
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: satish <satishmwaghela@gmail.com>
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-07-18 21:53:43 -07:00
