1071 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
1f4186b661
Add missing tier mapping (#23263) 2025-09-04 14:24:17 -07:00
Pere Miquel Brull
1e48241f51
MINOR - Add Security, SLA and Terms of Use to Data Contract (#23230)
* jsonschema

* MINOR - Add Security, SLA and Terms of Use to Data Contract

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 11:51:34 +02:00
IceS2
ebc67a9f97
MINOR: Add new WorkflowType and converter (#23090)
* Add new WorkflowType and converter

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-04 10:11:35 +02:00
Akash Verma
8dd69af269
fix(snowplow) : json-changes (#23217)
* none

* snowplow-json-change

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-09-04 09:34:25 +05:30
Mohit Tilala
f2fd8a9107
Fixes #22452: [Snowflake] Add custom host support for View in Snowflake source url (#23209) 2025-09-03 14:13:03 +05:30
Ram Narayan Balaji
5cb33ce78a
Implementation of Adding Entity Status and Reviewers to assets (#22904)
* Initial Implementation of Adding Status and Reviewers to assets for workflows

* Update generated TypeScript types

* Copilot Review Comments Addressed

* Removed DataProduct Reviewer Inheritance as it is irrelevant

* Commit: Classification has status and reviewers, DataContract uses the same status enums, changed the logic to be APPROVED instead of Active, DataContract can have null status as seen in tests, Changed Workflow to use workflowStatus instead of status as it is contradicting with the approval status, Fixed Tests

* Default for reviewers is null

* Default for reviewers is createSchema

* Addressed CoPilots comments

* Update generated TypeScript types

* Workflow status to workflowStatus in db and migrations

* Revert "Workflow status to workflowStatus in db and migrations"

This reverts commit 676e8789358654bc6f980f855c372f33c22fc40b.

* Changed status to entityStatus in the schema files

* Java Implementation of Default Status, Search Client improvements and Test fixes and new tests

* Adding entityStatus and reviewers in the searchIndex mappings and common attributes

* Data Migration scripts to change the glossaryTerm and dataContract structure

* Update generated TypeScript types

* Fixed zh/spreadsheet index json error

* Fix Postgre migration script

* Changed the entityStatus.json to status.json
Removed the duplicates of entityStatus in the indexMapping
Modified the sample data to take in EntityStatus.Approved instead of ContractStatus.Active

* Update generated TypeScript types

* dummy commit

* Fix UI Build Issues with the New EntityStatus
Fix py tests

* Migrations for all the entities that need entityStatus

* Update generated TypeScript types

* Removed Post Migration scripts

* Fix UI  and py for entityStatus

* Update generated TypeScript types

* Fix: DataContractResourceTest

* Fix UI and py for importing entityStatus

* UI to show and fetch Reviewers

* cleanup

* Removed Overridden SetDefaultStatus in GlossaryTermRepository

* Removed unnecessary validation

* Added entityStatus in search_entity_index_mapping.json

* Fixed DataContractResourceTest

* mvn spotless apply and fix migration scripts

* fix tests

* fix type error

* fix advanced search tests

* Status comparison using enums and supportsStatus to supportsEntityStatus

* mvn spotless apply

* fix merge conflict

* update entity status

* fix tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
2025-09-03 12:49:45 +05:30
Suman Maharana
20e18d4f9f
Add ssl support to hive (#22831)
* Add ssl support to hive

* Added missing ts files

* Added version to pure transport

* Added Tests

* fix tests add missing files
2025-09-02 20:13:30 +05:30
Chirag Madlani
841a03566e
feat(ui): support add edit for semantic rules (#23092)
* feat(ui): support add edit for semantic rules

* support QueryBuilder with tree change

* Update generated TypeScript types

* update querybuilder widget and add tests

* fix conflicts for tree rendering

* add validation for sematic rules

* fix unit tests and address comment

* fix data contract tests

* add unit tests for contract components

* fix styling and add tests

* address comments

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-09-02 18:45:44 +05:30
Mayur Singal
f39aadb051
MINOR: Make transient table ingestion enabled by default - snowflake (#23173) 2025-09-02 12:49:18 +05:30
Akash Verma
421f345554
Snowplow Connector (#23133)
* Snowplow Connector

* markdown file change

* UI

* ts file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:32:33 +05:30
Akash Verma
a41d0404c4
Feature: ServiceNow Connector (#23093)
* service now connector files

* updated schema and ui file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-09-02 11:00:23 +05:30
Mayur Singal
c5a1bf317f
MINOR: Allow additional fields for custom connectors (#23103)
* MINOR: Allow additional fields for custom connectors

* Update generated TypeScript types

* Fix the ConfigClass import

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-08-29 13:58:23 +05:30
Dmitriy
4ba4bed300
Fixes #22598: Add Russian Language Support for Elasticsearch Search (#22599)
* ISSUE-22598: Add Russian language support for Elasticsearch index mappings

- Add 44 Russian (ru) Elasticsearch mapping files for all entity types
- Update IndexMappingVersionTracker to handle language-specific mappings
- Update generated UI configuration files

* fix Typescript generation

* Add RU to IndexMappingLanguage enum in JSON schema

* fix missing index ,fix typescript, Renamed directory: elasticsearch/RU/ → elasticsearch/ru/ (lowercase) ,Replaced filter: icu_folding → asciifolding (built-in filter that doesn't require plugins)

---------

Co-authored-by: dmitrii.cherkashin <dmitrii.cherkashin@welltory.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2025-08-29 00:13:25 +05:30
Himanshu Khairajani
8c4cebea13
fix #21555: Automator - Separating terms and tags in action config (#22970)
* Separating terms and tags in action config

* Update generated TypeScript types

* add: migration files for separate tags and terms

* chore: java formatting

* yaml formatting

* Chore: updated the release number

* updated to v194 as per release cycle

* updated to v195 as per release cycle

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
2025-08-28 10:50:48 +02:00
Tomas Montiel Prieto
7197d68aff
Move resultlist util to spec (#23121)
* move resultlist to spec

* move resultlist to spec 2

* update import
2025-08-28 07:49:02 +02:00
Mohit Yadav
414a009474
Upgrade Mcp to 0.11.2 (#23049)
* Upgrade Mcp to 0.11.2
Use stateless Mcp Servlet

* Add Test for Load Testing and Improve Search Response

* Fixed Glossary And Patch Test

* Add user tests

* Fix failing load test
2025-08-22 22:42:47 +05:30
Pere Miquel Brull
bdf3659b41
MINOR - Data Contract fixes and improvements (#23043)
* fix change event handling for alerts

* contract is deleted when asset is deleted

* add support for custom properties

* Update generated TypeScript types

* handle suite index deletion

* validate owner is not coming back if not requested

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-22 12:58:06 +02:00
Mohit Yadav
c0d7a574d7
chore(release): Prepare Branch for 1.10.0-SNAPSHOT (#23034)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-21 21:43:01 +05:30
Copilot
99b08445a6
Add SanKey to ChartType enum (#22858) 2025-08-18 11:58:19 +05:30
Sriharsha Chintalapani
a6d544a5d8
RDF Ontology, Json LD, DCAT vocabulary support by mapping OM Schemas to RDF (#22852)
* Support for RDF, SPARQL, SQL-TO-SPARQL

* Tests are working

* Add  RDF relations tests

* improve Knowledge Graph UI, tags , glossary term relations

* Lang translations

* Fix level depth querying

* Add semantic search interfaces , integration into search

* cleanup

* Update generated TypeScript types

* Fix styling

* remove duplicated ttl file

* model generator cleanup

* Update OM - DCAT vocab

* Update DataProduct Schema

* Improve JsonLD Translator

* Update generated TypeScript types

* Fix Tests

* Fix java checkstyle

* Add RDF workflows

* fix unit tests

* fix e2e

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-08-17 18:36:26 -07:00
Sriharsha Chintalapani
15b92735b9
Fix #1093: Add Grafana Support (#22571)
* Fix #1093: Add Grafana Support

* Update generated TypeScript types

* Grafana test fix

* Update

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-08-11 19:39:39 +05:30
Tomas Montiel Prieto
66b6250588
Minor: add configs for embedding provider (#22825)
* add configs for embedding provider

* Update generated TypeScript types

* ci: trigger

* make embedding dimension dynamic

* Update generated TypeScript types

* ci: trigger

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-08 12:35:12 +05:30
Aniket Katkar
bce4bcd32f
Fix service insight live update bugs (#22822)
* Fix live update bugs

* support automator status

* fix query search index

* Update the logic to display the AutoPilot status and add playwright test

* Fix tests

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-08 07:55:55 +05:30
Ariel Schulz
d31e2d8ba0
Feature/1 fix and add lineage to exasol connector (#21399)
* Add lineage to Exasol connector

* Update test_connection to return TestConnectionResult

* Add exasol tests & dependencies to tests in setup.py

* Opensearch is required for testing, so add it there

* Modify metadata

* Update documentation for lineage

* Apply formatting changes to code

* Apply make py_format
2025-08-06 23:49:38 +05:30
Akash Verma
1cc1abcd27
feature: googlesheet connector (#22464)
* feature: googlesheet connector

* updates

* minor change

* java checkstyle

* googledrive files

* fix

* make the google sheets work

* fix directory and files

* remove ui

* update generated types

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-06 22:01:41 +05:30
Tomas Montiel Prieto
d7d6a6f8b3
Enable bedrock embedding service (#22734)
* enable bedrock embedding service

* Update generated TypeScript types

* ci: trigger

* ci: trigger

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-06 07:19:37 -07:00
Ram Narayan Balaji
0aa9238a72
Fix: #19907 Glossary Term Approval Workflow - Trigger Filters - JsonLogic along with Exclude Fields filter (#22437)
* Draft Implementation of Auto approve Glossary Terms - JsonLogicFilter

* Update generated TypeScript types

* Fixed Issues: PassFilter Inversion when jsonLogic is true, Unescaping JsonFilter

* Corrected the Test Expectations and fixed the test

* Fixed the Test for auto approval

* Fixed Java Checkstyle

* Added Entity to the jsonLogic Map for rule application so that other operations on entity is also used in jsonLogic

* Implementation of Code Review Changes
1. Use the Singleton Rule Engine and add Operations
2. Use Migrations and remove the backward Compatibility

* Update generated TypeScript types

* Removed Flowable variable updatedBy

* Update CheckEntityAttributesImpl to use Singleton rule instance

* Final Design: Improved Json Logic Triggers : isChanged, isReviewer, isOwner

* Fixed Issue: Extracting var from isChanged rule

* Fixed Issue: Fixed comment and trigger properties for entityBasedTrigger

* Hybrid approach: Exclude Fields + JsonLogic

* Update generated TypeScript types

* Added a lot of test cases!

* Auto Approve Glossary Terms during creation to avoid forever DRAFT state

* Added nodes for auto approve for reviewers

* Revert starting terms in DRAFT

* Adding Migrations to take the fresh data from the seed config, since our default workflow definitions have been changed.

* Handled Migrations properly for glossary term auto approve nodes

* Fix Merge Conflicts - Updated MigrationUtil, Fixed GlossaryStates test with newly added nodes

* Add Trigger filter to have empty string

* Fix Java checkstyle

* Updated the JsonLogic apply to incorporate RuleEngine changes

* Update the default rule for checkglossaryterm has reviewers node in governance workflow

* add migration logic

* Fix Flaky Optimistic Lock exception in the test case

* add tests

* Fix: 1. Propagate updatedBy from the trigger and make the updatedBy to be a reviewer in case of auto approval by reviewer.
2.  Multiple Workflow Instance Conflicts resolution

* Remove early no conflict return

* revert search provider changes

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-08-06 12:17:55 +00:00
Mayur Singal
892334df10
Fix #21361: Live charts for service insights (#21644)
* Fix #21361: Live charts for service insights

* websocket implementation

* Minor refactoring

* update the UI for PlatformInsights and TotalDataAssets widgets.

* Remove unused state and variable

* Implement the live updates logic for Platform insight charts

* Add healthy data assets chart to platform insights

* Add agents widget

* add DI migrations to 190

* Add Agents status widget

* pass collateAgentsList to service insights tab

* Add the styling for CollateAI agents status cards

* add service name in response and stop stream api

* Fix the style variable names

* fix fields bug

* add remaining charts

* add total assets live chart

* pipeline_status_live

* Implement the stop socket connection for service insights live update

* Fix the chart names for live update

* fix services

* fix description

* handle ingestion pipeline status

* Add icons for agents and statuses

* alerts api eslint fix

* Fix the logic to update the agents statuses from websocket response

* Add missing localization keys

* Remove the autopilot status banner

* Fix total data assets widget live updates

* Remove commented code

* Add collate app status

* Update generated TypeScript types

* uncomment the websocketProvider code

* Make changes for live updates for collate AI agents

* Remove unnecessary changes and move util function to util file

* Fix the playwright and add check to prevent the live updates of one service showing for others

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-05 20:20:35 +05:30
Mohit Yadav
b92e9d0e06
chore(release): Prepare Branch for 1.9.0-SNAPSHOT (#22742)
Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
2025-08-04 20:00:25 +05:30
Himanshu Khairajani
866117360a
fix: enum to domains (#22722)
* fix: enum to domains

* Update generated TypeScript types

---------

Co-authored-by: --global <--global>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-08-04 09:01:04 +02:00
sonika-shah
0a298631eb
fix sorting on updatedAt field in classification_search_index (#22715) 2025-08-04 10:16:40 +05:30
Karan Hotchandani
eceb75dd17
feat(ui): Add Chart Details Page (#22271)
* feat: Add Chart Details Page and update Dashboard Chart Table

This commit introduces a new dedicated page for displaying chart details, mirroring the functionality of the existing dashboard details page.

Key changes include:
- Creation of  components, tests, and mocks.
- Creation of  component and its interface.
- Creation of  and .
- Renamed  to  to support JSX syntax.
- Updated application routing to include FQN in chart detail URLs.
- Modified  to link chart names to the new chart details page.

* fix tests

* add chart class playwright

* Refactor chart details and constants for improved type support

Updated ChartDetails component and related interfaces to improve type safety and support for Chart as a data asset. Removed custom properties tab and widget from chart details. Added chart entity to data asset types and constants, and updated color schemes for chart visualizations. Adjusted permission handling and tab generation logic for chart details.

* add charts custom properties

* chart page bug fixes (#22490)

* Update generated TypeScript types

* fix tests

* mvn formatting

* add visit page link

* domain migration

* add announcements

* fix test

* Update ChartDetailsUtils.tsx

* fix style issue

* update routes

---------

Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-08-03 16:20:59 +02:00
Akash Verma
48ab71d9f3
Epic connector (#22652)
* Merge branch 'main' of https://github.com/open-metadata/OpenMetadata into feature/epic-connector

* feature:epic-connector

* UI changes

* UI markdown file

---------

Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
2025-08-03 15:26:52 +05:30
sonika-shah
4cf5a410fe
Feed migrations to support multi-domain (#22601)
* WIP : feed migrations to support multi-domain

* fix domain field in ChangeEvent and thread.json , move to maintaining list<uuid>
rather than list<entityRef>

* Update generated TypeScript types

* fix query migrations

* add default for domains field in thread and changeEvent

* add backend test , and allow domain param in createThread

* Update generated TypeScript types

* Apply suggestions from code review

handling null issue in JSON_ARRAY

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix flakiness in test, add pending migration

* fix sql query

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-08-02 04:59:05 +05:30
Pere Miquel Brull
30e2f83d50
MINOR - Fix updates & add rule provider (#22676)
* MINOR - Fix updates & add rule provider

* increrase the rule modal width and remove the rule column from table component in settings

* disabled edit and delete if system provider and change the rule logic

* format

* fix css of contract detail page and form component

* fix tests

* add the ability to ignore entities

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-08-01 14:29:56 +02:00
Mayur Singal
fe28faa13f
MINOR: Add support for csv.gz in datalake (#22666)
* MINOR: Add support for csv.gz in datalake

* fileformat change

* Update generated TypeScript types

* pyformat
2025-08-01 17:39:19 +05:30
IceS2
f578a81277
MINOR: Update table profile config to add spark configs. Update spark config to add temp path (#22646)
* Update table profile config to add spark configs. Update spark config to add temp path

* Add default null value for sparkTableProfilerConfig

* Fix TableProfileConfig extension DAO query

* Update generated TypeScript types

* Implemented Dependency Injection for the ProfilerProcessorConfig

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-31 11:50:30 +02:00
Keshav Mohta
f8b588e6f0
Feature: Security Service (#22450)
* feat: security service initial code

* support secrity type for service from ui

* refactor: added missing java files for security service and require json files

* refactor: added doc file, oneOf java changes for ranger

* Merge branch 'main' of https://github.com/open-metadata/OpenMetadata into issue-20145

* update the security services schema to have domains instead of domain

* fix: added security service metadata pipeline

* Make changes for security service UI

* Update missing translation

* update type

* Fix the java checkstyle

* fix: added ingestionRunner in security service json

* Hide security service for OSS

* fix: reverse metadata documentation

* refactor: added securityConnection in test connection

* fix: documentation and ts file changes

* fix: deleted __init__ file and added SSISConnection again in the workflowclassconverter.java

* fix: convert domain to domains

* fix: added new file for basicAuth for ranger and change in rangerConnectionClassConverter.java file

* fix: java checkstyle

* fix: mysql security service sql

* fix: security service index mapping

* fix: moved migrations in new version and fix classConverterFactory

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-31 06:38:21 +02:00
Ram Narayan Balaji
f392902a73
Enhancement: GlossaryTerm Approval Workflow to Store States + Added Migration (#22402) 2025-07-31 08:50:00 +05:30
Pere Miquel Brull
dfe3fd6357
MINOR - Data Contract Validation (#22541) 2025-07-30 23:01:27 +02:00
satish
dd879e2976
Data Asset Rules configuration in settings (#22540)
* Data Asset Rules configuration in settings

* Enable, delete and API loading states

* Convert card listing to table listing

* Icon update for preference page menu item

* Table loading fix on delete and edit

---------

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2025-07-30 12:29:22 +05:30
Ram Narayan Balaji
e35dc186b0
Feature #21893 ER Diagram - Pagination, Efficient Upstream, downstream node retrieval (#21996)
* Initial Implementation of ER Diagram Upstream and downstream implementation

* Fix: Extra endpoint of entityRelationship removed

* Fix: Add upstreamEntityRelationship property in table index mappings for ES

* Fix: Removed isConnectedVia since it is not required for ER Diagram

* Improved some code, not final

* Fixed: Working with test cases

* Moved to TableResource from Database resource, need to fix tests

* Improved code and fixed test cases

* Fixing Painless Scipts along with reindexing Null Pointer Exceptions

* Reverted changes for Database Schema entity relationship

* Revert "Reverted changes for Database Schema entity relationship"

This reverts commit 544dd342fec924062d769472e59b29f0aa0eaf30.

* Minor: Reverted changes for Database Schema entity relationship - Fixed Build

* Refactor code: Fix Unnecessary functions, corrected imports

* Refactor code: Improve Test cases , fixed addNode to fqn hash inconsistency, Added Extra test cases for multihop and multi parent use case

* Refactor code: Make tests run in the same thread to not collide with other entity relationship tests

* Refactor code: Create Foreign Keys during the create table itself to avoid orphans

* Refactor code: Improve Test Cases to find the node and upstream details for matching as well

* Refactor code: Corrected Typo

* Update generated TypeScript types

* Database Schema ER Diagram Initial Implementation

* Refactor: Safe Delete function

* Update generated TypeScript types

* Refactored: GraphBuilders to closely Follow Lineage, Fixed Test Cases, refactored constants and generic pagination

* Test cases for Lineage and Improved Test cases for EntityRelationship for Table Level

* Test cases for Platform Lineage and DatabaseSchema ER Diagram

* Initial Improved Implementation of Database Schema ER with pagination

* mvn spotless apply

* Fixed the Test for auto approval

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2025-07-28 15:25:40 +05:30
Sriharsha Chintalapani
715f792e0b
Add support service account in Synapse (#22546)
* Add support service account in Synapse

* Update generated TypeScript types

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2025-07-27 18:51:54 +05:30
Himanshu Khairajani
3a65e1b436
Fix #1873 Automator - support for Multi Domain (#22583)
* Fix: Support Domains (multiple)

* Update generated TypeScript types

* Chore: Migration files for supporting domain --> domains in

* Chore: Using listAfter method from ingestionPipelineDAO

* Chore: Java Checkstyle formatting

---------

Co-authored-by: --global <--global>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-25 18:28:46 +02:00
Sriharsha Chintalapani
b0586f849f
Fix #22511: k8s secret support for Secrets Manager (#22516)
* Fix #22511: k8s secret support for Secrets Manager

* Update generated TypeScript types

* address comments

* pylint fix

* fix java checkstyle

* improve inCluster description in schema

* fix failing tests

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-07-24 12:40:51 +02:00
Sriharsha Chintalapani
e3ba945630
Update databaseServiceMetadataPipeline.json (#22518)
* Update databaseServiceMetadataPipeline.json

markDeletedSchemas and markDeletedDatabases should be false by default

* add migrations

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-07-23 11:14:18 +02:00
Sriharsha Chintalapani
d91122e13a
Fix #21563: Explore page count mismatch (#22203)
* Fix #21563: Explore page count mismatch

* Don't fail on migrations

* Fix the deleted assets showing even when deleted switch is not checked (#22217)

* Fix the failing playwright for service ingestion (#22218)

* parametrize get private key for snowflake (#22214)

* Schema Change Alert Not Triggering for Team Owner with Slack Destination (#22215)

* [Snyk] Security upgrade react-i18next from 11.18.6 to 15.5.3 (#21785)

* fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities

The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-BABELRUNTIME-10044504

* Empty commit

* Fix type errors

---------

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>

* Fixes #18151 : change replaced copy by model_copy (#18153)

* feat: replace copy

* fix native python copy

---------

Co-authored-by: IceS2 <pjt1991@gmail.com>

* Fix #20145: Implemented Prefix For Dashboard Service (#21585)

* feat: implemented microstrategy lineage & dbServicePrefix

* feat: added dbServicePrefixes support in other dashboards

* fix: test_metabase and powerbi extra code remove

* fix: python checkstyle

* refactor: added prefix support for other connectors - superset, tableau, etc

* refactor: added migration for prefix change and fix dbServicePrefixes field description

* refactor: added prefix changes in superset db source

* doc: add prefix in tableau doc

* fix: typescript files and postgres migration for prefix

* fix: moved migration in 1.8.2

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* chore(ui): Update whats new for 1.8.2 (#22196)

* update whats new for 1.8.2

* update whats new

* fix test (#22226)

* fix test (#22220)

* fix table filter test (#22219)

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>

* pass test case result ts as event time (#22190)

* update whats new (#22229)

* Fix Patch Tool (#22222)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* added tests for current user store (#22221)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Handle quoted entity names in masking queries (#22174)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix #1751: Include Column Constraint in DI Charts (#22199)

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Update operations.yaml (#22231)

Fix email templates

* Add lineage stored procedure and view filter pattern support (#22223)

* Add lineage stored procedure and view filter pattern support

* Update generated TypeScript types

* Add tests for lineage filter pattern

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Docs update (#22232)

* Docs: Fix links in secrets manager docs

* Docs: fix dbt Cloud typos in docs

---------

Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>

* Slack Application Document Addition in Collate (#22213)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Add Permission Debugger to understand roles & permissions for a user (#22207)

* Add debug api endpoints for roles & policies

* Add Roles & Policy Debugger

* fix errors

* Address comments

* Address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* fix: cross-platform path resolution for dbt ingestion (on Windows) (#22230)

* fix: windows os dbt ingestion fix

* py formatting

---------

Co-authored-by: --global <--global>

* Table bulk edit keyboard support (#22113)

* Keyboard support for tags, glossary terms and related terms

* Keyboard support for Certification, Domain, Tier, User team select components

* FocusTrap common and first element focus

* Unit tests for useRovingFocus and FocusTrapWithContainer

* Deactivate focus trap on popover close

* Update Playwrite tests

* Address review comments

---------

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>

* Docs: OpenSearch Version Chsnge from 2.7 to 2.19 (#22252)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Improves German ui translations (#22255)

* fix(ui): typo with tranlsation usage (#22256)

* MINOR: Fix databricks default schema issue (#22254)

* chore(ui): rename confusing labels (#22227)

* fixed column name

* removed database schema from column name

* addressed comments

* Fix ElasticSearchSink and OpeSearchSink (#22257)

* Fix Promtheus endpoint (#22233)

* Fix : Activity Feed Not Showing Column-Level Metadata Changes (#22245)

* Fix : Activity Feed Not Showing Column-Level Metadata Changes

* Add backend test

* fix checkstyle

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* fix test (#22236)

* chore(ui): Update whats new for 1.8.3 (#22262)

* update whats new for 1.8.3

* minor update

* Docs: 1.8.2 Release Update (#22263)

* Docs: 1.8.2 Release Update

* Docs: 1.8.2 Release Update

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* fix(test): AUT test failures (#22224)

* fix glossary version page playwright test

* fix lineage test

* Revert #22175 (Update GitHub workflows to ignore changes in openmetadata-docs) (#22283)

Co-authored-by: Prajwal Pandit <prajwalpandit@MacBook-Pro.local>

* Docs: Configure Lineage Note Updation (#22284)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: OpenMetadata Changes in Collate (#22268)

* OpenMetadata Changes in Collate

* OpenMetadata Changes in Collate

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Revamp metrics, Add Request Latencies, breakdown database, search latencies (#22259)

* Add cleaner metrics

* Revamp Metrics; Add Request Latencies, breakdown database, search latencies

* Remove MicrometerBundleSingleton.java

* Fix tests

* RELEASE 1.8.3 Updation (#22282)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Docs: 404 Error Fix (#22260)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Email Alerts Config Removal (#22225)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Keycloak SSO Troubleshooting Updation (#22253)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Auto Classification Feature Updation (#22237)

* Auto Classification Feature Updation

* Auto Classification Feature Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Doc: Tableau Note Addition (#21928)

* Doc: Tableau Note Addition

* Doc: Tableau Note Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Updation of backup-restore-metadata.md (#22206)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Doc: Meta updation (#22153)

* Doc: Meta updation

* Doc: Meta updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Doc: Meta Description Updation (#22120)

* Doc: Meta Description Updation

* Meta description updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Feat(ui): Add "Metric" as an Option for Entity Reference Type Dropdown  (#22272)

* added matric to entity reference

* updated tests

* Docs: Meta Updation (#22180)

* Doc: Meta updation

* Doc: Meta updation

* Docs: Meta Updation

* Docs: Meta Updation

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Update index.md

* Docs: Meta Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* fix(ui): Updated button names  (#22250)

* updated button names

* fix jest test

* update button names

* consistent submit button text

* updated forgot password form

* fixed sonar and playwright

* fixed playwright

---------

Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>

* PLAYWRIGHT: supported test around lineage drawer (#22281)

* supported test around lineage drawer

* added dashboard data model as well in the list

* fix new node suggestion not coming on search, drawer close not clicking due to longer div width and fix the playwrigth test on it

* fix the drag icon size in lineage left sidebar

* fix the list not updating after search

* fix the new node selector being overflowing and icon not visible

* Add drive as service (#22159)

* Fix #22157: Add Drive Service Support to OpenMetadata

* Fix #22157: Add Drive Service Support to OpenMetadata

* Update generated TypeScript types

* Fix tests

* Update generated TypeScript types

* Fix tests

* Tests are passing

* Tests are passing

* Update generated TypeScript types

* Address comments

* Update generated TypeScript types

* Add sample data and ingestion for drives, directories, spreadsheets, worksheets, files

* Fix postgres migrations

* Fix postgres tests, optimize queries

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* feat: add claude assistant (#22313)

* fix: claude workflow token (#22314)

* Add Claude Code GitHub Workflow (#22315)

* Update Claude PR Assistant workflow

* Claude Code Review workflow

* Fix ElasticSearch agg

* Fix ElasticSearch agg

* Fix ElasticSearch agg

* Fix ElasticSearch agg

* Fix ElasticSearch agg

* Fix dataAsset search and entity search

* Add logging

* Fix unnecessary changes

* Fix tests

* Revert to use previous search buidlers, but build allFields from searchSettings

* Update openmetadata-service/src/main/java/org/openmetadata/service/search/elasticsearch/ElasticSearchClient.java

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix build

* Fix multiple relation batch update (#22352)

* Fix multiple relationship bulk add

* Remove unused code

* Fix #22244 - Fix issues in zh language search index mapping (#22295)

Co-authored-by: zuohuan <zuohua12@163.com>

* Handling NPE reading appPrivateConfig with empty parameters (#22292)

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>

* Fix#21401: Auto pilot trigger button enable and improve test coverage (#22329)

* Modify the condition to only disable the Run Agents button when AutoPilot is in RUNNING state.

* Add playwright coverage for agents deletion confirmation after service is deleted

* I worked on fixing the flakiness in ObservabilityAlerts.spec.ts (#22336)

* FIX #22216 - Recursive suggestion application for deeply nested columns (#22348)

* feature: thoughtspot connector (#22266)

* feature: thoughtspot connector

* java and ts files

* java checkstyle

* rm java files

* ui changes

* java files

* minor changes

---------

Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>

* Add: missing supportsMetadataExtraction flag in connectors (#22296)

* Add: missing supportsMetadataExtraction flag in connectors

* addressed comments

* generate types

* MINOR - Add columns.description in search settings (#22299)

* MINOR - Add columns.description in search settings

* remove from defaults

* Docs: ThoughtSpot Connector Addition (#22358)

* Docs: ThoughtSpot Connector Addition

* Docs: ThoughtSpot Connector Addition

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Docs: SMTP Note Addition (#22360)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* supported playwright test for nested columns suggestions (#22361)

* MINOR - Update JVM params (#22334)

* MINOR - Update JVM params

* Update openmetadata-server-start.sh

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* User Activity Metrics (#22354)

* User Activity Metrics

* Fix tests

* remove dbx debug tests (#22264)

* FIX:  the race condition in bulk import around websocket and restAPI (#22277)

* fix the race condition in bulk import around websocket and restAPI

* Fix for Race condition

* remove the ui race condition fix

* re-switch the function to old place to avoid unwanted file change

* added ui support to tackle race condition as per backend changes

* fix the localization keys and unsave the data after restAPI call, since we are getting it from websocket started response

* fix bulk edit table flakyness

* minor code fixes

* fix the bulk action being affected if multiple tab open for same page and increase the database test time to avoid flakyness

* Fix Failing Test

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Fix soft-delete and restore handling for charts linked to dashboards during dashboard delete/restore operations (#22168)

* Fix soft-delete and restore handling for charts linked to dashboards during dashboard delete/restore operations

* remove the search script no longer required

* resolve conflict

* Policy Improvements  (#22273)

* - Removed Trimmed Permissions
- Fix Sample Data

* Add View Permissions Per Entity Api

* Remove Permission Trim for all calls

* Added generic function to prioritize field-level permissions over view all

* refactor: create separate edit and view permission functions

* add granular view and edit permission validation for entity pages

* update DataQuality components with granular permission checks

* update Domain related components with granular permission checks

* fix sonar cloud failure and address pr comment

* update Metric

* added playwright test for entities and fix failing unit test

* fix table profiler

* fix test and minor fix

* fix sonar cloud issues

* minor fix

* address pr comments and fix failing tests

* fix test

* fix test

---------

Co-authored-by: shrushti2000 <shrushtipolekar@gmail.com>

* Docs: Meta Description Updation (#22368)

* Docs: Meta Description Updation

* Docs: Meta Description Updation

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Minor(ui): Fixed Pagination alignment  (#22333)

* fixed pagination disalignment

* fixed pagination disalignment

* fix(ui): Handle text overflow in CommonEntitySummaryInfo and fix loader in search bar (#22330)

* fixed overflow & search issue

* fixed popover content

* removed unncessary code

* Fix: Postgres query column name for exec time (#22366)

* Fix Null Columns (#22365)

* Minor Fix: Add upstreamLineage in Directory, Worksheet, File, Spreadsheet DriveService  Search Indexers (#22346)

* Fix: Add upstreamLineage in DriveService ES DOC

* fix: add upstreamLineage to all drive-related ES indexers

* Refactor: Update DataQualityAndProfiler tests and ColumnProfileTable logic (#22364)

* Refactor: Update DataQualityAndProfiler tests and ColumnProfileTable logic

- Replaced `createNewPage` with `performAdminLogin` for improved login handling in DataQualityAndProfiler tests.
- Enhanced test case for profiler matrix visibility to include checks for admin, data consumer, and data steward roles.
- Updated ColumnProfileTable to use `fqn` consistently instead of `tableProfiler?.fullyQualifiedName` for fetching table columns.

This refactor aims to streamline the test setup and improve code clarity.

* Enhance ColumnProfileTable to utilize getTableFQNFromColumnFQN for improved FQN handling

- Updated ColumnProfileTable to derive table FQN from column FQN using the new utility function.
- Refactored related logic to ensure consistent usage of table FQN across navigation and data fetching.
- Added unit tests for getTableFQNFromColumnFQN to validate its functionality.

This change aims to streamline the handling of fully qualified names in the profiler component.

* Docs: Meta Description Updation (#22376)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Add: Schema and Database Mark Deletion (#22088)

* Added Schema and Database Mark Deletion

* removed unnecessary changes

* fixed marked deleted databases

* Added to all db connectors

* Added generated types

* Added tests

* Username extraction from jwtprincipalclaimsmapping, if email format (#22350)

* Username extraction from jwtprincipalclaimsmapping, when email format given

* Removed reduntant method

* Revert "supported playwright test for nested columns suggestions (#22361)" (#22374)

This reverts commit 2c97b7ae2ff377b97b7fe1d868d2c4acc41fb2b3.

* Docs: Team Note Addition in Team Structure (#22384)

* Docs: Team Note Addition in Team Structure

* Docs: Team Note Addition in Team Structure

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Meta Description Updation (#22386)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Quick Start Fix (#22394)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Switch to react-data-grid for Grid Component (#22279)

* Switch to react-data-grid for Grid Component

* Rdg styling and tests update

* Replace grid in EditTableTypeProperty and other fixes

* Update focus trap

* Fix data grid rerendering on user search issue

* Fix sonarqube issues and a playwright issue

* Fix glossary status column filter issue

* Address review comments

* Certificatation overlay class update

* Max width to certification popover

---------

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>

* Fix eslint error (#22388)

* Docs: Meta Description Updation (#22397)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Fix Entity Relationship Cleanup to not deleted entities without repo… (#22400)

* - Fix Entity Relationship Cleanup to not delted entities without repositories

* - Add Migration from Test Case to Test Case Resolution

* - Typo should be resolution id

* Add Tests and Fix Condition

* Update BatchSize

* Revamp: Data quality Page UI (#21766)

* Revamp: Data quality UI

* added pie chart as per new mock

* added pie chart component in test case page.

* updated test case list table UI

* updated pie chart with new mock

* Refactor Data Quality Summary Panel to use SummaryPieChartCard component

- Replaced inline pie chart implementations with a new reusable SummaryPieChartCard component for better code organization and reusability.
- Introduced new ChartData and SummaryPieChartCardProps interfaces for type safety.
- Updated styles for the new component and adjusted the layout in the DataQuality page.
- Added GREY_200 color constant for improved color management in pie charts.
- Enhanced percentage calculation utility for better precision and safety in division.

* Update DataQualityPage styles and button dimensions

- Removed unnecessary tab background class from DataQualityPage.
- Adjusted button styles for .ant-btn-default and .ant-btn-sm, changing dimensions and SVG sizes for improved UI consistency.

* Update DataQualityPage tests and component layout to reflect changes in tab selection and column span

* Enhance DateTimeDisplay component with license information and update localization files to include new "Bundle Suites" and "Table Suites" entries across multiple languages.

* fixed migration issue

* used new widget in place of old one

* Add TestCaseFormV1 component and related styles for Data Quality tests

- Introduced TestCaseFormV1 component for selecting test levels (Table/Column).
- Added SelectionCardGroup component for displaying selection options.
- Created associated LESS styles for both components.
- Updated DataQualityPage to include the new TestCaseFormV1 in a drawer format.
- Modified ic-format-table.svg to adjust icon dimensions.

* Enhance Data Quality Test Case Form UI

- Improved layout and styling for the Test Case Form, including margin adjustments and label styling.
- Added functionality for selecting tables and columns with dynamic fetching and caching.
- Implemented test type selection with corresponding parameter forms based on selected definitions.
- Updated AsyncSelect component to handle disabled state correctly.
- Adjusted SelectionCardGroup styles for better visual consistency.

* Enhance Test Case Form with New Features and Improved UI

- Added new fields for test name, description, tags, and glossary terms to the Test Case Form.
- Implemented loading state management for form submission and cancellation.
- Introduced reusable action buttons for better user interaction.
- Enhanced styling for fixed action buttons and drawer mode adjustments.
- Updated form layout to accommodate new fields and improve overall user experience.

* Enhance Test Case Form Functionality and UI

- Added dynamic assertion toggle and validation for test case names to prevent duplicates.
- Improved form initialization with default values and enhanced parameter handling.
- Integrated existing test case fetching based on selected tables and columns.
- Updated form submission logic to create test cases and display success/error messages.
- Enhanced overall user experience with better state management and UI adjustments.

* Add Data Quality Test Case Form Enhancements and New Schedule Component

- Introduced a new interface for TestCaseFormV1 to define props and form values, enhancing type safety.
- Added a ScheduleIntervalV1 component for managing scheduling options, including cron expressions and on-demand triggers.
- Updated TestCaseFormV1 to integrate the new scheduling functionality, allowing users to configure test case execution schedules.
- Enhanced UI with new styling for scheduler options and improved layout for better user experience.
- Implemented state management for dynamic form fields based on user selections, improving interactivity and usability.

* Enhance Test Case Form with Dynamic Name Generation and UI Improvements

- Added functionality for dynamic test name generation based on selected table and test type, ensuring unique and descriptive names.
- Introduced state management for manual test name editing to prevent overwriting user input.
- Updated styles for the block editor to improve visual consistency and usability.
- Enhanced form initialization and auto-generation logic for test names, improving user experience during test case creation.

* Add Bundle Suite Form and Integrate with Data Quality Page

- Introduced a new BundleSuiteForm component for creating and managing test suites, including form fields for name, description, and test case selection.
- Implemented styling for the Bundle Suite Form to enhance user experience and visual consistency.
- Integrated the BundleSuiteForm into the DataQualityPage, allowing users to open the form as a modal for adding new test suites.
- Added state management for modal visibility and handlers for opening and closing the Bundle Suite modal.
- Enhanced the overall layout and functionality of the Data Quality page to accommodate the new test suite feature.

* Enhance styling for Data Quality test case forms

- Added padding to the last paragraph of the block editor in both TestCaseFormV1 and BundleSuiteForm components to improve layout and visual consistency.

* Enhance Data Quality UI with new components and styling

- Added a PageHeader and Searchbar to the TestCases component for improved user navigation and search functionality.
- Introduced a new stylesheet for TestSuites to enhance layout and visual consistency.
- Refactored TestSuites component to include a styled header and integrated Searchbar.
- Updated DataQualityTab to accept a tableHeader prop for better customization.
- Enhanced styling for Data Quality tab and table components to improve overall user experience.

* Refactor DataQualityTab to enhance test case status management

- Removed unused imports and streamlined component structure for better readability.
- Introduced a new handleStatusSubmit function to manage test case status updates.
- Replaced the previous status display with a TestCaseIncidentManagerStatus component for improved functionality and user interaction.
- Adjusted the width of the incident column for better layout consistency.

* Add test case insight translations and update styles

- Added translations for "test-case-insight-plural" and "test-case-insight-description" in multiple languages to enhance localization support.
- Updated the stylesheet for TestSuites to include a copyright notice for compliance and clarity.

* Remove deprecated Data Quality chart widgets and associated styles

- Deleted unused components including DataAssetsCoveragePieChartWidget, DataStatisticWidget, EntityHealthStatusPieChartWidget, IncidentTimeChartWidget, IncidentTypeAreaChartWidget, StatusByDimensionCardWidget, and TestCaseStatusAreaChartWidget to streamline the codebase.
- Removed corresponding LESS styles and test files to ensure a clean and maintainable project structure.
- Updated CustomPieChart component for improved rendering and styling consistency.

* Remove StatusCardWidget interface file to streamline Data Quality components

* Add showLegends prop to CustomPieChart and update styles

- Introduced a new `showLegends` prop in the `CustomPieChart` component to conditionally render legends.
- Enhanced the component's layout with a new wrapper class for better styling.
- Updated associated LESS styles to support the new legend display functionality.

* Enhance Data Quality UI with new Bundle Suite functionality

- Added "Bundle Suite" and "Bundle Suites" entries to the English locale file for improved user interface.
- Refactored DataQualityClassBase to remove the unused getManageExtraOptions method and introduced getExportDataQualityDashboardButton method.
- Updated DataQualityPage to include a dropdown menu for adding test cases and bundle suites, enhancing user interaction and functionality.

* Enhance query parameter handling in Data Quality components

- Updated the `TestCases` component to use brackets for array formatting in query strings.
- Improved `useTableFilters` hook to handle both array format and comma-separated strings for filter values.
- Removed unnecessary array-to-string conversion to maintain array format in query parameters.

* Enhance Data Quality UI with custom gradient drawer and filter bar

- Added a custom gradient header style for the drawer in the TestCaseFormV1 and BundleSuiteForm components.
- Updated the DataQualityPage to include a new class for the data quality filters bar, improving layout and styling.
- Refactored TestCases and TestSuites components to utilize Card components for better organization of filter elements.

* Enhance TestCaseIncidentManagerStatus component and update locale files

- Refactored the TestCaseIncidentManagerStatus component to improve the edit icon button functionality, including permission checks and translation support.
- Added "Bundle Suite" entries to multiple locale files (de-de, es-es, fr-fr, gl-es, he-he, ja-jp, ko-kr, mr-in, nl-nl, pr-pr, pt-br, pt-pt, ru-ru, th-th, tr-tr, zh-cn) for improved internationalization.

* Add EditTestCaseModalV1 component and associated tests

- Introduced the EditTestCaseModalV1 component for editing data quality test cases, featuring a comprehensive form with validation and dynamic fields.
- Implemented unit tests for the EditTestCaseModalV1 component to ensure proper rendering, functionality, and interaction with mock data.
- Updated styles for the new modal and integrated it into the DataQualityTab for seamless user experience.
- Enhanced the TestCaseFormV1 with additional styling and functionality to support the new modal integration.

* Refactor Data Quality components for improved functionality and localization

- Updated the success toast message in BundleSuiteForm to use a more descriptive translation key.
- Enhanced the Severity component to display permission messages correctly when editing severity.
- Improved the TestCaseIncidentManagerStatus component to provide clearer edit button titles based on permissions.
- Refactored the SummaryPieChartCard component to streamline the PieChart rendering process.
- Updated test cases for TestCases and TestSuites components to ensure proper rendering and functionality with mocked components.
- Enhanced DataQualityPage tests to cover modal functionality and tab integration, ensuring a comprehensive testing approach.

* Refactor Data Quality UI components for improved test suite functionality

- Updated TestSuite.spec.ts to streamline test suite creation and navigation.
- Enhanced TestCaseFormV1, BundleSuiteForm, and TestSuites.component.tsx with data-testid attributes for better testability.
- Modified DataQualityTab to conditionally set data-testid for delete buttons based on context.
- Adjusted TestSuiteDetailsPage to incorporate DataQualitySubTabs for improved routing and navigation.

* Refactor test cases and UI components for improved functionality and consistency

- Updated IncidentManager.spec.ts to check for 'Failed' status using data-testid attributes.
- Modified Permission.spec.ts to enhance test case editing with updated button identifiers.
- Refactored Table.spec.ts to standardize test case selection by updating data-testid values.
- Enhanced DataQualityAndProfiler.spec.ts and TestCases.spec.ts to improve test case editing and validation.
- Updated EditTestCaseModalV1 to use a data-testid for the modal title for better testability.
- Adjusted DataQualityTab to include data-testid for status badges, improving test reliability.

* Add new SVG icons and enhance AlertBar component styles

- Introduced new SVG icons: ic-table-test.svg and ic-tag-new.svg for improved UI representation.
- Enhanced AlertBar styles with a new grey-info type for better visual distinction.
- Updated AlertBar interface to support the new grey-info type and added a className prop for customization.
- Refactored AlertBar component to utilize the new className prop for dynamic styling.
- Improved TestCaseFormV1 layout and integrated AlertBar for displaying contextual messages.
- Updated various components to support new styling conventions and improve overall UI consistency.

* Add calendar SVG icon and refactor Data Quality UI components

- Introduced a new calendar SVG icon for enhanced visual representation.
- Refactored EditTestCaseModalV1 and TestCaseFormV1 components to improve layout and styling consistency.
- Updated form item classes and button types for better UX.
- Enhanced BundleSuiteForm with improved card sections and integrated AlertBar for contextual messaging.
- Removed unused BundleSuiteForm styles to streamline the codebase.

* Enhance Data Quality UI with error handling and styling improvements

- Added floating error alert functionality in EditTestCaseModalV1, TestCaseFormV1, and BundleSuiteForm for better user feedback.
- Introduced error message state management to display relevant error messages inline.
- Updated styles for floating error alerts to ensure visibility and consistency across components.
- Enhanced form submission error handling to provide clearer user guidance.
- Updated translations to include pipeline information for various languages.

* Enhance Data Quality UI with new icons and layout improvements

- Added new SVG icons for data assets coverage and health check to improve visual representation in the UI.
- Updated the PieChartSummaryPanel to include icons for better context in summary cards.
- Refactored form components to improve layout consistency and user experience.
- Introduced a new constant for maximum name length to enforce validation across forms.
- Enhanced styling for form switch containers to improve visual clarity and usability.

* Update translations for various languages to include new terms related to column and table levels, test application, and selection prompts. This enhances the user interface by providing clearer context in multiple languages.

* Update translations for various languages to improve clarity and consistency in user interface terms related to bundle suites, column levels, and scheduling descriptions. This enhances the overall user experience across multiple languages.

* Refactor BundleSuiteForm tests to improve clarity and functionality

- Updated imports to include React for better compatibility.
- Enhanced mock implementations for translation and alert handling.
- Improved test assertions for rendering components in different modes.
- Clarified comments regarding API availability for form submission.

* Enhance BundleSuiteForm with Scheduler Functionality

- Added 'enableScheduler' option to the BundleSuiteForm interface.
- Updated tests to verify rendering and functionality of scheduler fields based on the toggle state.
- Refactored form to conditionally display scheduler-related fields when the scheduler is enabled.
- Ensured proper handling of form submission based on the scheduler's state.

* Refactor Data Quality Test Components and Remove Unused Code

- Removed the AddDataQualityTestV1 component and its associated tests.
- Updated AuthenticatedAppRouter to eliminate references to removed components.
- Refactored TestCaseFormV1 and BundleSuiteForm to remove the isDrawer prop and adjust related tests.
- Enhanced the integration of TestCaseFormV1 within the TableProfiler context for better drawer management.
- Cleaned up unused routes and constants related to data quality tests.
- Updated styles and tests to reflect the changes in component structure and functionality.

* Enhance TestCaseFormV1 with Permission Checks and Cleanup

- Integrated permission checking for creating test cases based on table access.
- Added loading state for permission checks to improve user experience.
- Cleaned up unused state variables and effects in TestCaseFormV1.
- Updated AddTestCaseList component to include necessary dependencies in hooks.
- Added new localization string for permission error messages.

* Enhance Permission Handling in Data Quality Components

- Integrated permission checks for creating and editing test cases in TestCaseFormV1 and BundleSuiteForm.
- Updated state management to reflect permission-based conditions for enabling features like pipeline creation and scheduler options.
- Refactored related components to ensure proper dependency handling in hooks.
- Improved test coverage for permission-related functionalities across affected components.

* Refactor Data Quality Test Cases and Improve UI Interactions

- Updated test case creation and editing flows in various spec files to enhance user experience and reliability.
- Replaced deprecated selectors and improved response handling for API calls.
- Streamlined pagination functionality in test cases list to ensure proper visibility and interaction.
- Enhanced permission checks in DataQualityPage and TestCaseFormV1 to ensure proper access control.
- Improved loading states and notifications for better user feedback during test case operations.

* fixed failing playwright

* Add new Playwright test for Data Quality Test Case creation flow

- Implemented a comprehensive test suite for adding table and column-level test cases in the Data Quality feature.
- Included permission checks to ensure non-owner users cannot create test cases.
- Enhanced user interactions and response handling for improved reliability and feedback during test case operations.

* address review  comment

* added playwright test for nested columns suggestions (#22378)

* supported playwright test for nested columns suggestions

* added test code around it

* Docs: Meta Description Updation (#22407)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Docs: RDS IAM Auth Updation (#22410)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: matillion Note Removal in Requirements (#22385)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Fix JVM params (#22409)

* Fix whats new design (#22401)

* fix(ui): whats new alert redesign

* version updgrade condition fix

* update translation

* address comment

* Docs: 1.8.4 Release Updation (#22387)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Correcting GCS Composer to GCP Composer (#22429)

* Docs: Correcting GCS Composer to GCP Composer

* Docs: Correcting GCS Composer to GCP Composer

---------

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* fix the console error of domain and owner in classification page (#22419)

* feat: improve test result details for GX integration (#22424)

* Docs: Meta Description Updation (#22433)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Minor: Fix the AutoPilot test flakiness (#22414)

* Fix the AutoPilot specs

* Increase the AutoPilot timeout

* fix: Add support for editing "Compute row coun" from parameter screen #22139 (#22158)

* fix: Add support for editing "Compute row coun" from parameter screen #22139

* fixed failing test

* Fix Threads relations (#22432)

* Fix Threads relations

* Fix Post.getFrom

* Fix THREAD Entity

* Update Message

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Docs: Artifacts Removal (#22442)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Meta Tags Updation (#22444)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Fixes #22363 #22369: Stored procedure temp table processing and lineage filtering with db & schema (#22416)

* Process temp table graph in stored procedure processor and add db/schema filtering on lineage

* Add tests for stored procedure lineage processing

* Fix tests and py_format

* Fix the filters and log stored proc query count info

* Playwright Update: Bulk Import (#22436)

Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>

* Docs: Databrick Features Updation (#22448)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* Docs: Meta Updation (#22451)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>

* Docs: 18.4 to 1.8.6 Release Updation (#22455)

Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>

* fix the flaky glossary bulk edit failure (#22446)

* Add matchtype for fields

* Fix search queries exact match

* Search aggregates are consistent in query with dataAsset or table as specific Index

* Add Tests

* Fix sonar warnings

* revert config

* Update generated TypeScript types

* Add more tests

* Make boost 20.0 for all keyword exact matches default

* uncomment WorkFlowHandler Initialization

* fix SearchSourceBuilderFactoryTest

* fix default sort order for tags data products on explore

* fix type errors

* fix and add e2e for match type

* add e2e test for explore page count

* fix explore count test

* fix index for search preview

* Update generated TypeScript types

* minor fix

---------

Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Ajith Prasad <37380177+aji-aju@users.noreply.github.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Ethan <63649819+kuma0128@users.noreply.github.com>
Co-authored-by: Keshav Mohta <68001229+keshavmohta09@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shrushti Polekar <shrushtipolekar@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Dhruv Parmar <83108871+dhruvjsx@users.noreply.github.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Nick Acosta <30478672+PubChimps@users.noreply.github.com>
Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>
Co-authored-by: Rounak Dhillon <162090200+RounakDhillon@users.noreply.github.com>
Co-authored-by: “Rounak <“rounakpreet.d@deuexsolutions.com”>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Himanshu Khairajani <46777429+Khairajani@users.noreply.github.com>
Co-authored-by: satish <satishmwaghela@gmail.com>
Co-authored-by: Satish <satish@Satishs-MacBook-Pro.local>
Co-authored-by: x-0-r <franz.emberger@gmail.com>
Co-authored-by: Sweta Agarwalla <105535990+sweta1308@users.noreply.github.com>
Co-authored-by: Prajwal Pandit <prajwalpandit@MacBook-Pro.local>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Sweta Agarwalla <swetaagarwalla13@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: zuohuan <37143749+zuozuowudi@users.noreply.github.com>
Co-authored-by: zuohuan <zuohua12@163.com>
Co-authored-by: Akash Verma <138790903+akashverma0786@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Ram Narayan Balaji <81347100+yan-3005@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Pranita <pfulsundar8@gmail.com>
2025-07-22 08:52:20 -07:00
Himanshu Khairajani
77ea2875f7
Feat: Automator - lineage propagation : stop condition, propagation depth (#22390)
* Feat: Lineage propagation stop condition support (#22185)

* feat: lineage stop condition and propagation

* Update generated TypeScript types

* Chore: stop propagation config updates

* Update generated TypeScript types

---------

Co-authored-by: --global <--global>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Feat: Automator - support to perform lineage propagation till given depth (#22379)

* Chore: Refactoring

* Update generated TypeScript types

* Chore: json schema config fix

* Update generated TypeScript types

* Feat: Automator propagation docs update

* revert: Chore: json schema config fix

* Update generated TypeScript types

* Chore: Update docs for scenario - mulitple parents attrbibutes with differerent depth

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: --global <--global>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-22 09:48:00 +02:00
Chirag Madlani
b098395602
Data contracts support for tables & Multi Domain Migration (#22108)
* WIP - MINOR - Rule Engine

* WIP - MINOR - Rule Engine

* WIP - MINOR - Rule Engine

* WIP - MINOR - Rule Engine

* rules

* rules

* rules

* fix retrieval by entity

* test dc

* test dc

* WIP: Data contract feature

* destructure component to it's own files

* WIP contract tab

* update local

* fix test

* First iteration for multi domain support

* fix inheritance fields

* fix inheritance fields

* fix create interface

* fix few more tests

* fix indexing updates

* fix domain rel

* update domain --> domains

* merge

* fix merge

* fix csv tests and createEntity interface

* Update generated TypeScript types

* Trigger Build

* migrations

* fix tests

* fix tests

* fix tests

* Update generated TypeScript types

* Trigger Build

* handle drive service

* fix pg migration

* fix domains ref after merge and clean python tests

* Update generated TypeScript types

* fix merge domains

* format

* add missing migrations

* Update generated TypeScript types

* tests

* Update generated TypeScript types

* Trigger Build

* tests

* tests

* fix py test

* migrate domain to domains and fix compilation errors

* fix domain assignement

* fix domain spec

* fix py tests

* fix data product creation issue

* fix domain tests

* fix bulk import

* fix tests

* fix tests

* fix query and domain migration

* fix py test

* fix playwrights

* fix getEntitiesWithDisplayName indexing quotes

* fix domain prapogation tests

* fix domain propagation

* Fix patch api

* fix domain schema build edit playwright

* fix test

* fix test

* fix domain selection issue and console errors

* quick fix landing page changes

* fix remaining tests

* fix ui tests

* Fix adding data products

* format

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-22 09:34:50 +02:00
Mohit Yadav
7fe431a2a0
- Add Actual Case on the displayName to aggregate with right bucket … (#22380)
* - Add Actual Case on the displayNamce to aggregate with right bucket Names

* suuport actual case for name

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2025-07-21 20:56:42 -07:00