* linting: fix python linting
* fix: get column types from parquet schema for parquet files
* style: python linting
* fix: remove displayType check in test as variation depending on OS
* Fix#14786: Suggestions API
* Handle suggestions in ometa
* Minor: Optimise Databricks Client (#14776)
* MINOR - Fix SP topology context & Looker usage context (#14816)
* MINOR - Fix SP topology context & Looker usage context
* MINOR - Fix SP topology context & Looker usage context
* Fix tests
* Fixes#14598: Fix Tags / Labels ingestion on includeTags as False (#14782)
* fix(ui): password error message for char limits (#14808)
* fix(ui): password error message for char limits
* fix java side code
* Fixes#13556: Support for Salesforce table description ingestion (#14733)
* ISSUE-13556: Add suport for Salesforce table description ingestion
* ISSUE-13556: Remove unnecessary blank line
* ISSUE-13556: Fix to get description for each table
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
* MINOR - Better handling of Ingestion Pipeline Status (#14792)
* MINOR - Better handling of Ingestion Pipeline Status
* format
* format
* MINOR: Added table validation for cost analysis data (#14793)
* Added validation for cost analysis source
* centralized life cycle logic
* CYPRESS: simplify side navigation click in cypress (#14818)
* simplify side navigation click in cypress
* make sidbar item uses common enum
* fix cypress failure of outside import
* fix(#14326): tier dropdown is not working in advance search (#14780)
* improvement in advance search based on custom property
* fix a reading undefined property issue
* wip: advance search based on tier
* some code cleanup and improvement
* some fixes
* fix: ui flicker when advanceSearched is apply and refresh the page
* some cleanup
* no need to call customproperty api call, if entity not suppport customProperties
* minor change
* fix: autocomplete not working in tier search option in advance search modal
* added unit test for advance search provider component
* some cleanup
* added testcase for open modal
* added testcase for resetAllFilters method
* removed unwanted code
* added e2e test for testing tier advance search
* fix: e2e search flow for single field
* fix: string field not working after giving listValues in TierSearch
* fix: group query e2e test fix
* used asyncFetch way to get the tierOptions synchronously
* some cleanup
* remove unwanted lines
* some cleanup
* fix: selected option show option value instead of option title
* fix(minor): update skip icon for executions (#14809)
* Fixes#14803: ignore capitalization when confirming deletes (#14804)
* ignore case when confirming deletes
* Test confirmation of deletes works when case differs
Added test case for 'delete' as the confirmation text.
* minor(config): update openmetadata-ui code reviewers (#14823)
* Add Tests
* Add list/accept/reject apis
* initial ui changes
* localisation
* show suggestion for empty description
* ui feedbacks
* Fix permission check for entities without owner
* Fix entityLink and add tests
* Add update suggestion WIP
* Fix test
* Fix PUT and Pagination
* Fix styling
* update test
* Update status
* add OM server connection in apps
* add permissions check
* Fix CI
* Remove TODO
* Fix feedResourceTest
* fix unit tests
* add private configs for apps
* add private configs for apps
* fix update application icons
* minor center align icon
* add private configs for apps
* Format
* Fix pydantic gen
* Remove token
* Update name
* Rework private conf
* Fix apps
* Fix apps
* Format
* Format
* show metapilot only if its installed
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: kwgdaig <18678754+kwgdaig@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Abhishek Porwal <80886271+Abhishek332@users.noreply.github.com>
Co-authored-by: Carlo Q <carlo@machina.bio>
Co-authored-by: karanh37 <karanh37@gmail.com>
* Fix(#14262): Format the ES reindexing logs for better readability
* Refactor formatJsonString function in StringsUtils.ts
* Fix Error Schema for Search Indexing Application
* Refactor AppLogsViewer.component.tsx
* Fix import order and add default value for formatJsonString
* Refactor formatJsonString function in StringsUtils.ts
* Fix Schema
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Create the iceberg connection schema
* Link the IcebergConnection configuration with the forms on the UI
* Add the pyiceberg dependency on the ingestion package
* Create the get_connection and test_connection functions
* First iteration on the iceberg ingestion logic
* Add A more comprehensive implementation of the Iceberg Source
* Add UnitTests
* Update icebergConnection definition
* Update the iceberg souce code based on new schema
* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters
* Updated setup dependencies to be more flexible
* Updated get_owner_ref logic
* Fix formatting
* Changed the icebergConnection json schema structure to enable the ClassConverters
* Add the IcebergCatalog and IcebergFileSystem ClassConverters
* Refactor the code to take into account the new jsonSchema structure
* Fix formatting
* Add Documentation for the Iceberg Connector
* Fix Menu order for Iceberg
* ui: add Iceberg service icon and constant
* Fix DynamoDb Catalog issue due to how PyIceberg instantes it
* Changed uri title to URI
* Fix ClassConverter for Iceberg
* Fix GetSecretValue for password types
* Fix formatting
* Fix formatting
* Add Iceberg Connector Images for the docs
* Add pylint disable for Hacky super() call
* Add Iceberg.md for the UI docs
* Fix pylint complaint
* Fix pylint complaint
* Fix UnitTests
* fix type error and unit tests
* update pipeline type checks
* Fix Sonar Cloud complaints
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#11944: API support to fetch count for mentions
* Add closedTask/totalTask
* fetch count as per new count api for entity and user page and remove mentions tab from entity
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* added data observability settings page
* localization changes for other languages
* Handler closure and cleanup
* complete create observibility flow
* fix searchIndex method error
* Update Entity Observability Filter
* working observability creation
* complete creation flow
* fix action with arguments
* fix form validations and form data formulation for 'input.actions' field
* localization changes for other languages
* Fixes for Data Observability
* Add mention notification
* Only apply mention to conversation
* fIx test case
* bug fixes for add and edit observability alert form functionality
* fIx test case
* add feature to config internal along with external destinations in alert form
* Fix Formatting
* Fix Url Redirection
* add observability alert details page
* localization changes for other languages
* remove filter and action required rules
* fix styling for observability form and details page
* add delete functionality on observability alert details page
* update view page layout and add a warning in configure destination step
* localization changes for other languages
* feat(ui): support notification with new flow (#14848)
* feat(ui): support notification with new flow
* fix notifications
* add missing filters for notification alert creation flow
* update the filter hiding logic to show at the start always
* add check to show Actions section in observability alert creation form
* code cleanup and improvements
* add breadcrumb to add notification alert page
* Add General Metadata Filters
* remove code smells and code cleanup for add notification page
* add new filter
* show activity feed alert on notifications list page
* add notification alert details page changes
* localization changes for other languages
* show icons for all the entities in the alert trigger dropdown
* redirect to notification alert listing page after deleting the notification alert
* change add alert page title
* add logic to disable all destinations except email for users
* fixed unit tests
* code improvements and cleanups
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* Handler closure and cleanup
* Remove unnecessary field
* Remove unnecessary field
* Support query comments in MSSQL
* Remove unnecessary field
* Format
* Add external type
* Add MSSQL SP support
* MINOR - Test Case Ownership, keep severity, add test case result incidentId
* fix immutability
* Fix tests
* MINOR - Test Case Ownership, keep severity, add test case result incidentId
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* feat: SAS Viya connector
* refactor SASCatalog to SAS
* add SAS logo to UI and connection documentation
* doc changes
* modify ingestion logic
* revert original changes
* added support for dataflow & perfect logic for reports/datatables
* add filter doc
* more updates to perfect ingestion for each asset type
* fix a bug with table lineage not created properly
* Delete ingestion/pipelines/sasCatalog.yaml
* precomit fix
* Conversion to database connector
* minor fixes
* make custom properties type generic
* Add SAS javaEnum
* add dummy variable for sas.yaml
---------
Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
* Remove LMAX Disruptor , use queue and Quartz
* Spotless Fix
* Spotless formatting
* Review Comments
* Improvements
* Improvements to add Retry and DLQ
* Spotless fix
* Update Stats
* Fix stats
* Fix delete Failures
* Fix Failing Tests
* Fix Failing Tests
* Fix Failing Tests
* Postgres Fix
* Fix Schema Change for Change Event Table
* Failing test
* Fix Error for non ChangeDescriptions
* Adds Observability On Top of Event Subscription
* Make List Separate
* Add more filters for Test Suite
* Populate Default Schema Updates to Look for
* typo
* Add matchFieldChange and other in paramAdditionalContext
* Review Comments
* Spotless fix
* Merge issue
* Update Filter as per new Syntax
* Fix Failing Test
* Add field and index
* MINOR - Move test case incident to the top of the data_quality_data_time_series table
* Fix test
* Fix compile
* Format
* Update incidentId
* Rename field
* Fix patch
* Allow users to login with their user name in LDAP mode, and assign roles to user according to their LDAP group while login
* Fix#12503: Ldap feature: Allow user login using username and reassign roles based on users' ldap groups when login
---------
Co-authored-by: wentian <zb-wentian@kingmed.com.cn>
Co-authored-by: EricWent <135603556+EricWent@users.noreply.github.com>
* global manifest option for storage services
* added a no metadata config source option for global manifest s3 services option
* merge fixes
* more merge fixes.
* black stuff
* test fixes
* formatting
* storage service container automatic deletion support
* reverted auto-modified files.
* styling
* linting
* fix: return null is no aggregation value is present
* fix: added Optional typing
* style: java linting
* fix: use Optional type hint
* style: java linting
* feat: add test case resolution task workflow
* chore: add migration for test case resolution feature
* fix: removed required field for object compatibiity in older migrations
* fix: minor testCaseResolution status logic
* chore: revert migration for test case incident
* chore: update migration file
* style: renamed variables
* feat: added logic to compute failed/passed rows
* feat: add support for row level computation in schema
* chore: add test definition migration
* feat: add logic to explicitly compute row level failure
* chore: clean up code
* style: fix java
* style: fix pyton format
* fix: unhidde API for incident manager
* style: fix java styling
* feat: add test case resolution task workflow
* chore: add migration for test case resolution feature
* fix: removed required field for object compatibiity in older migrations
* fix: minor testCaseResolution status logic
* chore: revert migration for test case incident
* chore: update migration file
* chore: clean up code
* style: fix java stylecheck
