* made ui enhancement in setting page
* ui fixes
* fix ui render in application and other setting page
* fix unit test and user profile page issues
* added loader in team selectable in user profile page
* changes as per comments
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* feat(nosql-profiler): row count
1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.
* added profiler support for mongodb connection
* doc
* use int_admin_ometa in test setup
* - fixed linting issue in gx
- removed unused inheritance
* moved the nosql function into the metric class
* formatting
* validate_compose: raise exception for bad status code.
* fixed import
* format
* feat(connector): add BigTable
* bigtable work
1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter
* docs moved to separate PR
* format files
* minor cosmetic
- removed TODO
- changed headers' year to 2024 for new files
- fixed typos
* format
* formatting and comments
1. added missing docstrings.
2. abstracted the _find_instance method.
3. aliased the IDs used in the BigTable connection
* added comment regarding private key
* added comments regarding column families
* enclose get_schema_name_list in `try/except/else`
* format
* streamlined get_schema_name_list to include all logic in the try block
* linting: fix python linting
* fix: get column types from parquet schema for parquet files
* style: python linting
* fix: remove displayType check in test as variation depending on OS
* Fix#14786: Suggestions API
* Handle suggestions in ometa
* Minor: Optimise Databricks Client (#14776)
* MINOR - Fix SP topology context & Looker usage context (#14816)
* MINOR - Fix SP topology context & Looker usage context
* MINOR - Fix SP topology context & Looker usage context
* Fix tests
* Fixes#14598: Fix Tags / Labels ingestion on includeTags as False (#14782)
* fix(ui): password error message for char limits (#14808)
* fix(ui): password error message for char limits
* fix java side code
* Fixes#13556: Support for Salesforce table description ingestion (#14733)
* ISSUE-13556: Add suport for Salesforce table description ingestion
* ISSUE-13556: Remove unnecessary blank line
* ISSUE-13556: Fix to get description for each table
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
* MINOR - Better handling of Ingestion Pipeline Status (#14792)
* MINOR - Better handling of Ingestion Pipeline Status
* format
* format
* MINOR: Added table validation for cost analysis data (#14793)
* Added validation for cost analysis source
* centralized life cycle logic
* CYPRESS: simplify side navigation click in cypress (#14818)
* simplify side navigation click in cypress
* make sidbar item uses common enum
* fix cypress failure of outside import
* fix(#14326): tier dropdown is not working in advance search (#14780)
* improvement in advance search based on custom property
* fix a reading undefined property issue
* wip: advance search based on tier
* some code cleanup and improvement
* some fixes
* fix: ui flicker when advanceSearched is apply and refresh the page
* some cleanup
* no need to call customproperty api call, if entity not suppport customProperties
* minor change
* fix: autocomplete not working in tier search option in advance search modal
* added unit test for advance search provider component
* some cleanup
* added testcase for open modal
* added testcase for resetAllFilters method
* removed unwanted code
* added e2e test for testing tier advance search
* fix: e2e search flow for single field
* fix: string field not working after giving listValues in TierSearch
* fix: group query e2e test fix
* used asyncFetch way to get the tierOptions synchronously
* some cleanup
* remove unwanted lines
* some cleanup
* fix: selected option show option value instead of option title
* fix(minor): update skip icon for executions (#14809)
* Fixes#14803: ignore capitalization when confirming deletes (#14804)
* ignore case when confirming deletes
* Test confirmation of deletes works when case differs
Added test case for 'delete' as the confirmation text.
* minor(config): update openmetadata-ui code reviewers (#14823)
* Add Tests
* Add list/accept/reject apis
* initial ui changes
* localisation
* show suggestion for empty description
* ui feedbacks
* Fix permission check for entities without owner
* Fix entityLink and add tests
* Add update suggestion WIP
* Fix test
* Fix PUT and Pagination
* Fix styling
* update test
* Update status
* add OM server connection in apps
* add permissions check
* Fix CI
* Remove TODO
* Fix feedResourceTest
* fix unit tests
* add private configs for apps
* add private configs for apps
* fix update application icons
* minor center align icon
* add private configs for apps
* Format
* Fix pydantic gen
* Remove token
* Update name
* Rework private conf
* Fix apps
* Fix apps
* Format
* Format
* show metapilot only if its installed
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: kwgdaig <18678754+kwgdaig@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Abhishek Porwal <80886271+Abhishek332@users.noreply.github.com>
Co-authored-by: Carlo Q <carlo@machina.bio>
Co-authored-by: karanh37 <karanh37@gmail.com>
* Fix(#14262): Format the ES reindexing logs for better readability
* Refactor formatJsonString function in StringsUtils.ts
* Fix Error Schema for Search Indexing Application
* Refactor AppLogsViewer.component.tsx
* Fix import order and add default value for formatJsonString
* Refactor formatJsonString function in StringsUtils.ts
* Fix Schema
---------
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Create the iceberg connection schema
* Link the IcebergConnection configuration with the forms on the UI
* Add the pyiceberg dependency on the ingestion package
* Create the get_connection and test_connection functions
* First iteration on the iceberg ingestion logic
* Add A more comprehensive implementation of the Iceberg Source
* Add UnitTests
* Update icebergConnection definition
* Update the iceberg souce code based on new schema
* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters
* Updated setup dependencies to be more flexible
* Updated get_owner_ref logic
* Fix formatting
* Changed the icebergConnection json schema structure to enable the ClassConverters
* Add the IcebergCatalog and IcebergFileSystem ClassConverters
* Refactor the code to take into account the new jsonSchema structure
* Fix formatting
* Add Documentation for the Iceberg Connector
* Fix Menu order for Iceberg
* ui: add Iceberg service icon and constant
* Fix DynamoDb Catalog issue due to how PyIceberg instantes it
* Changed uri title to URI
* Fix ClassConverter for Iceberg
* Fix GetSecretValue for password types
* Fix formatting
* Fix formatting
* Add Iceberg Connector Images for the docs
* Add pylint disable for Hacky super() call
* Add Iceberg.md for the UI docs
* Fix pylint complaint
* Fix pylint complaint
* Fix UnitTests
* fix type error and unit tests
* update pipeline type checks
* Fix Sonar Cloud complaints
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#11944: API support to fetch count for mentions
* Add closedTask/totalTask
* fetch count as per new count api for entity and user page and remove mentions tab from entity
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* added data observability settings page
* localization changes for other languages
* Handler closure and cleanup
* complete create observibility flow
* fix searchIndex method error
* Update Entity Observability Filter
* working observability creation
* complete creation flow
* fix action with arguments
* fix form validations and form data formulation for 'input.actions' field
* localization changes for other languages
* Fixes for Data Observability
* Add mention notification
* Only apply mention to conversation
* fIx test case
* bug fixes for add and edit observability alert form functionality
* fIx test case
* add feature to config internal along with external destinations in alert form
* Fix Formatting
* Fix Url Redirection
* add observability alert details page
* localization changes for other languages
* remove filter and action required rules
* fix styling for observability form and details page
* add delete functionality on observability alert details page
* update view page layout and add a warning in configure destination step
* localization changes for other languages
* feat(ui): support notification with new flow (#14848)
* feat(ui): support notification with new flow
* fix notifications
* add missing filters for notification alert creation flow
* update the filter hiding logic to show at the start always
* add check to show Actions section in observability alert creation form
* code cleanup and improvements
* add breadcrumb to add notification alert page
* Add General Metadata Filters
* remove code smells and code cleanup for add notification page
* add new filter
* show activity feed alert on notifications list page
* add notification alert details page changes
* localization changes for other languages
* show icons for all the entities in the alert trigger dropdown
* redirect to notification alert listing page after deleting the notification alert
* change add alert page title
* add logic to disable all destinations except email for users
* fixed unit tests
* code improvements and cleanups
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Centralize EventType
* Format better for readability
* Add Handling for Thread as Change Event
* Centralize logic for Entity Message Creation
* Add Thread Parent Message in Conversation
* Add Task and Announcement
* Support for multiple destinations
* Delete existing alerts for schema changes
* Delete all tables data for event subscription
* Centralize logic for Notifications and Observability
* Change Field Name and Remove redundant code
* Test Fixes
* Add more fields
* Add Optional
* Logical Test Case Addition Chnage Event
* Add Filter By Owner
* Fix Email Entity Url
* Handler closure and cleanup
* Remove unnecessary field
* Remove unnecessary field
* Support query comments in MSSQL
* Remove unnecessary field
* Format
* Add external type
* Add MSSQL SP support
* MINOR - Test Case Ownership, keep severity, add test case result incidentId
* fix immutability
* Fix tests
* MINOR - Test Case Ownership, keep severity, add test case result incidentId
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* feat: SAS Viya connector
* refactor SASCatalog to SAS
* add SAS logo to UI and connection documentation
* doc changes
* modify ingestion logic
* revert original changes
* added support for dataflow & perfect logic for reports/datatables
* add filter doc
* more updates to perfect ingestion for each asset type
* fix a bug with table lineage not created properly
* Delete ingestion/pipelines/sasCatalog.yaml
* precomit fix
* Conversion to database connector
* minor fixes
* make custom properties type generic
* Add SAS javaEnum
* add dummy variable for sas.yaml
---------
Co-authored-by: lizmc <liz.mcintosh@sas.com>
Co-authored-by: Shiyang Xiao <Shiyang.Xiao@sas.com>
* Remove LMAX Disruptor , use queue and Quartz
* Spotless Fix
* Spotless formatting
* Review Comments
* Improvements
* Improvements to add Retry and DLQ
* Spotless fix
* Update Stats
* Fix stats
* Fix delete Failures
* Fix Failing Tests
* Fix Failing Tests
* Fix Failing Tests
* Postgres Fix
* Fix Schema Change for Change Event Table
* Failing test
* Fix Error for non ChangeDescriptions
* Adds Observability On Top of Event Subscription
* Make List Separate
* Add more filters for Test Suite
* Populate Default Schema Updates to Look for
* typo
* Add matchFieldChange and other in paramAdditionalContext
* Review Comments
* Spotless fix
* Merge issue
* Update Filter as per new Syntax
* Fix Failing Test
* Add field and index
* MINOR - Move test case incident to the top of the data_quality_data_time_series table
* Fix test
* Fix compile
* Format
* Update incidentId
* Rename field
* Fix patch
