* Refactor Search
* Refactor Search
* Fix propgation bugs
* Fix propgation bugs
* Fix glossary term search
* Fix glossary term search
* Only issue search requests if the client is configured properly
* Only issue search requests if the client is configured properly
* Fix glossary index
* add documentation for sharded tables (#13361)
* Cost analysis agg (#13408)
* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes
* feat: __init__.py files creation
* feat: updated workflow import classes in code and doc
* feat: moved kpi runner from runner to processor folder
* fix: skip failure on list entities
* feat: deleted unused files
* feat: updated status reporter
* feat: ran linting
* feat: fix test error with typing and fqn
* feat: updated test dependencies
* feat: ran linting
* feat: move execution order up
* feat: updated cost analysis report to align with new workflow
* feat: fix entity already exists for pipeline entity status
* feat: ran python linting
* feat: move skip_on_failure to method
* feat: added unusedReport to DI
* feat: added aggregated unused report
* feat: ran linting
* feat: reverted compose file changes
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Add Java 17 support (#12895)
* Add Java 17 support
* Change Test HTTP client provider
* Create Tests HTTP Client once
* Create Tests HTTP Client once
* fix(CI): Update CI to use jdk 17 and dockerfiles as well
---------
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
* Refactor Search
* Refactor Search
* Fix propgation bugs
* Fix propgation bugs
* Fix glossary term search
* Fix glossary term search
* Only issue search requests if the client is configured properly
* Only issue search requests if the client is configured properly
* Fix glossary index
* Merge main
* fix style
* deleted field propagation
* Fix style
* close the test client
* Changing to jersey connector
* Fix Authentication Exception headers
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
* Separate initialization of Repository and Resources
* Change that speeds up the test. Still WIP
* Rebasing the branch with main
* Revert back previous changes and use Repositories from registry for migration
* Fixing test failures
* Code cleanup
* Fix test failures
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Changed intial implementation accordingly. Added better flexibility for different auth prodvider impl
* ISSUE-11740: Clean up unnecessary classes
* ISSUE-11740: Clean up unnecessary properties
* ISSUE-11740: Clean up unnecessary properties
* ISSUE-11740: Clean up unnecessary properties
* ISSUE-11740: Clean up unnecessary properties
* ISSUE-11740: Clean up unnecessary properties
* ISSUE-11740: Code formatting
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles
* ISSUE-11740: Moved docs to 1.2 version
---------
Co-authored-by: artiom.darie <artiom.darie@adswizz.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Fix#12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback
* Fix#12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback
* rebase with main
* Fix styling
* Add jdbiUnitOfWork
* Improvements for Change Event Repository and missing Annotations
* Add connection commit/rollback
* push schemaChange fix
* Improvements for Change Event Repository and missing Annotations
* Pass wrapped collectionDAO everywhere
* Pass wrapped collectionDAO everywhere
* Separate event handlers transactions
* Fix checkstyle
* Wrap PUT , POST, and DELETE in transactions
* Add Patch for transactions
* Add primary key to tag.id
* Proxy internal @CreateSQLObjects
* Fix exception handling in ManagedHandleInvocationHandler
* Java typo
* Update schema files
* Checkstyle fix and conflicts resolve issue
* Remove @JdbiUnitOfWOrk from Feed Repository
* remove unnecessary @JdbiUnitOfWork annotation
* Test Failures fix
* Test Failures fix
* Increase wait time , changeEventDAO takes time due to handle.commit()
* commit change
* No need to use commit in ChangeEventHandler
* Add a lookup for avoiding transaction that are not started and should not be rolled back
* remove JdbiUnitOfWork.java
---------
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Add ascii_bin for fqnhash, Add Constraints on timeseries
* Attemp of moving migrations to files
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Deprecate Flyway and use Native migrations
* Move upstream migrations to new path
* Add entity cache in EntityRepository for all the entities
* Set entity fields only when it is not already set
* Clone entities from the cache
* Remove SubjectCache
* Remove RoleCache
* Remove PolicyCache
* Remove TagLabelCache
* Deleting lingering files
* Test failure fixes
* Remove getEntityReference methods from EntityDAO
* Move quoteName logic to EntityRepository
* Fix test failures
* Fix#7712: Align AuthProvider values in the JSON schema definition
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Handle new providers
* Lint
* Fix#7712: Align AuthProvider values in the JSON schema definition
* Handle new providers
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Lint
* fix rebase
* Fix test
* Fix test
* Fix Usage of Auth Provider in User Resource
* remove unused function
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
* interfaces for db migrations
* Add Data Migration for entities to 1.1
* Migration for FQN hash
* Added Tag Usage And Fixed some transaction issue in testing
* Added SERVER_CHANGE_LOG validations
* Update Path for files
* Added Postgres Migration
* Test Suite Migration [WIP]
* remove ingestion pipeline
* moved Migration to Table Initializer
* init Data source config in TableInitializer
* make checksum ignore configurable
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Add Pipeline Service Status Job to publish to Prometheus
* Add Pipeline Service Status Job to publish to Prometheus
* Add config for health check interval
* Added Support for Slack Related Configuration , Added Slack Bot , Slack Installer and Slack Application Configuration
* comment
* Checkstyle
* Update Encrypt and Decrypt to encrypt all settings for slack
* Fix typo
* Update version for client and bolt
* Update deps
* Remove dependency for Slack bolt servlet
* Refactor Data Insight Chart for Reusability
* Data Insight Reporting
* Add Schedule Info
* Add Error Handling
* Add Profile Field
* Remove Endpoint as required field
* Missing Language
* Reformat
* Remove Task and Test Result Settings
* Fix test
* fix: typescript errors
* fix: send alertType for subscriptions request
* feat: add alert data insights report page
* Fix test
* fix: alert type typescript error
* fix: loading flicker on alerts page
* chore: add placeholders for data insight report alert page
* fix: alert icon styling
* fix: confirmation is not showing up for delete operation for subscription.
* fix: delete operation is not working from alert details page
* fix Activity Feed Errors on update
* fix: test
* chore: change the description text area to the markdown editor
* Data Insight Reporting should be created on system startup
* Restrict DataInsight Report to only one
* Review Comments
* feat: show the default DataInsightReport data
* sonar fixes
* sonar fixes
* deprecate ConfirmationModal
* trigger should be updated
* feta: add edit flow for data insight report
* remove custom option for schedule info
* chore: update data insight report icon
* test: add unit test for add data insight alert form
* fix: update cypress tests
* update local message
* test: add unit tests
* move sql changes to a different file
* spacing issues
* add tag provider in createRequest
* chore: send provider in create and update alert request.
* fix: code smells
* fix: comment typo
* fix: permission issue for event subscription
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Restructured Reindexing + Added Automated Reindexing on Glossary import
* Revert Openmetadata yaml
* Fix pending issues
* Fix stats
* Refactor to workflows and SearchIndex
* Fix Failing tests
* Get status for stream and push status with
* fix UI build failing
* replace all with entity list before hit api
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Mask sensitive info from API responses
* Rename converter classes
* Add missing Java classes from JSON schemas and class converters
* Update test service connection schema
* Update datalakeConnection JSON schema and fix some tests
* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh
* Fix Pipeline and Database service tests
* Minor refactor
* Fix CsvUtilTest
* Fix EventMonitorFactoryTest
* Fix CloudWatchEventMonitorTest
* Update datalake metadata
* Update bigquery metadata
* Fix test connection functionality
* Fix OMeta service api test
* Update gcsValues title and revert changes in GH actions
* Mask sensitive enabled by default for local docker
* Add missing tests
* Address PR comments
* Address PR comments
* fix ui breaks on gcsValues.json
* Address PR comments
* Minor refactor
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fixes#9618 Allow apostrophe in entity names
* Add support for space in entity names (with exception) and column names
* Add regex checks to entity names, table column names to allow only required characters
* fix: allowed characters in entityName
* Add all the allowed special characters in the entity name in tests
* Allow '&', '/', ':' only for the table
* Override basic entityName by defining entity specific entityName for Python code gen
* fix: dagster migration + json schema path
* fix: python style check
* Fix test failure
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Services sensitive passwords fields are stored in secrets store
* Update services on application startup in case of changes in the JSON Schema
* Minor changes after manual test
* Removed part of the secrets manager implementation in the server side
* Removed part of the secrets manager implementation in the openmetadata python library side
* Remove deprecated test
* Address pylint checks
* Address new pylint checks
* Address PR comments
* Fix import on airflows apis
* Clear singleton instances for running Ometa secrets manager test
