* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Restructured Reindexing + Added Automated Reindexing on Glossary import
* Revert Openmetadata yaml
* Fix pending issues
* Fix stats
* Refactor to workflows and SearchIndex
* Fix Failing tests
* Get status for stream and push status with
* fix UI build failing
* replace all with entity list before hit api
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* added query as an entity
* changed name of the variables and methods
* Added Resource Descriptors
* testcase bug fix
* addressing comments
* added script for table query migration
* added script for table query migration postgresql
* bug fix
* db change for script test
* added current timestamp
* change db config from postgresql to mysql
* added extension to use fucntion gen_random_uuid()
* solving maven ci
* added queryUsage and change is migration script
* addressing comments
* addressing comments
* added queryUsage relation and testcase
* added api to insert queries in bulk
* .
* fix a test case which was failing due to latest changes
* Ingestion Changes for Query as Entity
* move query changes to latest sqls
* added tags and owner
* update PR for Query as Entity
* update type
* fixed pagination
* fix path param
* fix TestCases
* add validation criteria
* removed exisitng query apis
* checkstyle fix
* remove vote from put
* remove vote from put
* Query As Entity Ingestion Changes
* Remove unused func
* update Review Comments
* update Review Comments
* remove previous changes for Query and Update Tests
* moved Checksum to Query Util Class
* update python api
* fix python checkstyle
* Fixed Tests
* Fix pytest
* remove space changes
* remove space changes
* Fixed put_addFollowerDeleteEntity_200
* Fix usage ingestion
* Update Python SDK and tests
* pylint fix
---------
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* Prep the skeleton
* Add DAO and tables
* Add Test Connection Definition Resource
* Format
* Add ResourceDescriptors & missing props
* Simplify APIs to scope for GET and LIST
* Mask sensitive info from API responses
* Rename converter classes
* Add missing Java classes from JSON schemas and class converters
* Update test service connection schema
* Update datalakeConnection JSON schema and fix some tests
* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh
* Fix Pipeline and Database service tests
* Minor refactor
* Fix CsvUtilTest
* Fix EventMonitorFactoryTest
* Fix CloudWatchEventMonitorTest
* Update datalake metadata
* Update bigquery metadata
* Fix test connection functionality
* Fix OMeta service api test
* Update gcsValues title and revert changes in GH actions
* Mask sensitive enabled by default for local docker
* Add missing tests
* Address PR comments
* Address PR comments
* fix ui breaks on gcsValues.json
* Address PR comments
* Minor refactor
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* First cut of the store service model
* Second cut of the store service model
* reverted accidental rename of property
* Third version for the object container schema definition.
* final draft version for container and object store service related entities
* final first draft of api's and entities for the object store service and container
* formatting
* removed test file
* formatting
* test fixes
* formatting
* more fixed tests
* fixed tests, addressed PR comments
* added type for object store connections
* addressed PR comments
* formatting
* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Alert Test Fix
* Removed Db calls in case local publishers available
* Fix test
* Removed unrequired code
* Maintaing entityType to class map
* checkstyle
* Schema for Alerts #9248
* 1. Api for alerts
2. Api for alertAction
API for Alert and AlertAction #9266
* missing file
* fix ui failures
* Added Api to give function parameter type and additional Context for UI
* Added default Triggers in Alerts
* checkstyle fix
* docs update
* function names updated
* added timestamp for alert status update
* receiver should be unique in json schema and alerts publishers
* updated bootstrap filters
* updatated review comments
* added functions to match eventType for entities
* added migrations for alerts
* added alert config in alertACtionConfig
* Fix issue in sending mails
* removed commented part
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config
* Add Amundsen config
* Changed SystemService to MetadataService
* Change to MetadataConnection
* Fixed failing test
* Fixed Failing test
* Added Metadata Service Test
* Bootstrapped Openmetadat service
* checkstyle fix
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* Fix pageViewEvent import issue
* Changed dataType to PERCENTAGE and NUMBER
* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#6141: Ingestion Pipeline Status Updates
* List Pipeline Status API & Improvements
* Rename State field to PipelineState in UI
* Convert Pipeline Status array to single object
* fix braking UI
* Rebase Fixes
* Profiler, TestStuite & DataInsigts Pipeline
* py_format
* fix logs page not loading
add pipelineStatus endpoint
* fix recent run changes
* Fix Tests
* address review comments for ui
* fix failing checks
* fix unit tests
* fix cypress test
* remove loader test as not using it
* wait for API when we click on the tab
* fix cypress waitFor api
* fix failed cypress tests
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fixes#8326 Add roles to system bots during initialization and use policy based authorization for bots
* Remove var usage and instead use specific types for variables
* Fix bot can't create entities
* Initial implementation of report endpoint
* Modified model files
* Added migration
* Added tests for analytics/report endpoint
* Finalized implementation of the reports endpoint
* Fixed maven test failure
* Fixed java style
* Added policy for reportDefinition
* Fixed minor typos in code
* Added database migration for web analytic event type
* Added logic for collect endpoint
* Added JSON Schema for collect endpoint
* Added index on table columns + added resource description for web event entities
* Fixed policy tests
* Updated add web analytic function to return the body of the request + updated test
* Added referer URL to PageView event
* Changed collection name to align with API endpoint
* updated initSeed method to initializeEntity
* cleaned up PR by removing unused filed from branch
* Fixed requested changes from review
* Clean up names
* Fixed comma in SQL statement