* Refactor Search
* Refactor Search
* Fix propgation bugs
* Fix propgation bugs
* Fix glossary term search
* Fix glossary term search
* Only issue search requests if the client is configured properly
* Only issue search requests if the client is configured properly
* Fix glossary index
* add documentation for sharded tables (#13361)
* Cost analysis agg (#13408)
* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes
* feat: __init__.py files creation
* feat: updated workflow import classes in code and doc
* feat: moved kpi runner from runner to processor folder
* fix: skip failure on list entities
* feat: deleted unused files
* feat: updated status reporter
* feat: ran linting
* feat: fix test error with typing and fqn
* feat: updated test dependencies
* feat: ran linting
* feat: move execution order up
* feat: updated cost analysis report to align with new workflow
* feat: fix entity already exists for pipeline entity status
* feat: ran python linting
* feat: move skip_on_failure to method
* feat: added unusedReport to DI
* feat: added aggregated unused report
* feat: ran linting
* feat: reverted compose file changes
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* Add Java 17 support (#12895)
* Add Java 17 support
* Change Test HTTP client provider
* Create Tests HTTP Client once
* Create Tests HTTP Client once
* fix(CI): Update CI to use jdk 17 and dockerfiles as well
---------
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
* Refactor Search
* Refactor Search
* Fix propgation bugs
* Fix propgation bugs
* Fix glossary term search
* Fix glossary term search
* Only issue search requests if the client is configured properly
* Only issue search requests if the client is configured properly
* Fix glossary index
* Merge main
* fix style
* deleted field propagation
* Fix style
* close the test client
* Changing to jersey connector
* Fix Authentication Exception headers
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
* Separate initialization of Repository and Resources
* Change that speeds up the test. Still WIP
* Rebasing the branch with main
* Revert back previous changes and use Repositories from registry for migration
* Fixing test failures
* Code cleanup
* Fix test failures
* Fix#12655: Customizable Landing Page - Add Personas
* Add Knowledge Panels
* Add Doc Store to store KnowledgePanels and Pages
* Add Doc Store to store KnowledgePanels and Pages schemas
* Fix tests
* Add Multiple Persona support for a user
* add more elaborate tests for docstore
* Fix Page and KnowledgePanel required fields
* Fix Page and KnowledgePanel required fields
* Fix Page and KnowledgePanel required fields
* Fix build
* feat: move elasticsearch indexing to backend + introduced EntityTimeSeries interface for timeseries type object
* feat: make reportData.json inherit from EntityTimeSeriesInterface
* feat: updated type to Object
* feat: deleted elasticsearch dependencies
* feat: removed elasticsearch indexing from workflow
* feat: added data insight sample data
* feat: cleaned up tests
* Fix LifeCycle inconsistencies in Schema; Add DELETE api
* set autocommit to true for non transactional
* make lifecycle common field for entities
* Add LifeCycle as common entity field
* Fix python life cycle code
* Fix search indexes
* remove unnecessary constant
* Add test back to entity resource test
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Add missing schema
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Fix#9972: Add Badge with color or icon for Tags,GlossaryTerm, Domain and DataProducts
* Fix#9972: Add Style with color or icon for Tags,GlossaryTerm, Domain and DataProducts
* Add style to TagLabel
* Add Stored Procedure Entity
* Stored Procedure repository
* Stored Procedure repository
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Rebase fixes with main
* Add Sample Data
* lint fix
* remove unused import
* Fix service count test
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* Add entity cache in EntityRepository for all the entities
* Set entity fields only when it is not already set
* Clone entities from the cache
* Remove SubjectCache
* Remove RoleCache
* Remove PolicyCache
* Remove TagLabelCache
* Deleting lingering files
* Test failure fixes
* Remove getEntityReference methods from EntityDAO
* Move quoteName logic to EntityRepository
* Fix test failures
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Restructured Reindexing + Added Automated Reindexing on Glossary import
* Revert Openmetadata yaml
* Fix pending issues
* Fix stats
* Refactor to workflows and SearchIndex
* Fix Failing tests
* Get status for stream and push status with
* fix UI build failing
* replace all with entity list before hit api
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* added query as an entity
* changed name of the variables and methods
* Added Resource Descriptors
* testcase bug fix
* addressing comments
* added script for table query migration
* added script for table query migration postgresql
* bug fix
* db change for script test
* added current timestamp
* change db config from postgresql to mysql
* added extension to use fucntion gen_random_uuid()
* solving maven ci
* added queryUsage and change is migration script
* addressing comments
* addressing comments
* added queryUsage relation and testcase
* added api to insert queries in bulk
* .
* fix a test case which was failing due to latest changes
* Ingestion Changes for Query as Entity
* move query changes to latest sqls
* added tags and owner
* update PR for Query as Entity
* update type
* fixed pagination
* fix path param
* fix TestCases
* add validation criteria
* removed exisitng query apis
* checkstyle fix
* remove vote from put
* remove vote from put
* Query As Entity Ingestion Changes
* Remove unused func
* update Review Comments
* update Review Comments
* remove previous changes for Query and Update Tests
* moved Checksum to Query Util Class
* update python api
* fix python checkstyle
* Fixed Tests
* Fix pytest
* remove space changes
* remove space changes
* Fixed put_addFollowerDeleteEntity_200
* Fix usage ingestion
* Update Python SDK and tests
* pylint fix
---------
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* Prep the skeleton
* Add DAO and tables
* Add Test Connection Definition Resource
* Format
* Add ResourceDescriptors & missing props
* Simplify APIs to scope for GET and LIST
* Mask sensitive info from API responses
* Rename converter classes
* Add missing Java classes from JSON schemas and class converters
* Update test service connection schema
* Update datalakeConnection JSON schema and fix some tests
* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh
* Fix Pipeline and Database service tests
* Minor refactor
* Fix CsvUtilTest
* Fix EventMonitorFactoryTest
* Fix CloudWatchEventMonitorTest
* Update datalake metadata
* Update bigquery metadata
* Fix test connection functionality
* Fix OMeta service api test
* Update gcsValues title and revert changes in GH actions
* Mask sensitive enabled by default for local docker
* Add missing tests
* Address PR comments
* Address PR comments
* fix ui breaks on gcsValues.json
* Address PR comments
* Minor refactor
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* First cut of the store service model
* Second cut of the store service model
* reverted accidental rename of property
* Third version for the object container schema definition.
* final draft version for container and object store service related entities
* final first draft of api's and entities for the object store service and container
* formatting
* removed test file
* formatting
* test fixes
* formatting
* more fixed tests
* fixed tests, addressed PR comments
* added type for object store connections
* addressed PR comments
* formatting
* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Alert Test Fix
* Removed Db calls in case local publishers available
* Fix test
* Removed unrequired code
* Maintaing entityType to class map
* checkstyle
* Schema for Alerts #9248
* 1. Api for alerts
2. Api for alertAction
API for Alert and AlertAction #9266
* missing file
* fix ui failures
* Added Api to give function parameter type and additional Context for UI
* Added default Triggers in Alerts
* checkstyle fix
* docs update
* function names updated
* added timestamp for alert status update
* receiver should be unique in json schema and alerts publishers
* updated bootstrap filters
* updatated review comments
* added functions to match eventType for entities
* added migrations for alerts
* added alert config in alertACtionConfig
* Fix issue in sending mails
* removed commented part
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>