* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes
* feat: __init__.py files creation
* feat: updated workflow import classes in code and doc
* feat: moved kpi runner from runner to processor folder
* fix: skip failure on list entities
* feat: deleted unused files
* feat: updated status reporter
* feat: ran linting
* feat: fix test error with typing and fqn
* feat: updated test dependencies
* feat: ran linting
* feat: move execution order up
* feat: updated cost analysis report to align with new workflow
* feat: fix entity already exists for pipeline entity status
* feat: ran python linting
* feat: move skip_on_failure to method
* feat: added unusedReport to DI
* feat: added aggregated unused report
* feat: ran linting
* feat: reverted compose file changes
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* working on new search changes
* working on new search changes
* working
* working
* owner propogation done
* working on propogation
* done
* change in storageservice index
* Merge conflict fix
* Draft changes
* working on making updates generic
* added code to opensearchClientImp
* renamed suppportsSearchIndex to supportsSearch
* checkstyle
* added generic code for deleted as well
* fix tests
* fix all tests
* addressing comments
* fixed test case failure
* Fix lifecycle validation error name typo
* fix realted domain propogation
---------
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* feat: move elasticsearch indexing to backend + introduced EntityTimeSeries interface for timeseries type object
* feat: make reportData.json inherit from EntityTimeSeriesInterface
* feat: updated type to Object
* feat: deleted elasticsearch dependencies
* feat: removed elasticsearch indexing from workflow
* feat: added data insight sample data
* feat: cleaned up tests
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Fix#11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field
* Add wildcard support
* Fix GlossaryTerm Patch
* Fix LifeCycle inconsistencies in Schema; Add DELETE api
* set autocommit to true for non transactional
* make lifecycle common field for entities
* Add LifeCycle as common entity field
* Fix python life cycle code
* Fix search indexes
* remove unnecessary constant
* Add test back to entity resource test
* Fix lint
* Fix lint
* Fix lint
* Fix lint
* Add missing schema
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Fixes a bug while patching the description of a TestCase
* Update docker-compose.yml
* Update docker-compose.yml
* Ran pre-commit checks and linter
* Added some clarifying points and fixed some grammatical errors in the documentation for installation instructions.
* revert changes made to docs
* implementation of lightdash connector.
* ui: add icon for lightdash service
* chore: update lightdash image
* chore: update the icon
* Cleaned up code (took out debug statements, etc.). Still TODO: yield_dashboard_lineage_details() not being called just yet.
* fix: ran linting
* added null checks
* Delete openmetadata-server.md
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
* Add Stored Procedure Entity
* Stored Procedure repository
* Stored Procedure repository
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Fix#12998: Support for Stored Procedures as another entity under Database Schema
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Rebase fixes with main
* Add Sample Data
* lint fix
* remove unused import
* Fix service count test
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* Update storage connection naming
* Update storage services and remove typing of generic service
* Remove inits for namespace package
* Add test connection
* Revert "Remove inits for namespace package"
This reverts commit 89f1ae9ea8a633593776f51caf2586d2110d4636.
* Add enum
* Remove init to allow namespace packaging in some modules
* Remove init to allow namespace packaging in some modules
* Move examples and fix test
* Format
* Linting
* ui: Display createdDateTime and sizeInByte profile metrics #12196
* Modify Sample Data
* updated profile matrix as per date object
---------
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Filter out PII queries
* Mask topic PII
* Mask topic PII
* Update sample data test
* Format
* Moved logic to repository or PIIMasker
* Fix test
* chore(ui): update sample data api endpoint for topic
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.
* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity
* feat: add status object to test case results
* feat: ran python linting
* feat: fixed update to
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.
* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity
* feat: add status object to test case results
* feat: ran python linting
* feat: refactor ingestion flow logic
* feat: ran python linting
* feat: update tests to match new workflow
* feat: ran python linting
* feat: update sample data test suite name
* feat: Added backend logic to support logical and executable test suites
* feat: clean up java and json code
* feat: added sample data for logical and executable test suites
* feat: remove executable from CreateTestSuite
* feat: ran python and java linting
* feat: added README info for data quality structure
* skipping cypress to keep main green
* fixed typescript type issue
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#10454: Improve Search Relevancy, by adding functional scoring and add ngram analyzer; Fix#10452: Enable Table and Column search by BOTH name and displayName
* fix stylecheck
* Undo changes in table example names
* remove ngram from teams & users
* Fix topic tags
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Added top level parsing and unit tests
* fix(ui): show schemaText and fields both
* fix no data placeholder for fields & schema text
* addressing comments
* fixed py checkstyle
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* revert common_broker_source changes
* revert common_broker_source changes
* remove changes to user & team indexes
* fix team index
* fix glossary & tag index
* Fix to TopicIndex
* fix advance search pre-requisites cypress failure
* fix group advance search cy failures
---------
Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Docs #8973: Superset with SSO docs
* Superset support for mysql & postgres db
* remove unwanted field from yaml
* Fix pylint
* Fix superset tests
* Fix sample data connection
* ci fix & review comments
* cypress & defualt provider fix
