* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix#12779: Add support for SearchIndexes for ElasticSearch and OpenSearch
* Rebase fixes with main
* Add Sample Data
* lint fix
* remove unused import
* Fix service count test
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* ui: Display createdDateTime and sizeInByte profile metrics #12196
* Modify Sample Data
* updated profile matrix as per date object
---------
Co-authored-by: Ayush Shah <ayush@getcollate.io>
* Filter out PII queries
* Mask topic PII
* Mask topic PII
* Update sample data test
* Format
* Moved logic to repository or PIIMasker
* Fix test
* chore(ui): update sample data api endpoint for topic
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.
* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity
* feat: add status object to test case results
* feat: ran python linting
* feat: fixed update to
* feat: added entityReference field in testSuite to link testSuite to an entity when the testSuite is executable.
* feat: added `executableEntityReference` as an entity reference for executable test suite to their entity
* feat: add status object to test case results
* feat: ran python linting
* feat: refactor ingestion flow logic
* feat: ran python linting
* feat: update tests to match new workflow
* feat: ran python linting
* feat: update sample data test suite name
* feat: Added backend logic to support logical and executable test suites
* feat: clean up java and json code
* feat: added sample data for logical and executable test suites
* feat: remove executable from CreateTestSuite
* feat: ran python and java linting
* feat: added README info for data quality structure
* skipping cypress to keep main green
* fixed typescript type issue
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#10454: Improve Search Relevancy, by adding functional scoring and add ngram analyzer; Fix#10452: Enable Table and Column search by BOTH name and displayName
* fix stylecheck
* Undo changes in table example names
* remove ngram from teams & users
* Fix topic tags
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Fix#10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf
* Added top level parsing and unit tests
* fix(ui): show schemaText and fields both
* fix no data placeholder for fields & schema text
* addressing comments
* fixed py checkstyle
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* revert common_broker_source changes
* revert common_broker_source changes
* remove changes to user & team indexes
* fix team index
* fix glossary & tag index
* Fix to TopicIndex
* fix advance search pre-requisites cypress failure
* fix group advance search cy failures
---------
Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Docs #8973: Superset with SSO docs
* Superset support for mysql & postgres db
* remove unwanted field from yaml
* Fix pylint
* Fix superset tests
* Fix sample data connection
* ci fix & review comments
* cypress & defualt provider fix
* Fix#8509: Add schema fields
* Fix#4675: Ingestion deployment from UI is broken
* Added sample data for topics
* Fixed pytests
* Address comments
* Refactored sampledata according to new schema
* Added return type
* Feat(ui) ✨ : Add support for Avro editor (#9224)
* Feat(ui) ✨ : Add support for Avro editor
* chore : add mock data for nested fields
* style: add group and opacity css
* add schema fields component to topic details and unit test
* Add locale keys
* Add support for edit description.
* refactor: expandableConfig
* test: add unit test for util method
* chore : make changes according to the schema change
* test : fix unit test and add new mock data
* chore : rename files
* Add row key
* chore : add default value for tags
* chore : update util method
* chore : add support for editing field tags
* chore : rename util files
* test : add unit test
* add comments
* addressing comments
* Address comments
* Added avro requirments
* Added requirement versions
* fixed versions
* protobuf version fix
* chore : rename util test file
* Fixed Dataype
* test: add unit test for schema component
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* refactor(profiler): integrated getter func.
Removed metric getter function from their own file.
Added metric getter to their own interface classs.
created dispatch by value methdo to dispatch metric getter func.
* feature(profiler): added systemProfiler schema
* feat(profiler): workflow fresh. & snflk impl.
* feat(profiler): freshness endpoint for put and get
* feat(profiler): added system met. for redshift
* feat(profiler): freshness met. for bigquery
* fix(profiler): keyword not found in func
* feat(profiler): Added sample data for freshness
* fix(profiler): fetch previous day for BQ
* fix(profiler): sonar + data fetching logic
* fix: typo in SystemMetric Class
* fix: linting
* fix: extracted out EntityList class into models.py
* Added migration steps to delete profiler pipeline from entity relationship
* Added migration to remove rows from entity_relationship with profiler pipelines
* Fixed sample data TestDefinition name after renaming testDefinition
* Added user_tokens table to v005
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6571: Add EntityLink for the testCase to ID columns
* Fix#6782: Separate TableProfile and ColumnProfile api calls
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix#6782: Separate TableProfile and ColumnProfile api calls - fix tests
* Fix setFields
* Fix tests
* Update pipeline status endpoint
* updated ui side as per new schema for profiler tab
* updated profiler details with new API
* Fix Profiler tests and validation errors (#6827)
* add profilerSample field in TableProfile
* add profilerSample field in TableProfile
* get columnProfile with field profile
* get columnProfile with field profile
* Fixed sample data and python tests
* fixed date range filter change issue
* handled empty profiler case
* Added column level test case and results
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* add initial setup and added profiler tab
* added unit test for tableprofiler component
* added more coverage for table profiler component
* added get and put request and functionality for profiler setting
* added unit test for new components
* miner fix
* added data-testid for profiler settings component
* changed input box to slider for profile sample
* updated setting model design
* replaced select with treeSelect
* added unit test for setting modal
* fixing flaky cypress related to resizeObserver loop limit
* fixed failed unit test and added selected sample profiler text
* addressing comments
