* fix snowflake system metrics
* format
* add link to logs and commit
fixed the dq cli test
* reverted bad formatting
* fixed models.py
* removed version pinning for data diff in tests
* fix(data-quality): snowflake data diff
- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality
* reverted unintended change
* fix import issue
* chore: add raise from status on ingestion step in tests
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* feat: indexed test case results
* feat: added indexation logic for test case results
* style: ran java linting
* fix: IDE warnigns
* chore: added test case results migration
* style: ran java linting
* fix: postgres migration column json ref
* empty commit to trigger queued
* chore: extracted test case results to its own resource
* chore: fix failing tests
* chore: move testCaseResult state from testSuite and testCase to dynamic field fetched from test case results search index
* chore: clean up test case repository
* style: ran java linting
* chore: removed testCaseResultSummary and testCaseResult state from db
* fix: test failures
* chore: fix index mapping type for result value
* chore: fix test failure
* GEN-1493 - Fix opensearch pagination
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* GEN-1410 - Improve PII Logging information
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* allow_module_level=True
* Issue-15768: Support Metric Entity
* Issue-15768: Support Metric Entity
* Issue-15768: Support Metric Entity
* Fix tests
* Fix tests
* Fix tests
* Minor: Fix tests
* ui: add metricsAPI rest utils
* ui: metric list page part 1
* feat: Add metric translations for multiple languages
* chore: Add "metric" field to SearchIndexingApplication schema
* ui: add create metric page
* ui: metric details page patch 1
* ui: add custom property and lineage support for metric entity
* ui: add expression component
* ui: add metric summary component
* chore: Update tab labels in MetricDetails and MetricVersion components
* ui: show other info like metric type, granularity, etc
* feat: Add support for metric entity in search dropdown
* feat: Rename custom property to Metric in MetricEntity.md
* feat: Add OwnerLabel component to MetricListPage
* Fix expression field in Metric
* chore: update expression to metricExpression
* ui: add metric header component with edit option
* Add metric to SearchIndexApp
* chore: Update expression to metricExpression
* ui: allow metric expression edit
* ui: update metric icon
* minor improvements
* Fix lineage indexing for Metric
* Update GlobalSettingsClassBase.ts to use MetricIcon for metrics in the global settings menu
* Fix error handling in MetricListPage component
* add related metrics
* minor improvements
* Fix relatedTerms patch
* Fix relatedTerms validation
* Add Boolean for deleted
* filter active entity from related metric list
* playwrite e2e part 1
* Refactor MetricSummary component to include RelatedMetrics in the summary panel
* test: add playwright test for metric special cases
* Add 'Metrics' to Explore Tree
* test: add e2e for add metric page
* test: add test for metric listing page content
* Add Boolean for deleted, remove deleted from suggests
* Refactor LineageProvider to handle deleted flag properly
* add playwright for metric listing
* fix test
* Add colored metric icon and update its usage in GlobalSettingsClassBase
* Fixed py_test test_ometa_endpoint for metric
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* support side effects on source classes by always importing source class
* streamlined error message
* fixed service type extraction for test suite pipeline
* - replaced "custom" with constant
- added quotes for the plugin exception for copy/paste ergonomics
* tests(datalake): use minio
1. use minio instead of moto for mimicking s3 behavior.
2. removed moto dependency as it is not compatible with aiobotocore (https://github.com/getmoto/moto/issues/7070#issuecomment-1828484982)
* - moved test_datalake_profiler_e2e.py to datalake/test_profiler
- use minio instead of moto
* fixed tests
* fixed tests
* removed default name for minio container
* configure api service metadata
* add rest api service
* fix test con. pyformat changes
* add models, fix test con.
* improve test con.
* add docs, side doc
* fix model data parse, url error fix
* add tests
* fix pytest errors
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* fix(profiler): snowflake
resolve tables using the snowflake engine instead of OpenMetadata
* added env for cleaning up dbs in E2E
* moved system metric method to profiler. all the rest says in snowflake
* format
* revert unnecessary changes
* removed test for previous resolution method
* use shutdown39
* fix(bigquery): unquote and convert any escaped characters to their actual representations
* test: bigquery description with multiple line
---------
Co-authored-by: Imri Paran <imri.paran@gmail.com>
* fix: Allow non numeric numbers to be sent via Json, Replace NaN values with None in SQAProfilerInterface
Replace NaN values with None in the SQAProfilerInterface class to maintain database parity. NaN values will be cast to null in OpenMetadata. This change ensures that data handling processes account for this conversion.
* fix: histogram overflow error
* test: Add Unit Test for Null and Null Ratio Metric
* chore: Address comments
* chore: Address comments
* fix: checkstyle and message
* fix: failing tests as null count works as expected
* mysql integration tests
* fix(data-quality): accept between with no bounds
add between filters only when the bounds are defined. if they are not (ie: resolve to 'inf' values), do not add any filters
* format
* consolidated ingestion_config
* format
* fixed handling of date and time columns
* fixed tests
* fixes arrayDataType must be not null, adding db name to queries as it fails
* Fix Pydantic Issue
* Partial: Add Unity Catalog Topology Test
* Fix lint
* Fix Tests, Fix UnityCatalog Array Column issue
* Fix Tests
* Address comments, add logger to the exception
