10673 Commits

Author SHA1 Message Date
Imri Paran
21af02d8d5
Fix 17903: fix(data-quality): snowflake data diff (#17907)
* fix(data-quality): snowflake data diff

- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality

* reverted unintended change
2024-09-19 17:55:48 +02:00
Mayur Singal
1be238266a
MINOR: Apply multi threading in View Lineage Processing (#17922) 2024-09-19 15:06:38 +02:00
Imri Paran
760b8eb742
fix(ingestion): deltalake (#17910)
add pin for deltalake<0.20 to avoid ad35eda798 (diff-f81b8b91e9721dc0a3235b6674a57c0700153b92b59f3988d357950a9c8c4760R1142-R1144)
2024-09-19 08:25:19 +02:00
Teddy
4331570f7f
GEN 1507 - Implement Origin Entity FQN parms to incident manager listing (#17890)
* fix import issue

* feat: added originEntityFQN param in incident listing

* chore: removed table alias

* fix: added alias to derived table

* style: ran java linting

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 22:45:36 +02:00
Pere Miquel Brull
0f5746499a
GEN-1492 - Decrypt JWT internally for system health check (#17864) 2024-09-18 19:24:10 +02:00
Teddy
7df05c3e57
Minor python test failure (#17904)
* fix import issue

* chore: add raise from status on ingestion step in tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 17:41:05 +02:00
Shailesh Parmar
ec6a662202
Minor: improve the UX of profiler graph tooltip (#17892)
* Minor: improve the UX of profiler graph tooltip

* addressing comment
2024-09-18 18:58:06 +05:30
Chirag Madlani
4b0b22af2a
fix(e2e): ingestion related flaky failures (#17848)
* fix(e2e): ingestion related flaky failures

* no need to run workflow for ready_for_review state update

* await for queued or running status

* fix failing tests

* fix issue

* add support for partial success
2024-09-18 18:11:08 +05:30
Ashish Gupta
a679625f7b
fix myData and ActivityFeed playwright test 1.5.5 (#17886) 2024-09-18 17:09:11 +05:30
Teddy
33c50efdbf
GEN-1192 - Move Test Case to its Own Resource (#17862)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* chore: extracted test case results to its own resource

* chore: fix failing tests

* chore: move testCaseResult state from testSuite and testCase to dynamic field fetched from test case results search index

* chore: clean up test case repository

* style: ran java linting

* chore: removed testCaseResultSummary and testCaseResult state from db

* fix: test failures

* chore: fix index mapping type for result value

* chore: fix test failure
2024-09-18 11:58:59 +02:00
Shailesh Parmar
55a027203e
Playwright: fixed permission, dataQuality, & testCases spec for 1.5.5 (#17884)
* Playwright: fixed permission, dataQuality, & testCases spec

* fixed testSuite wait issue
2024-09-18 13:24:24 +05:30
Sachin Chaurasiya
e42a7d6e7c
fix: ApiDocs Playwright spec (#17894)
* fix: ApiDocs Playwright spec

* fix(ui): Fix API docs test failure

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 11:37:59 +05:30
Sriharsha Chintalapani
4d0339b270
Improve Search Relevancy for tier, usage and use stemming to generate ngrams (#17871)
* Improve Search Relevancy for tier, usage and use stemming to generate ngrams

* Improve Search Relevancy for tier, usage and use stemming to generate ngrams

* add displayName using name

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-09-17 19:41:35 -07:00
Fateme Ghanbarzadeh
91a1479e53
Create pr-pr.json (#17887)
A file to add Persian language to open-metadata

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-17 19:40:55 -07:00
Sachin Chaurasiya
a72d502cb5
fix: Teams and owner fields are not being passed in the policy API call. (#17880) 2024-09-18 01:51:47 +05:30
dependabot[bot]
4d9759495e
Bump dompurify in /openmetadata-ui/src/main/resources/ui (#17868)
Bumps [dompurify](https://github.com/cure53/DOMPurify) from 2.3.10 to 3.1.6.
- [Release notes](https://github.com/cure53/DOMPurify/releases)
- [Commits](https://github.com/cure53/DOMPurify/compare/2.3.10...3.1.6)

---
updated-dependencies:
- dependency-name: dompurify
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 01:51:25 +05:30
Prajwal214
5be02196ee
Docs: Updated getting started Docs (#17891)
* Docs: Updating Getting Started Collate Docs

* Docs: Updating Getting Started Collate Docs

* Docs: Updating Getting Started Collate Docs

---------

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-09-17 18:45:26 +02:00
Pere Miquel Brull
f6fdd86d5c
Docs - Ingestion License (#17893) 2024-09-17 08:58:53 -07:00
Chirag Madlani
46550b3a88
fix(ui): overriding user info after login (#17825)
* fix(ui): overriding user info after login

* fix displayName override unnecessarily

* address comments

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

* fix MSAL login and refresh token issue

* remove unwanted changes

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-09-17 19:16:59 +05:30
Chirag Madlani
ed08b27a41
fix(ui): security vulnerability for ui packages (#17856)
* fix(ui): security vulnerability for ui packages

* revert quill package changes

* skip DataSteward due to issue in the app

* increase worker to 4
2024-09-17 18:15:29 +05:30
Pere Miquel Brull
6a1cd0ef8b
GEN-1493 - Fix paginate_es in opensearch (#17858)
* GEN-1493 - Fix opensearch pagination

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
2024-09-17 14:21:10 +02:00
Ashish Gupta
49323ed5bc
fix failing playwright test (#17881) 2024-09-17 16:01:58 +05:30
Pere Miquel Brull
91ddfcf07a
FIX - Postgres Python CI (#17859)
* fix deprecation

* remove print

* tests use testcontainers for mysql

* testcontainers for 3.8 dont work
2024-09-17 11:57:32 +02:00
Chirag Madlani
d5507ca44f
Revert "#16465: supported resize column in glossary tables" (#17878)
* Revert "#16465: supported resize column in glossary tables (#17794)"

This reverts commit a1a8d9331632f854fcd22db414f9d74285478175.

* need util changes for fix

* update machine to 4
2024-09-17 14:34:09 +05:30
Onkar Ravgan
507efc647f
fixed alationsink test (#17883) 2024-09-17 10:36:33 +02:00
Ashish Gupta
dbd4826c37
Docs: Updating the latest Release v.1.5.4 (#17875) 2024-09-17 09:41:34 +02:00
Aniket Katkar
3e899fa1f9
Add missing info for flink connector (#17874) 2024-09-17 11:48:39 +05:30
Sriharsha Chintalapani
6c307e69a6
Fix Search RBAC to consider only ViewAll, ViewBasic (#17865)
* Fix Search RBAC to consider only ViewAll, ViewBasic

* Fix Search RBAC to consider only ViewAll, ViewBasic

* Fix Search RBAC to consider only ViewAll, ViewBasic
2024-09-16 21:31:38 -07:00
Ashish Gupta
a1a8d93316
#16465: supported resize column in glossary tables (#17794)
* supported resize column in glossary tables

* added right border in resizable table column

* fix glossary drag and drop spec flaky

* minor css fix as previous border style applied to all table and not only resizable one

* fix type conditions

* added the import for get

* skip tests due to code change required

* fixme EntityDataSteward spec
improve worker to 4

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-17 00:17:21 +05:30
Sachin Chaurasiya
eb7b1d5ea0
minor: remove suggestion api from UI (#17857)
* minor: remove suggestion api from UI

* increase the page size to 10

* fix : unit test

* update playwright tests and getUserAndTeamSearch params

* added playwright for team search

* fix activity feed failure

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 21:36:42 +05:30
Ayush Shah
4fd2b24b2f
doc: remove deprecated docs (#17861) 2024-09-16 20:33:56 +05:30
Ayush Shah
23c6aa3ca5
fix: add children to array of struct (#17850) 2024-09-16 18:02:17 +05:30
Shailesh Parmar
e78450a5ec
Playwright: fixed Tags AUT test (#17852) 2024-09-16 18:00:12 +05:30
Pere Miquel Brull
9a96ddd4ae
GEN-1494 - Add CI for py-tests with Postgres and Opensearch (#17853)
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1410 - Improve PII Logging information

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* allow_module_level=True
2024-09-16 09:35:38 +02:00
Ayush Shah
2feb7d04ca
MINOR: Add Matillion SSL + Docs implementation (#17792) 2024-09-16 12:57:12 +05:30
Sriharsha Chintalapani
2da9c34730
Issue-13782: RBAC for search (#17757)
* Issue-13782: RBAC for search

* Handle complex conditions

* Add optimizations to condition parsing

* Add SPeL based condition evaluation

* Fix styling

* use SpeL Parser AST to compose ES conditions

* Fix test message

* improvements in query generation

* improvements in query generation

* Add more complex queries

* Add more complex codndition tests and evaluation

* Add OpenSearch query builders and tests

* Add handling resources in a rule, add tests for multiple rules and inherited roles
2024-09-16 11:45:21 +05:30
Sriharsha Chintalapani
c34545adeb
Issue-15768: Support Metric Entity (#17680)
* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Fix tests

* Fix tests

* Fix tests

* Minor: Fix tests

* ui: add metricsAPI rest utils

* ui: metric list page part 1

* feat: Add metric translations for multiple languages

* chore: Add "metric" field to SearchIndexingApplication schema

* ui: add create metric page

* ui: metric details page patch 1

* ui: add custom property and lineage support for metric entity

* ui: add expression component

* ui: add metric summary component

* chore: Update tab labels in MetricDetails and MetricVersion components

* ui: show other info like metric type, granularity, etc

* feat: Add support for metric entity in search dropdown

* feat: Rename custom property to Metric in MetricEntity.md

* feat: Add OwnerLabel component to MetricListPage

* Fix expression field in Metric

* chore: update expression to metricExpression

* ui: add metric header component with edit option

* Add metric to SearchIndexApp

* chore: Update expression to metricExpression

* ui: allow metric expression edit

* ui: update metric icon

* minor improvements

* Fix lineage indexing for Metric

* Update GlobalSettingsClassBase.ts to use MetricIcon for metrics in the global settings menu

* Fix error handling in MetricListPage component

* add related metrics

* minor improvements

* Fix relatedTerms patch

* Fix relatedTerms validation

* Add Boolean for deleted

* filter active entity from related metric list

* playwrite e2e part 1

* Refactor MetricSummary component to include RelatedMetrics in the summary panel

* test: add playwright test for metric special cases

* Add 'Metrics' to Explore Tree

* test: add e2e for add metric page

* test: add test for metric listing page content

* Add Boolean for deleted, remove deleted from suggests

* Refactor LineageProvider to handle deleted flag properly

* add playwright for metric listing

* fix test

* Add colored metric icon and update its usage in GlobalSettingsClassBase

* Fixed py_test test_ometa_endpoint for metric

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 11:36:31 +05:30
Pere Miquel Brull
e820cb0450
GEN-1410 - Improve PII Logging information (#17835) 2024-09-16 07:05:30 +02:00
Sriharsha Chintalapani
ea62f34385
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#17841)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-09-15 16:31:34 -07:00
k.nakagaki
3d8e30142c
Fixes 8428: make it possible to choice a sampling method type when we create profile ingestion for the Snowflake (#17831)
* Add test for existing code

* Add sampling method at ingestion.

* add samplingMethodType into UI

* modify init method to use new parameter.

* create descriptions

* execute isort

* fix an unintended change.

* apply py_format

* close section

* specify  init arguments

* fix bug

* apply py_format

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-09-15 21:51:17 +02:00
Ashish Gupta
08c13e5333
playwright improvement in activity feed spec (#17842) 2024-09-15 19:43:21 +05:30
Chirag Madlani
a109191c90
fix(ui): security vulnerability for root yarn.lock (#17847) 2024-09-15 18:27:07 +05:30
Shailesh Parmar
402e58ef36
Playwright: fixed AUT testCases spec (#17844) 2024-09-15 18:23:51 +05:30
Chirag Madlani
370ee13a24
fix(ui): security vulnerability for ui package.json (#17845) 2024-09-15 14:24:17 +05:30
Shailesh Parmar
414e19b6bd
Removed cypress form the project (#17839) 2024-09-15 13:12:53 +05:30
Chirag Madlani
e5a557dc8f
minor(ui): Bump react version to 17 (#17834)
* minor(ui): Bump react version to 17

* bump test libraries

* revert postinstall step

* fix tests

* address comments

* fix tests
2024-09-15 11:52:55 +05:30
Ashish Gupta
15a6b4b2cd
migrated team spec to playwright (#17838)
* migrated team spec to playwright

* migrate teams spec

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-09-13 23:43:24 +05:30
Karan Hotchandani
9471ddd52e
fix playwright test issues (#17836)
* fix playwright test issues

* cleanup

* fixed wait issue in test cases spec

* fix AddRoleAndAssignToUser spec failure

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-13 20:12:56 +05:30
Aniket Katkar
c7dd060607
Minor: Alert e2e playwright migration (#17664)
* Fix the alert details page disabled edit action

* Localization change for other languages

* Migrate Alert cypress to playwright

* remove the cypress and fix ObservabilityAlert spec
2024-09-13 19:15:35 +05:30
IceS2
4ae318f11b
Refactor code to improve di pipeline performance (#17820) 2024-09-13 11:18:22 +02:00