10595 Commits

Author SHA1 Message Date
Ashish Gupta
a1a8d93316
#16465: supported resize column in glossary tables (#17794)
* supported resize column in glossary tables

* added right border in resizable table column

* fix glossary drag and drop spec flaky

* minor css fix as previous border style applied to all table and not only resizable one

* fix type conditions

* added the import for get

* skip tests due to code change required

* fixme EntityDataSteward spec
improve worker to 4

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-17 00:17:21 +05:30
Sachin Chaurasiya
eb7b1d5ea0
minor: remove suggestion api from UI (#17857)
* minor: remove suggestion api from UI

* increase the page size to 10

* fix : unit test

* update playwright tests and getUserAndTeamSearch params

* added playwright for team search

* fix activity feed failure

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 21:36:42 +05:30
Ayush Shah
4fd2b24b2f
doc: remove deprecated docs (#17861) 2024-09-16 20:33:56 +05:30
Ayush Shah
23c6aa3ca5
fix: add children to array of struct (#17850) 2024-09-16 18:02:17 +05:30
Shailesh Parmar
e78450a5ec
Playwright: fixed Tags AUT test (#17852) 2024-09-16 18:00:12 +05:30
Pere Miquel Brull
9a96ddd4ae
GEN-1494 - Add CI for py-tests with Postgres and Opensearch (#17853)
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1410 - Improve PII Logging information

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* allow_module_level=True
2024-09-16 09:35:38 +02:00
Ayush Shah
2feb7d04ca
MINOR: Add Matillion SSL + Docs implementation (#17792) 2024-09-16 12:57:12 +05:30
Sriharsha Chintalapani
2da9c34730
Issue-13782: RBAC for search (#17757)
* Issue-13782: RBAC for search

* Handle complex conditions

* Add optimizations to condition parsing

* Add SPeL based condition evaluation

* Fix styling

* use SpeL Parser AST to compose ES conditions

* Fix test message

* improvements in query generation

* improvements in query generation

* Add more complex queries

* Add more complex codndition tests and evaluation

* Add OpenSearch query builders and tests

* Add handling resources in a rule, add tests for multiple rules and inherited roles
2024-09-16 11:45:21 +05:30
Sriharsha Chintalapani
c34545adeb
Issue-15768: Support Metric Entity (#17680)
* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Fix tests

* Fix tests

* Fix tests

* Minor: Fix tests

* ui: add metricsAPI rest utils

* ui: metric list page part 1

* feat: Add metric translations for multiple languages

* chore: Add "metric" field to SearchIndexingApplication schema

* ui: add create metric page

* ui: metric details page patch 1

* ui: add custom property and lineage support for metric entity

* ui: add expression component

* ui: add metric summary component

* chore: Update tab labels in MetricDetails and MetricVersion components

* ui: show other info like metric type, granularity, etc

* feat: Add support for metric entity in search dropdown

* feat: Rename custom property to Metric in MetricEntity.md

* feat: Add OwnerLabel component to MetricListPage

* Fix expression field in Metric

* chore: update expression to metricExpression

* ui: add metric header component with edit option

* Add metric to SearchIndexApp

* chore: Update expression to metricExpression

* ui: allow metric expression edit

* ui: update metric icon

* minor improvements

* Fix lineage indexing for Metric

* Update GlobalSettingsClassBase.ts to use MetricIcon for metrics in the global settings menu

* Fix error handling in MetricListPage component

* add related metrics

* minor improvements

* Fix relatedTerms patch

* Fix relatedTerms validation

* Add Boolean for deleted

* filter active entity from related metric list

* playwrite e2e part 1

* Refactor MetricSummary component to include RelatedMetrics in the summary panel

* test: add playwright test for metric special cases

* Add 'Metrics' to Explore Tree

* test: add e2e for add metric page

* test: add test for metric listing page content

* Add Boolean for deleted, remove deleted from suggests

* Refactor LineageProvider to handle deleted flag properly

* add playwright for metric listing

* fix test

* Add colored metric icon and update its usage in GlobalSettingsClassBase

* Fixed py_test test_ometa_endpoint for metric

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 11:36:31 +05:30
Pere Miquel Brull
e820cb0450
GEN-1410 - Improve PII Logging information (#17835) 2024-09-16 07:05:30 +02:00
Sriharsha Chintalapani
ea62f34385
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#17841)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-09-15 16:31:34 -07:00
k.nakagaki
3d8e30142c
Fixes 8428: make it possible to choice a sampling method type when we create profile ingestion for the Snowflake (#17831)
* Add test for existing code

* Add sampling method at ingestion.

* add samplingMethodType into UI

* modify init method to use new parameter.

* create descriptions

* execute isort

* fix an unintended change.

* apply py_format

* close section

* specify  init arguments

* fix bug

* apply py_format

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-09-15 21:51:17 +02:00
Ashish Gupta
08c13e5333
playwright improvement in activity feed spec (#17842) 2024-09-15 19:43:21 +05:30
Chirag Madlani
a109191c90
fix(ui): security vulnerability for root yarn.lock (#17847) 2024-09-15 18:27:07 +05:30
Shailesh Parmar
402e58ef36
Playwright: fixed AUT testCases spec (#17844) 2024-09-15 18:23:51 +05:30
Chirag Madlani
370ee13a24
fix(ui): security vulnerability for ui package.json (#17845) 2024-09-15 14:24:17 +05:30
Shailesh Parmar
414e19b6bd
Removed cypress form the project (#17839) 2024-09-15 13:12:53 +05:30
Chirag Madlani
e5a557dc8f
minor(ui): Bump react version to 17 (#17834)
* minor(ui): Bump react version to 17

* bump test libraries

* revert postinstall step

* fix tests

* address comments

* fix tests
2024-09-15 11:52:55 +05:30
Ashish Gupta
15a6b4b2cd
migrated team spec to playwright (#17838)
* migrated team spec to playwright

* migrate teams spec

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-09-13 23:43:24 +05:30
Karan Hotchandani
9471ddd52e
fix playwright test issues (#17836)
* fix playwright test issues

* cleanup

* fixed wait issue in test cases spec

* fix AddRoleAndAssignToUser spec failure

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-13 20:12:56 +05:30
Aniket Katkar
c7dd060607
Minor: Alert e2e playwright migration (#17664)
* Fix the alert details page disabled edit action

* Localization change for other languages

* Migrate Alert cypress to playwright

* remove the cypress and fix ObservabilityAlert spec
2024-09-13 19:15:35 +05:30
IceS2
4ae318f11b
Refactor code to improve di pipeline performance (#17820) 2024-09-13 11:18:22 +02:00
Ashish Gupta
dbbd932cf7
migration: fully migrated customize landing page to playwright (#17803)
* fully migrated customize landing page to playwright

* changes made as per comments
2024-09-13 14:46:30 +05:30
Chirag Madlani
17744f42dc
feat(ui): support refresh with multi tabs open (#17782)
* feat(ui): support refresh with multi tabs open

* address comments

* fix clientType error

* fix unit tests

* add version miss match alert for seamless experience

* update variable values

* use custom hook for location

* patch DataInsight app before running it

* fix addRoldeAndAssignToUser flaky test failure
2024-09-13 14:16:42 +05:30
Mayur Singal
1fdb667ee3
MINOR: make type optional in ES Response (#17832)
* MINOR: make type optional in ES Mixin

* make none as default

* pyformat
2024-09-13 10:17:12 +02:00
Shailesh Parmar
015953f576
playwright: fixed AUT test for 1.5.4 (#17833)
* playwright: fixed AUT test for 1.5.4

* fix team drag drop flaky

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-13 13:35:45 +05:30
Mayur Singal
f2c75be78d
MINOR: Optimise Snowflake Test Connection (#17779) 2024-09-13 12:55:55 +05:30
Shailesh Parmar
0e75a9cceb
playwright: migrate permission spec to playwright (#17795)
* playwright: remove organisation policy and role before staring the playwright test

* added default role as data consumer

* fixed failing test

* keeping org policies as it is.

* migrate permission spec

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-13 11:24:28 +05:30
Prajwal214
75588cf364
Docs: Fixing the Getting Started Collate Images Size (#17830)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-09-13 10:54:23 +05:30
Chirag Madlani
5b117539f8
ui: playwright increase test timeout 2024-09-13 02:18:24 +05:30
Karan Hotchandani
67820a2aa7
fix playwright tests for search and owners (#17816)
* fix playwright tests

* fix tests

* fix minor tests
2024-09-13 01:46:05 +05:30
Prajwal214
3f582e3063
Docs: Updated the Getting Started Collate Docs (#17824)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-09-12 11:33:03 -07:00
Sachin Chaurasiya
681a15c4a5
minor: update custom property entities data model, data product and database schema icon (#17812)
* minor: update custom property entities data model, data product and database schema icon

* remove unused icon
2024-09-12 23:54:48 +05:30
Shailesh Parmar
fda7e1ecb9
playwright: fixed failing aut test in main (#17818)
* playwright: fixed failing aut test in main

* fix myData spec failure

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-12 23:42:20 +05:30
Ashish Gupta
16e25bc469
what's new for 1.5.4 (#17826) 2024-09-12 22:31:17 +05:30
Ashish Gupta
5999ccf716
fix(ui): unable to access import glossary page (#17823)
* fix the glossary import page not showing

* added playwright test for glossary import export
2024-09-12 22:17:10 +05:30
Prajwal214
c0a01159ca
Docs: Updating the latest Release v.1.5.3 (#17819)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-09-12 20:47:09 +05:30
Prajwal214
bd105c300a
Docs: Fixing References in the Connector Docs (#17817)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-09-12 20:46:44 +05:30
Ashish Gupta
5c7ab993e8
modify bot playwright test to stepper mode from parallel (#17811)
* skip bot playwright test

* change spec from parallel mode to stepper mode with the default admin account

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-09-12 20:41:51 +05:30
IceS2
9d2784e8e8
Hotfix to the Term Aggregation size on Data Insights (#17822) 2024-09-12 16:50:04 +02:00
Shailesh Parmar
d785276b8e
Minor: improve UI of filters in test case graph (#17775) 2024-09-12 14:23:51 +00:00
Imri Paran
59854de58d
[GEN-1406]: import plugin and clear plugin message for failed source import (#17788)
* support side effects on source classes by always importing source class

* streamlined error message

* fixed service type extraction for test suite pipeline

* - replaced "custom" with constant
- added quotes for the plugin exception for copy/paste ergonomics
2024-09-12 16:13:03 +02:00
dependabot[bot]
5d972789ea
Bump express in /openmetadata-ui/src/main/resources/ui (#17813)
Bumps [express](https://github.com/expressjs/express) from 4.19.2 to 4.21.0.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/4.21.0/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.21.0)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-12 17:55:33 +05:30
Teddy
e066929ff7
GEN-1380 - Implement support for date_histogram aggregation (#17738)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* feat: add support for date_histogram aggregation

* style: ran java linting

* chore: clean up conflicts

* fix: move from iterator loop to forEach

* fix: removed comment

* style: ran java linting
2024-09-12 13:11:30 +02:00
Imri Paran
3282b057d8
ci: pin spacy version (#17814)
spacy 3.8 requires numpy 2.0 which is not compatible with openmetadata-ingestion requirements:
184e508d9c
2024-09-12 15:12:53 +05:30
Imri Paran
b70b3ce913
added config logging with secrets redacted (#17770) 2024-09-12 10:19:53 +02:00
Teddy
aa399dfd68
MINOR: move constraint update from schemaChanges to postDataMigration (#17801)
* fix: move constraint update from schemaChanges to postDataMigration

* fix: move index after column is created
2024-09-12 08:13:41 +02:00
Pere Miquel Brull
f4d0eba08f
MINOR - Add ES pagination with error handling (#17776)
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
2024-09-12 07:14:56 +02:00
Imri Paran
a3d6c1dd20
MINOR: tests(datalake): use minio (#17805)
* tests(datalake): use minio

1. use minio instead of moto for mimicking s3 behavior.
2. removed moto dependency as it is not compatible with aiobotocore (https://github.com/getmoto/moto/issues/7070#issuecomment-1828484982)

* - moved test_datalake_profiler_e2e.py to datalake/test_profiler
- use minio instead of moto

* fixed tests

* fixed tests

* removed default name for minio container
2024-09-12 07:13:01 +02:00
Ayush Shah
1c6695b8d7
Fixes #17804: Classification API returns Table class for restore (#17806)
* fix: Classification API returns Table class for restore
2024-09-12 10:11:41 +05:30