1565 Commits

Author SHA1 Message Date
sonika-shah
35bef5669a
Fix #18035 - getting type null exception on user feed (#18036) 2024-09-29 10:24:46 +05:30
sonika-shah
baa2781619
Fix #18039 - Fix incorrect @Schema implementations in Swagger annotations (#18040) 2024-09-29 10:23:30 +05:30
sonika-shah
1b029d2bf2
Add new ‘enumWithDescriptions’ Custom Property to allow adding Enum Keys with Description (#17777)
* Add new ‘metaEnum’ Custom Property to allow adding Enum Keys with Description

* replace JsonNodeFactory method with JsonUtils

* rename property from metaEnum to enumWithDescriptions, and other method optimizations

* ui: add support for creating enumWithDescription property

* minor locale changes

* ui: add edit support for created enumWithDescription property

* Refactor enum description field layout in AddCustomProperty and EditCustomPropertyModal

* add support for adding values to enumWithDescription custom property type

* Refactor custom property input IDs in AddCustomProperty and EditCustomPropertyModal components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* Refactor custom property table rendering logic and UI components

* add basic card layout

* Refactor CustomPropertyTable component to improve UI and functionality

* update playwright test part 1

* Refactor PropertyValue component to conditionally render right panel styles

* fix: entity reference property update

* Refactor CustomPropertyTable component to conditionally render right panel styles

* fix: flaky test

* Refactor CustomPropertyTable test to use updated test IDs and remove unnecessary code

* fix flaky test

* improve the playwright test

* add more test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-09-29 00:45:46 +05:30
Teddy
e3f1d528d8
MINOR - Improve Data Quality Results List from Search (#18014)
* fix import issue

* feat: added dimension and type field in DQ Result search listing

* fix: remove code duplication

* style: ran java linting

* chore: clean up unecessary elements

* style: ran java linting

* fix: remove unecessary conditional statement + remove comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-26 22:47:03 +02:00
Pere Miquel Brull
d26449576a
GEN-1234 - Clean up suggestions when a user is deleted (#17988)
* GEN-1234 - Clean up suggestions when a user is deleted

* add method

* add method

* fix postgres query
2024-09-26 16:22:36 +02:00
Suman Maharana
37b6dc8290
Add Sigma Dashboard Connector (#17855)
* Add Sigma Dashboard Connector

* changed to id instead of name in dashboard entity

* Address Comments

* addressed comments

* Added Docs

* yaml file changes

* fix ui changes
2024-09-26 16:29:35 +05:30
sonika-shah
a99fbb2eb6
GEN-1434: Improvement : Show displayName for database and databaseSchema in explore tree (#17876)
* Show displayName for database and databaseSchema in explore tree

* use display name for database and schema

* add playwright

* resync indexes of dataAssets based on database & databaseSchema displayName change

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2024-09-26 16:18:16 +05:30
Mohit Yadav
afd7887bd8
[Issue-16487] Add Stop for Search Indexing (#17914)
* Add Stop for Search Indexing

* Update Logs and Message

* test for stop func

* remove test
2024-09-25 18:29:32 +05:30
Shailesh Parmar
8dd6a84d1f
GEN-1160 Minor: migrate to test case search api from test case api (#17902)
* Minor: migrate to test case search api from test case api

* fix: testSuites search client update

* style: ran java linting

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2024-09-25 10:10:30 +05:30
Imri Paran
350e0f70cb
MNIOR: feat(apps): support config file (#17872)
* feat(apps): support config file

- added support for app config files
- removed AppPrivateConfig from the OpenMetadata server configuration

* use dorpwizard utility classes for resolving environment variables in the config

* moved fields to class level

* format
2024-09-24 14:21:50 +00:00
Mohit Yadav
d77cf36b38
Adds Saml Redirect Uri (#17936)
* Add Saml Redirect Uri In Session

* Refactor

* add redirect url in saml

* add Saml logout servlet

* fix for message

* added logout method for saml

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-09-23 22:20:48 +05:30
Siddhant
bc3d4c778e
[FIX] ldap User Name (#17764)
* migrate userName to emailPrefix for ldap auth provider.

* migrate userName to emailPrefix for ldap auth provider.

* fix migration.

* move migration to v155

* Update Ldap Authenticator

* Fix Ldap Issue on Login

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-09-23 11:35:20 +05:30
sonika-shah
c1e20873b1
Fix #17929 : Fix team export issue (#17930) 2024-09-22 21:30:35 +05:30
Teddy
e008a0d6f7
MINOR - Add list testCase for Logical Test Suite ID (#17941)
* fix import issue

* fix: listing test cases linked to logical test suite

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-21 11:04:42 +02:00
Mohit Yadav
512946df15
FIx Failing Test Case (#17945)
* FIx Failing Test Case

* Update dependency version
2024-09-20 22:21:18 +05:30
Mohit Yadav
f85246583e
Fix Automator Search (#17942)
* Fix Automator Search

* Add only to index
2024-09-20 19:37:16 +05:30
Mohit Yadav
f4ce0e8693
fix owners patch issue (#17900)
* fix owners patch issue

* rename func

* typo

* Add Test Case

* Fix Tests

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-20 11:41:13 +05:30
Mohit Yadav
043b18ee0f
Add Redirect Uri Handling for Confidential Flow (#17913)
* Add Redirect Uri Handling for Confidential Flow

* add redirect uri in login

* fix session redirect uri

* update redirect path to absolute path

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2024-09-20 10:31:54 +05:30
Teddy
4331570f7f
GEN 1507 - Implement Origin Entity FQN parms to incident manager listing (#17890)
* fix import issue

* feat: added originEntityFQN param in incident listing

* chore: removed table alias

* fix: added alias to derived table

* style: ran java linting

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 22:45:36 +02:00
Pere Miquel Brull
0f5746499a
GEN-1492 - Decrypt JWT internally for system health check (#17864) 2024-09-18 19:24:10 +02:00
Teddy
33c50efdbf
GEN-1192 - Move Test Case to its Own Resource (#17862)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* chore: extracted test case results to its own resource

* chore: fix failing tests

* chore: move testCaseResult state from testSuite and testCase to dynamic field fetched from test case results search index

* chore: clean up test case repository

* style: ran java linting

* chore: removed testCaseResultSummary and testCaseResult state from db

* fix: test failures

* chore: fix index mapping type for result value

* chore: fix test failure
2024-09-18 11:58:59 +02:00
Sriharsha Chintalapani
4d0339b270
Improve Search Relevancy for tier, usage and use stemming to generate ngrams (#17871)
* Improve Search Relevancy for tier, usage and use stemming to generate ngrams

* Improve Search Relevancy for tier, usage and use stemming to generate ngrams

* add displayName using name

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-09-17 19:41:35 -07:00
Pere Miquel Brull
6a1cd0ef8b
GEN-1493 - Fix paginate_es in opensearch (#17858)
* GEN-1493 - Fix opensearch pagination

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
2024-09-17 14:21:10 +02:00
Sriharsha Chintalapani
6c307e69a6
Fix Search RBAC to consider only ViewAll, ViewBasic (#17865)
* Fix Search RBAC to consider only ViewAll, ViewBasic

* Fix Search RBAC to consider only ViewAll, ViewBasic

* Fix Search RBAC to consider only ViewAll, ViewBasic
2024-09-16 21:31:38 -07:00
Sriharsha Chintalapani
2da9c34730
Issue-13782: RBAC for search (#17757)
* Issue-13782: RBAC for search

* Handle complex conditions

* Add optimizations to condition parsing

* Add SPeL based condition evaluation

* Fix styling

* use SpeL Parser AST to compose ES conditions

* Fix test message

* improvements in query generation

* improvements in query generation

* Add more complex queries

* Add more complex codndition tests and evaluation

* Add OpenSearch query builders and tests

* Add handling resources in a rule, add tests for multiple rules and inherited roles
2024-09-16 11:45:21 +05:30
Sriharsha Chintalapani
c34545adeb
Issue-15768: Support Metric Entity (#17680)
* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Fix tests

* Fix tests

* Fix tests

* Minor: Fix tests

* ui: add metricsAPI rest utils

* ui: metric list page part 1

* feat: Add metric translations for multiple languages

* chore: Add "metric" field to SearchIndexingApplication schema

* ui: add create metric page

* ui: metric details page patch 1

* ui: add custom property and lineage support for metric entity

* ui: add expression component

* ui: add metric summary component

* chore: Update tab labels in MetricDetails and MetricVersion components

* ui: show other info like metric type, granularity, etc

* feat: Add support for metric entity in search dropdown

* feat: Rename custom property to Metric in MetricEntity.md

* feat: Add OwnerLabel component to MetricListPage

* Fix expression field in Metric

* chore: update expression to metricExpression

* ui: add metric header component with edit option

* Add metric to SearchIndexApp

* chore: Update expression to metricExpression

* ui: allow metric expression edit

* ui: update metric icon

* minor improvements

* Fix lineage indexing for Metric

* Update GlobalSettingsClassBase.ts to use MetricIcon for metrics in the global settings menu

* Fix error handling in MetricListPage component

* add related metrics

* minor improvements

* Fix relatedTerms patch

* Fix relatedTerms validation

* Add Boolean for deleted

* filter active entity from related metric list

* playwrite e2e part 1

* Refactor MetricSummary component to include RelatedMetrics in the summary panel

* test: add playwright test for metric special cases

* Add 'Metrics' to Explore Tree

* test: add e2e for add metric page

* test: add test for metric listing page content

* Add Boolean for deleted, remove deleted from suggests

* Refactor LineageProvider to handle deleted flag properly

* add playwright for metric listing

* fix test

* Add colored metric icon and update its usage in GlobalSettingsClassBase

* Fixed py_test test_ometa_endpoint for metric

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 11:36:31 +05:30
Sriharsha Chintalapani
ea62f34385
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#17841)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-09-15 16:31:34 -07:00
IceS2
4ae318f11b
Refactor code to improve di pipeline performance (#17820) 2024-09-13 11:18:22 +02:00
IceS2
9d2784e8e8
Hotfix to the Term Aggregation size on Data Insights (#17822) 2024-09-12 16:50:04 +02:00
Teddy
e066929ff7
GEN-1380 - Implement support for date_histogram aggregation (#17738)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* feat: add support for date_histogram aggregation

* style: ran java linting

* chore: clean up conflicts

* fix: move from iterator loop to forEach

* fix: removed comment

* style: ran java linting
2024-09-12 13:11:30 +02:00
Pere Miquel Brull
f4d0eba08f
MINOR - Add ES pagination with error handling (#17776)
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
2024-09-12 07:14:56 +02:00
Ayush Shah
1c6695b8d7
Fixes #17804: Classification API returns Table class for restore (#17806)
* fix: Classification API returns Table class for restore
2024-09-12 10:11:41 +05:30
Siddhant
052430ee07
fix announcement notification. (#17793) 2024-09-11 22:08:54 +05:30
Imri Paran
0e43aeb1b6
Fix 17304: make ingestion pipeline APIs public (#17700)
* chore(api): make ingestion pipeline APIs public

* format

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-11 19:58:20 +05:30
Siddhant
25175089fc
[REFACTOR] Improved Structure For Email Module (#17755)
* [fix] code structure

* fix test
2024-09-11 18:23:39 +05:30
harshsoni2024
4f57f4e710
GEN-309: OpenAPI Connector (#17754)
* configure api service metadata

* add rest api service

* fix test con. pyformat changes

* add models, fix test con.

* improve test con.

* add docs, side doc

* fix model data parse, url error fix

* add tests

* fix pytest errors

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-09-11 13:36:53 +05:30
Ayush Shah
8decd2338f
MINOR: Add Matillion test connection and schema for pipeline service (#17710) 2024-09-10 17:41:28 +05:30
Mohit Yadav
0c510e443a
Add Listpage Method (#17761) 2024-09-09 16:21:20 +05:30
Teddy
1f72a3c9c6
GEN-1213 - logic to index test case result (#17706)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* fix: added index on id field
2024-09-09 07:58:45 +02:00
IceS2
a5dc937bbe
Remove CostAnalysisWorkflow dependency on Service Connection (#17732)
Connection is not a required attribute for a DatabaseService.
In order to avoid errors we are removing the dependency on this
attribute and checking that the DatabaseServiceType belongs to either
Snowflake, Redshift or BigQuery, which are the supported databases for
this feature.
2024-09-06 10:18:07 +02:00
Siddhant
4fa281074e
New Email Templates (OSS) (#17606)
* Set new emailTemplates for OSS. Minor other improvements.

* Set new emailTemplates for OSS. Minor other improvements.

* fix template.

* set changeCount in the templates.

* fix changeCount calculation

* migrations.
2024-09-06 11:59:29 +05:30
Siddhant
55344555a9
fix pom. (#17682) 2024-09-06 11:58:46 +05:30
Teddy
a7b6279f2e
GEN-1333 Add TS validation on DQ and Porfiler data ingestion (#17731)
* fix: added ts validation for DQ and profiler data

* fix: change ts to ms in pytest

* style: ran python linting
2024-09-06 08:16:31 +02:00
IceS2
d1bc19fbf2
Fixes some things on the APICollection (#17704) 2024-09-05 11:04:50 +02:00
Suresh Srinivas
5cef8e5e7c
Clean up code warnings flagged by IDE (#17679)
* Remove unnecessary imports and throws

* Make members final

* User more performant array/list operations

* Migrate to newer java language level

* Remove verbose or redundant code constructs
2024-09-03 18:31:18 -07:00
Suresh Srinivas
5eebb89ac6
Upgrade dependencies for release 1.6 (#17676) 2024-09-02 15:18:08 -07:00
Sriharsha Chintalapani
ee11760576
Minor: remove unnecessary repository calls in SaerchRepository (#17579) 2024-09-01 00:25:12 -07:00
sonika-shah
6d32257765
Fixes #16498 : Support custom properties for Data Products (#17641) 2024-08-31 09:43:37 +05:30
Sriharsha Chintalapani
46a6851147
Minor: Fix Edit Reviewers Permission (#17638) 2024-08-30 12:01:30 +02:00
Chirag Madlani
fa3529f085
fix(ui): pick email and name based on claim values at time of login (#17626)
* fix(ui): pick email and name based on claim values at time of login

* Update Error Message

* Update code for better message

* Typo

* fix playwright failures

* fix playwright tests

* fix tests

* fix login spec failing

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-08-30 06:27:37 +00:00