2141 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
2da9c34730
Issue-13782: RBAC for search (#17757)
* Issue-13782: RBAC for search

* Handle complex conditions

* Add optimizations to condition parsing

* Add SPeL based condition evaluation

* Fix styling

* use SpeL Parser AST to compose ES conditions

* Fix test message

* improvements in query generation

* improvements in query generation

* Add more complex queries

* Add more complex codndition tests and evaluation

* Add OpenSearch query builders and tests

* Add handling resources in a rule, add tests for multiple rules and inherited roles
2024-09-16 11:45:21 +05:30
Sriharsha Chintalapani
c34545adeb
Issue-15768: Support Metric Entity (#17680)
* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Issue-15768: Support Metric Entity

* Fix tests

* Fix tests

* Fix tests

* Minor: Fix tests

* ui: add metricsAPI rest utils

* ui: metric list page part 1

* feat: Add metric translations for multiple languages

* chore: Add "metric" field to SearchIndexingApplication schema

* ui: add create metric page

* ui: metric details page patch 1

* ui: add custom property and lineage support for metric entity

* ui: add expression component

* ui: add metric summary component

* chore: Update tab labels in MetricDetails and MetricVersion components

* ui: show other info like metric type, granularity, etc

* feat: Add support for metric entity in search dropdown

* feat: Rename custom property to Metric in MetricEntity.md

* feat: Add OwnerLabel component to MetricListPage

* Fix expression field in Metric

* chore: update expression to metricExpression

* ui: add metric header component with edit option

* Add metric to SearchIndexApp

* chore: Update expression to metricExpression

* ui: allow metric expression edit

* ui: update metric icon

* minor improvements

* Fix lineage indexing for Metric

* Update GlobalSettingsClassBase.ts to use MetricIcon for metrics in the global settings menu

* Fix error handling in MetricListPage component

* add related metrics

* minor improvements

* Fix relatedTerms patch

* Fix relatedTerms validation

* Add Boolean for deleted

* filter active entity from related metric list

* playwrite e2e part 1

* Refactor MetricSummary component to include RelatedMetrics in the summary panel

* test: add playwright test for metric special cases

* Add 'Metrics' to Explore Tree

* test: add e2e for add metric page

* test: add test for metric listing page content

* Add Boolean for deleted, remove deleted from suggests

* Refactor LineageProvider to handle deleted flag properly

* add playwright for metric listing

* fix test

* Add colored metric icon and update its usage in GlobalSettingsClassBase

* Fixed py_test test_ometa_endpoint for metric

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-16 11:36:31 +05:30
Sriharsha Chintalapani
ea62f34385
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#17841)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGJETBRAINSKOTLIN-2393744

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-09-15 16:31:34 -07:00
IceS2
4ae318f11b
Refactor code to improve di pipeline performance (#17820) 2024-09-13 11:18:22 +02:00
IceS2
9d2784e8e8
Hotfix to the Term Aggregation size on Data Insights (#17822) 2024-09-12 16:50:04 +02:00
Teddy
e066929ff7
GEN-1380 - Implement support for date_histogram aggregation (#17738)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* feat: add support for date_histogram aggregation

* style: ran java linting

* chore: clean up conflicts

* fix: move from iterator loop to forEach

* fix: removed comment

* style: ran java linting
2024-09-12 13:11:30 +02:00
Pere Miquel Brull
f4d0eba08f
MINOR - Add ES pagination with error handling (#17776)
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
2024-09-12 07:14:56 +02:00
Ayush Shah
1c6695b8d7
Fixes #17804: Classification API returns Table class for restore (#17806)
* fix: Classification API returns Table class for restore
2024-09-12 10:11:41 +05:30
Siddhant
052430ee07
fix announcement notification. (#17793) 2024-09-11 22:08:54 +05:30
Imri Paran
0e43aeb1b6
Fix 17304: make ingestion pipeline APIs public (#17700)
* chore(api): make ingestion pipeline APIs public

* format

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-11 19:58:20 +05:30
Siddhant
25175089fc
[REFACTOR] Improved Structure For Email Module (#17755)
* [fix] code structure

* fix test
2024-09-11 18:23:39 +05:30
harshsoni2024
4f57f4e710
GEN-309: OpenAPI Connector (#17754)
* configure api service metadata

* add rest api service

* fix test con. pyformat changes

* add models, fix test con.

* improve test con.

* add docs, side doc

* fix model data parse, url error fix

* add tests

* fix pytest errors

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-09-11 13:36:53 +05:30
Ayush Shah
8decd2338f
MINOR: Add Matillion test connection and schema for pipeline service (#17710) 2024-09-10 17:41:28 +05:30
Mohit Yadav
0c510e443a
Add Listpage Method (#17761) 2024-09-09 16:21:20 +05:30
Teddy
1f72a3c9c6
GEN-1213 - logic to index test case result (#17706)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* fix: added index on id field
2024-09-09 07:58:45 +02:00
IceS2
a5dc937bbe
Remove CostAnalysisWorkflow dependency on Service Connection (#17732)
Connection is not a required attribute for a DatabaseService.
In order to avoid errors we are removing the dependency on this
attribute and checking that the DatabaseServiceType belongs to either
Snowflake, Redshift or BigQuery, which are the supported databases for
this feature.
2024-09-06 10:18:07 +02:00
Siddhant
4fa281074e
New Email Templates (OSS) (#17606)
* Set new emailTemplates for OSS. Minor other improvements.

* Set new emailTemplates for OSS. Minor other improvements.

* fix template.

* set changeCount in the templates.

* fix changeCount calculation

* migrations.
2024-09-06 11:59:29 +05:30
Siddhant
55344555a9
fix pom. (#17682) 2024-09-06 11:58:46 +05:30
Teddy
a7b6279f2e
GEN-1333 Add TS validation on DQ and Porfiler data ingestion (#17731)
* fix: added ts validation for DQ and profiler data

* fix: change ts to ms in pytest

* style: ran python linting
2024-09-06 08:16:31 +02:00
IceS2
d1bc19fbf2
Fixes some things on the APICollection (#17704) 2024-09-05 11:04:50 +02:00
Suresh Srinivas
5cef8e5e7c
Clean up code warnings flagged by IDE (#17679)
* Remove unnecessary imports and throws

* Make members final

* User more performant array/list operations

* Migrate to newer java language level

* Remove verbose or redundant code constructs
2024-09-03 18:31:18 -07:00
Suresh Srinivas
5eebb89ac6
Upgrade dependencies for release 1.6 (#17676) 2024-09-02 15:18:08 -07:00
Sriharsha Chintalapani
ee11760576
Minor: remove unnecessary repository calls in SaerchRepository (#17579) 2024-09-01 00:25:12 -07:00
sonika-shah
6d32257765
Fixes #16498 : Support custom properties for Data Products (#17641) 2024-08-31 09:43:37 +05:30
Sriharsha Chintalapani
46a6851147
Minor: Fix Edit Reviewers Permission (#17638) 2024-08-30 12:01:30 +02:00
Chirag Madlani
fa3529f085
fix(ui): pick email and name based on claim values at time of login (#17626)
* fix(ui): pick email and name based on claim values at time of login

* Update Error Message

* Update code for better message

* Typo

* fix playwright failures

* fix playwright tests

* fix tests

* fix login spec failing

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-08-30 06:27:37 +00:00
harshsoni2024
5393e5ede2
Connector: vertexai schema (#17632)
* vertexai connection schema

* remove yaml file
2024-08-29 21:19:07 -07:00
Teddy
26befb6db1
fix: lineage lookup for long FQNs (#17633) 2024-08-29 15:15:04 +00:00
Mayur Singal
84c1efba96
MINOR: Fix delete lineage in case of override lineage enabled (#17625) 2024-08-29 15:46:58 +05:30
Mohit Yadav
a9a1a2036b
[MINOR] Fix Email Updates (#17620)
* Fix Email

* Fix Test
2024-08-29 11:59:00 +05:30
Mohit Yadav
e4073c7824
Bump Openmetadata Snapshot version (#17621) 2024-08-29 01:51:20 +05:30
IceS2
b8af2019b4
MINOR: Add pagination to entity history versions (#17587)
* Add pagination to EntityHistory Versions

* Fix endless loop
2024-08-28 14:38:15 +05:30
Onkar Ravgan
d6eb4fa9e8
MINOR: Fixed owner not updating from dbt if owners field has an empty list set in db (#17610)
* Fixed owner not updating from dbt for empty list

* fix table get
2024-08-28 14:30:58 +05:30
Sriharsha Chintalapani
94f0c1144e
Patch response should sort the owners field (#17599) 2024-08-27 11:02:12 -07:00
Siddhant
19b5d49dc8
[FIX] Fix IsEmailServiceEnabled. (#17601)
* fix isEmailServiceEnabled.

* use getSmtpSettings() from emailUtil
2024-08-27 23:23:20 +05:30
Pere Miquel Brull
c5623d0254
FIX - PG Migration for automator (#17583) 2024-08-25 20:35:36 -07:00
Siddhant
a2c77b08b7
[FIX] EmailTemplates Edit Configurations. (#17581)
* added migration for emailTemplates.

* PUT will set the old template in the db.[walkaround]

* remove migration.
2024-08-25 18:58:47 +05:30
Siddhant
929bae5b7b
Changed Double to int for the DataAssetCount. Included % for the percentageChangeValue. Added colors to the % values with the digits. Corrected the incorrect placeholders. (#17578) 2024-08-24 11:43:54 +05:30
sonika-shah
cce22a1b5c
Improve count/feed api performance for 1.5 (#17576) 2024-08-23 11:20:34 -07:00
IceS2
ce19fa3389
Add '/' prefix in order to avoid Bad Request answer from AWS OpenSearch (#17575) 2024-08-23 20:01:56 +02:00
Siddhant
c76c27e1e9
correct the placeHolder to fetch the dataCount. (#17569) 2024-08-23 14:46:37 +00:00
Mohit Yadav
bb52bc779e
Fix Get Parent (#17567) 2024-08-23 18:19:26 +05:30
IceS2
ef7042752a
MINOR: Fix Percentage Difference Calculation and Tier Summary Calculation. (#17560)
* Fix unparsable date and remove legacy code

* fix ui for data insight cleanup

* fix unit tests

* fix tour playwright

* fix percentage value and label for charts

* Moved 'NoTier' filter from Filter to Query

* Removed SystemChartType.TotalDataAssetsByTier from condition

* Hack: Quick fix for calculating the % difference on System Charts

* Fix checkstyle

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
2024-08-23 07:00:12 +02:00
IceS2
9e7ddfbd69
MINOR: Fix unparsable date and remove legacy code (#17549)
* Fix unparsable date and remove legacy code

* fix ui for data insight cleanup

* fix unit tests

* fix tour playwright

* fix percentage value and label for charts

---------

Co-authored-by: Chira Madlani <chirag@getcollate.io>
2024-08-22 14:52:47 -07:00
IceS2
d0c08fb6e6
Add a Workaround for the Tier Calculation on DataInsightsReport (#17555) 2024-08-22 14:51:58 -07:00
sonika-shah
eb400e0cd2
Exclude tasks in listCountByOwner for user/team owned assets (#17554) 2024-08-22 11:11:50 -07:00
IceS2
0d1b4e0747
Add Fix for timestamps (#17547) 2024-08-22 13:28:36 +02:00
IceS2
cb8a8a8b81
MINOR: Handle missing user on Web Analytics (#17546)
* Handle missing user on Web Analytics. Changed Daily Active Users to epoch timestamp

* Rollback epoch timestamp changes
2024-08-22 12:34:28 +02:00
Ashish Gupta
588535f36e
MINOR: fix status badge for search index application (#17536)
* fix status badge for search index application

* fix sonar and added separate color for activeError

* Running status

* remove the css for activeError

* fix count button styling in explore tree node

* fix the connector icon not proper in list

* remove the unused code

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-08-22 15:45:35 +05:30
IceS2
69321debba
Changed Data Insights Elastic Search queries to using epoch timestamp (#17534) 2024-08-21 19:57:58 -07:00