1565 Commits

Author SHA1 Message Date
07Himank
7b7c25529b
Minor Fix Knowledge (#14576)
* Minor Fix Knowledge

* checkstyle

* checkstyle
2024-01-08 10:47:05 -08:00
Mohit Yadav
dad886eaba
Remove LMAX Disruptor , use queue and Quartz (#14422)
* Remove LMAX Disruptor , use queue and Quartz

* Spotless Fix

* Spotless formatting

* Review Comments

* Improvements

* Improvements to add Retry and DLQ

* Spotless fix

* Update Stats

* Fix stats

* Fix delete Failures

* Fix Failing Tests

* Fix Failing Tests

* Fix Failing Tests

* Postgres Fix

* Fix Schema Change for Change Event Table

* Failing test

* Fix Error for non ChangeDescriptions

* Adds Observability On Top of Event Subscription

* Make List Separate

* Add more filters for Test Suite

* Populate Default Schema Updates to Look for

* typo

* Add matchFieldChange and other in paramAdditionalContext

* Review Comments

* Spotless fix

* Merge issue

* Update Filter as per new Syntax

* Fix Failing Test
2024-01-09 00:13:45 +05:30
Sriharsha Chintalapani
b9781746ce
Fix #8496: Segregate ES indexes for use in shared infrastructure (#14606)
* Fix #8496: Segregate ES indexes for use in shared infrastructure

* Fix tests

* use entityType aggregation key for counts

* localisation

* Revert openmetadata.yaml changes

* Update sample_data.yaml

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-01-08 08:29:11 -08:00
Sriharsha Chintalapani
dcff230bb6
Fix #12854: Executable TestSuite should inherit the ownership from its table (#14612) 2024-01-08 17:24:37 +01:00
Pere Miquel Brull
e8eb2bda3c
MINOR - Hide AutoTagger, add MetaPilot search, and fix apps status calls (#14201)
* MINOR - Hide AutoTagger & MetaPilot search & Fix apps status calls

* Fix method call

* Fix method call

* Fix method call

* "additionalProperties": true

* Use EntityRef

* Use ES sink

* Update UI schema type
2024-01-08 14:57:07 +01:00
Sriharsha Chintalapani
10e2f69add
MINOR - exclude logback (#14615)
* exclude logback

* exclude logback
2024-01-08 08:41:24 +01:00
Pere Miquel Brull
b92fd5cde4
MINOR - Move test case incident to the top of the data_quality_data_time_series (#14600)
* Add field and index

* MINOR - Move test case incident to the top of the data_quality_data_time_series table

* Fix test

* Fix compile

* Format

* Update incidentId

* Rename field

* Fix patch
2024-01-08 07:42:15 +01:00
Onkar Ravgan
ecdb7b9f41
Fixes 14109 and 14325: Optimised Tableau Connector (#14548)
* Optimised tableau conn

* Added comment
2024-01-08 06:33:05 +01:00
Sriharsha Chintalapani
a41a341aca
Minor: Revert JWT Filter changes to extract username (#14607) 2024-01-06 23:49:52 -08:00
Ayush Shah
d513dc4d4d
#11890: Add GCS Json schema changes (#14559)
* Issue-11890: Add GCS Json schema changes

* Modify Gcs Security config

* Add Test Def for gcs

* Add gcs for storage_metadata_config
2024-01-06 19:27:36 -08:00
Pere Miquel Brull
aa79bcb923
#14471 - Clean up ingestion status when deleting the ingestion pipeline (#14592) 2024-01-06 09:31:29 -08:00
Mayur Singal
a789fc86d6
Fix #13053: Remove Connection URI config MongoDB (#14584)
* Fix #13053: Remove Connection URI cofig MongoDB

* pyformat & test fixes
2024-01-05 10:51:12 -08:00
Suresh Srinivas
308b4c2096
Clean up code issues flagged by IDE (#14585) 2024-01-05 07:01:08 -08:00
Pere Miquel Brull
0255171218
MINOR - Create Test Case Resolution ts entry & delete resolution when… (#14541)
* MINOR - Create Test Case Resolution ts entry & delete resolution when Test Case is deleted
2024-01-05 09:15:49 +01:00
Aniket Katkar
5a0880ccaa
#11374: Removed the announcement knowledge panel customisability (#14196)
* Removed the announcement knowledge panel
Announcements widget will only show on landing page if  announcements are present

* renamed the MyDataPageV1 to  MyDataPage

* added unit tests for the MyDataPage component

* Added unit tests for customizablePage and MyDataPage

* removed the API call to fetch announcements in customizeMyData component

* added unit tests for CustomizeMyData component

* added unit tests for EmptyWidgetPlaceholder component

* Added unit tests for AddWidgetModal components

* updated the data test ids for widgets

* updated the data test id for KPI widget

* added data-testids related to customize page flow

* Added tests for persona CRUD operations

* localization change for other languages

* updated data test ids related to customize landing page

* updated the persona flow spec

* added cypress tests for customizable landing page flow

* fixed unit tests

* updated the my data page logic to add announcement widget

* fixed empty widget placeholder not showing after resetting the layout

* Minor: Fix the DocStoreResourceTest

* remove the border for announcement widget

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-01-05 11:30:00 +05:30
Sriharsha Chintalapani
34ff582cf2
Allow user login using username and reassign roles based on users' ldap groups when login (#14550)
* Allow users to login with their user name in LDAP mode, and assign roles to user according to their LDAP group while login

* Fix #12503: Ldap feature: Allow user login using username and reassign roles based on users' ldap groups when login

---------

Co-authored-by: wentian <zb-wentian@kingmed.com.cn>
Co-authored-by: EricWent <135603556+EricWent@users.noreply.github.com>
2024-01-05 10:46:07 +05:30
Suresh Srinivas
17e86ad08f
Update maven plugins and dependencies (#14583)
* Update maven plugin versions

* Upgrade maven dependencies
2024-01-04 19:25:05 -08:00
Pere Miquel Brull
d16980a30c
MINOR - Fix Empty Test Suites list filter (#14546)
* MINOR - Fix Empty Test Suites list filter

* allowed empty test suite to appear in logical test suite page

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-01-04 19:27:37 +05:30
mohitdeuex
e0f16cf39e Make Test Method Protected 2024-01-04 14:18:16 +05:30
Pere Miquel Brull
86e679e932
MINOR - Update exception in PipelineServiceClientFactory (#14567)
* MINOR - Update exception in PipelineServiceClientFactory

* format
2024-01-03 16:42:03 +01:00
Sriharsha Chintalapani
7b934b10ae
fix: upgrade org.apache.santuario:xmlsec from 2.2.6 to 2.3.4 (#14509)
Snyk has created this PR to upgrade org.apache.santuario:xmlsec from 2.2.6 to 2.3.4.

See this package in Maven Repository:
https://mvnrepository.com/artifact/org.apache.santuario/xmlsec/

See this project in Snyk:
https://app.snyk.io/org/harshach/project/97e6fbe6-21ff-4c69-b9c5-388bb60a9097?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-12-31 11:10:24 -08:00
Suresh Srinivas
ff423a4ad7
14492 part3 - Add import export support for Table (#14531) 2023-12-29 18:52:50 -08:00
Sriharsha Chintalapani
0303b44b9c
OpenMetadata Operations Command Line Utility (#14504)
* Add new OpenMetadataSetup command line application to migrate/deploy and re-index

* Add new OpenMetadataSetup command line application to migrate/deploy and re-index

* Add deployPipelines option

* Add reIndex option

* add subcommands

* add provision to store upgrade metrics

* rename bootstrap script

* fix styling checks

* Add changelog and store metrics into SERVER_CHANGE_LOG

* Cast jsonb

* Cast jsonb

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-12-29 08:22:58 +01:00
Teddy
2f679a9a48
FIXES #14294: return null if no aggregation value is present (#14514)
* fix: return null is no aggregation value is present

* fix: added Optional typing

* style: java linting

* fix: use Optional type hint

* style: java linting
2023-12-29 08:05:36 +01:00
Mohit Yadav
1f4ab99122
Validate Migration Needs Search Repository in Extensions (#14523) 2023-12-29 12:12:09 +05:30
Suresh Srinivas
4c47a2b90e
Add support for multi record CSV import export (#14520) 2023-12-28 14:03:47 -08:00
Pere Miquel Brull
b84ce33b80
#11799 - Fix Airfow ownership & add pipeline tasks (#14510)
* Fix airflow owner and add tasks

* Add pipeline tasks ownership

* MINOR - Fix py CI

* Add pipeline tasks ownership

* Add pipeline tasks ownership

* MINOR - Fix py CI

* MINOR - Fix py CI

* Add pipeline tasks ownership

* patch team

* patch team

* Format
2023-12-28 10:25:00 -08:00
Teddy
3886842bb7
FIXES #14396: Exclude empty test suites from quality page (#14511)
* fix: exclude empty test suites

* style: ran java linting

* fix: update expected test results
2023-12-28 14:25:49 +01:00
Teddy
3dc642989c
Fixes #7729 - Add logic to compute passed/failed rows (#14472)
* feat: add test case resolution task workflow

* chore: add migration for test case resolution feature

* fix: removed required field for object compatibiity in older migrations

* fix: minor testCaseResolution status logic

* chore: revert migration for test case incident

* chore: update migration file

* style: renamed variables

* feat: added logic to compute failed/passed rows

* feat: add support for row level computation in schema

* chore: add test definition migration

* feat: add logic to explicitly compute row level failure

* chore: clean up code

* style: fix java

* style: fix pyton format

* fix: unhidde API for incident manager

* style: fix java styling
2023-12-27 13:38:51 +01:00
Saurabh Yadav
0691c96eaf
FIxes 13543: Added Duckdb Ingestion Connector (#14468)
* changes

* Added duck db ingestion connector
2023-12-25 18:07:09 -08:00
Sriharsha Chintalapani
4b7f4f43d6
Fix #13982: Fix userFQN encoding while creating mentions (#14496)
* Fix #13982: Fix userFQN encoding while creating mentions

* quote only teams or users
2023-12-25 17:28:13 -08:00
Suresh Srinivas
e98ae8aa2a
14493 Part 1 - Support for database schema, table import export (#14494)
* Fixes #14493 - Import & export support for database

* Import export support for database schema
2023-12-25 13:09:07 -08:00
Suresh Srinivas
496ae26cef
Code clean up related to issues flagged by Sonar and IDE (#14491) 2023-12-22 16:08:04 -08:00
07Himank
f5f0e6b9f9
MINOR search fix (#14480) 2023-12-22 07:46:53 -08:00
Teddy
fe4c353bf3
Fixes #14331 - Add Test Case Incident Manager Migration (#14386)
* feat: add test case resolution task workflow

* chore: add migration for test case resolution feature

* fix: removed required field for object compatibiity in older migrations

* fix: minor testCaseResolution status logic

* chore: revert migration for test case incident

* chore: update migration file

* chore: clean up code

* style: fix java stylecheck
2023-12-22 11:01:51 +01:00
Mohit Yadav
cdddc0c891
Remove and unschedule jobs on (#14481) 2023-12-22 15:04:17 +05:30
Mohit Yadav
417e352358
Fix Charts Tasks for description update (#14456)
* Fix Charts Tasks for description update

* Fix Charts Tasks for description update
2023-12-21 12:03:17 +05:30
Suresh Srinivas
20f7ed182c
Code cleanup to fix errors flagged by Sonar (#14464) 2023-12-20 16:19:31 -08:00
Pere Miquel Brull
e16ad3c5dc
MINOR - Clean ingestion ES code and auth providers (#14358)
* MINOR - Clean ingestion ES code and auth providers

* clean parser

* Clean security config for the client

* Clean security config for the client

* Improve class conversion exceptions

* Fix tests

* Clean up java client

* Clean up java client

* clean parser

* Fix test

* Fix test

* fix NO_AUTH error

* Fix test

* Format

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-19 12:08:48 +01:00
Pere Miquel Brull
fac1896fdb
#13190 - Improve URL handling for Airflow REST Client (#14403)
* #13190 - Improve URL handling for Airflow REST Client

* Fmt

* Format
2023-12-19 12:08:17 +01:00
Mohit Yadav
a469d3bbe7
Add notification for Glossary Approval Task (#14438) 2023-12-19 10:24:54 +01:00
Ayush Shah
21909802b3
Apply Spotless issue fix (#14436) 2023-12-19 12:18:41 +05:30
Mohit Yadav
6612ac9a51
Adds Test in Glossary Term from various languages (#14319)
* Adds Test in Glossary Term from various languages

* Update GlossaryTermResourceTest.java
2023-12-19 09:24:22 +05:30
Sriharsha Chintalapani
123ed59923
Minor: update git-blmae-ignore-revs, and uncomment ClassificationResourceTest tests code (#14431) 2023-12-18 19:16:29 -08:00
Suresh Srinivas
451a20b3cd
Adopt Java 17 features (#14430)
* Adopt Java 17 features

* Make the code comments compact
2023-12-18 17:52:01 -08:00
Sriharsha Chintalapani
1294f93e15
Minor: Migrate to latest google code style library to support Java 17 and beyond (#14429)
* Minor: add spotless and use simplecontext

* Remove context from rule evaluaiton

* Fix EventSubscription tests

* Minor: Migrate to latest google code style library to support Java 17 and beyond

* Minor: Ignore code style migration from git blame
2023-12-18 12:56:17 -08:00
Pere Miquel Brull
a83a5ba3a3
MINOR - Skip delta tests for 3.11 (#14398)
* MINOR - Bump delta for 3.11

* Update flags

* MINOR - Bump delta for 3.11

* Update tests regex

* Update version

* Deprecations

* Format

* Version

* Try delta spark

* Skip delta tests for 3.11

* Update ingestion/tests/unit/topology/pipeline/test_airflow.py
2023-12-18 17:01:57 +01:00
Onkar Ravgan
1af1caf065
Prepare alation connector schemas (#14407) 2023-12-18 13:07:42 +05:30
Onkar Ravgan
ef48b7eae7
MINOR: Added custom properties methods in python sdk (#14402)
* Added custom properties methods in python sdk

* fixed tests
2023-12-18 12:57:14 +05:30
Pere Miquel Brull
d8984d267e
#14340 & #13849 - Clean secret ID and improve encrypt/decrypt exception management (#14356)
* Fix supported characters in SM

* Update SM

* Fixes

* Fixes

* Improve class conversion exceptions

* Comments

* Rename noop to db secrets manager providee

* Update sm

* Fix

* db SM

* db SM

* Fix test

* UI

* Update openmetadata-ui/src/main/resources/ui/src/mocks/IngestionListTable.mock.ts

* update default
2023-12-18 06:43:20 +01:00