10673 Commits

Author SHA1 Message Date
Sachin Chaurasiya
45d48e2a0a
chore(#12882): remove the sso support for bots (#13078)
* chore(#12882): remove the sso support for bots

* fix: unit test
2023-09-11 11:06:13 +05:30
Pere Miquel Brull
66a89ffe61
Fix e2e profiler status (#13127) 2023-09-10 18:46:28 +02:00
07Himank
e98cb244a4
Refactoring search clients (#13016)
* working on refactoring the search clients

* indention

* working on refactoring

* working on refactoring

* working on the refotring the whole search

* working on the refotring the whole search

* working on update indexes from repository

* Refactoring the clients

* cleanup code

* added index removed comments

* ..

* checkstyle

* working on adding new indexes

* style

* incorrect changes

* missed a catch statement

* error handling at one place and async call to clients

* added new indexes to jp,zh async call , many small handlings

* task type fix

* fixing CI

* checkStyle

* fixed CI testes

* fixed CI glossary test issue

* remove reindexing from the inportcsv

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-09-09 12:24:46 +05:30
Mohit Yadav
5f5aeef7f0
Transaction for Delete @UnitOfWork (#13115)
* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* rebase with main

* Fix styling

* Add jdbiUnitOfWork

* Improvements for Change Event Repository and missing Annotations

* Add connection commit/rollback

* push schemaChange fix

* Improvements for Change Event Repository and missing Annotations

* Pass wrapped collectionDAO everywhere

* Pass wrapped collectionDAO everywhere

* Separate event handlers transactions

* Fix checkstyle

* Wrap PUT , POST, and DELETE in transactions

* Add Patch for transactions

* Add primary key to tag.id

* Proxy internal @CreateSQLObjects

* Fix exception handling in ManagedHandleInvocationHandler

* Java typo

* Update schema files

* Checkstyle fix and conflicts resolve issue

* Remove @JdbiUnitOfWOrk from Feed Repository

* remove unnecessary @JdbiUnitOfWork annotation

* Test Failures fix

* Test Failures fix

* Increase wait time , changeEventDAO takes time due to handle.commit()

* commit change

* No need to use commit in ChangeEventHandler

* Add a lookup for avoiding transaction that are not started and should not be rolled back

* remove JdbiUnitOfWork.java

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-08 23:19:44 +05:30
Shailesh Parmar
2b2ec04bc9
ui: updated testCaseResult api from put to patch (#13117) 2023-09-08 17:21:47 +05:30
Sachin Chaurasiya
5de688bf9c
fix(#12736): OIDC Pulling Keyset multiple times per minute. (#13118) 2023-09-08 16:55:26 +05:30
Ashish Gupta
749c7184cd
chore(ui): stored procedure ui changes (#13102)
* chore(ui): stored procedure ui changes

* fix the params and added source url in heading
2023-09-08 16:43:24 +05:30
Mohit Yadav
e70f7afe4b
Add Voting to Entities (#13101)
* Add Voting to Entities

* Fix Failing test and maven build failure in main

* revert files
2023-09-08 16:23:32 +05:30
Shailesh Parmar
cc5128fcb3
fix ui: Percentage of Service with Owners graph in DI calculating wrong data #13084 (#13091) 2023-09-08 14:40:18 +05:30
Mayur Singal
4e633877b3
Fix ElasticSearch Test Connection & Deploy (#13061) 2023-09-08 12:40:48 +05:30
Shailesh Parmar
a41326ea1e
cypress: updated tagsAddRemove spec as per upgrade test (#13083) 2023-09-08 10:40:28 +05:30
Ashish Gupta
478837fa85
supported unit test for stored procedure (#13095)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-08 10:39:05 +05:30
Mayur Singal
ba09f874df
Fix usage count issue (#13109) 2023-09-08 10:36:29 +05:30
Teddy
5d780dc8eb
fix: alerting for entiyFQN filter and testResult filter for test cases (#13113)
* fix: alerting for entiyFQN filter and testResult filter for test cases

* fix: handle empty array
2023-09-07 17:40:42 +02:00
karanh37
b6bab6c7dd
feat(ui): Domains functionality (#12839) 2023-09-07 12:26:25 +05:30
Ayush Shah
8ac70ef2e9
Update index.md (#13111) 2023-09-07 10:45:05 +05:30
Suresh Srinivas
cd2c61ad5e
Cleanup task resolution and closing with task workflows (#13097) 2023-09-06 07:11:16 -07:00
Onkar Ravgan
d8e78a32d8
Added Life Cycle fields, API and ingestion integration (#13014)
* Added initial code

* temp commit

* Added snowflake changes

* Added postgres migration

* removed non req changes

* review comments one

* Added ometa tests

* lint fix

* fix lint naming

* fixed merge changes
2023-09-06 12:37:55 +02:00
Ashish Gupta
6ef003798b
chore(ui): fix signup page styling (#13086)
* chore(ui): fix signup page styling

* fix the file naming convention

* optimize signup form
2023-09-06 15:54:24 +05:30
Pere Miquel Brull
de7e06d024
Update structure for PII processing (#13079)
* Update structure for PII processing

* Fix tests

* Fix tests

* Lint

* Remove typo
2023-09-06 11:30:46 +02:00
Pere Miquel Brull
a9b13de893
Move workflows back into src (#13100)
* Move workflows back into src

* Fix test
2023-09-06 11:30:33 +02:00
Ashish Gupta
3d8c5cd36a
feat(ui): supported version page in stored procedure (#13077)
* supported version page in stored procedure

* minor changes

* changes as per comments
2023-09-06 12:19:28 +05:30
Teddy
c52af7eba0
fix: added upsert logic back for system metrics (#13092) 2023-09-06 08:12:38 +02:00
Teddy
9e9319096a
Issue 13080 - Added logic to update Summary on test case deletion (#13081)
* fix: add logic to update summary on test case deletion

* fix: java linting

* fix: python linting

* fix: empty commit to trigger CI tests
2023-09-06 08:12:11 +02:00
Mayur Singal
79f7e50fbe
Docs: Add permission to external table in snowflake (#13099) 2023-09-06 11:38:49 +05:30
Onkar Ravgan
9af14a5a1c
fixed either in lineage req (#13088) 2023-09-05 18:18:16 +05:30
Sachin Chaurasiya
80c11ab4f5
fix(#12954): restrict roles and policy in settings for admins only (#13073)
* fix(#12954): restrict roles and policy in settings for admins only

* chore: address comments
2023-09-05 15:19:24 +05:30
Mayur Singal
011eaf8ad5
Fix #13001: Fix query not populating to all tables (#13004) 2023-09-05 14:16:37 +05:30
Onkar Ravgan
a3ca8b6e66
Added project filter pattern to dashboard entity (#12925) 2023-09-05 11:01:28 +05:30
Ayush Shah
dc8e59eba8
Fix E2E - dashboards (#13082) 2023-09-04 23:25:31 +05:30
Chirag Madlani
f4218e7774
feat(ui): pipeline and service tab for service listing page (#12949)
* feat(ui): pipeline and service tab for service listing page

* wip pipeline listing page

* support pipeline filter and pagesize option

* fix minor issue

* fix cypress and unit tests

* accomodate skeleton loading changes

* fix unit tests for timezone

* fix unit tests

* fix cypress

* address comments

* fix unit tests
2023-09-04 21:21:56 +05:30
Chirag Madlani
916d9c1d1f
test(ui): table details component (#12278)
* test(ui): table details component

* fix merge conflicts

* address commnets
2023-09-04 19:20:18 +05:30
Ashish Gupta
fe7f2828b2
feat(ui): supported stored procedure in database (#13031)
* feat: supported stored procedure in database

* minor fixes

* fix sonar

* optimize stored procedure code and supported deleted flag for it

* feat(ui): supported code and activity tab in stored procedure (#13054)

* supported code and activity tab in stored procedure

* added support for task functionality

* feat(ui): supported lineage tab in stored procedure (#13060)

* supported code and activity tab in stored procedure

* added support for task functionality

* feat: supported lineage tab in stored procedure

* feat(ui): supported custom property tab in stored procedure and setting page (#13063)

* feat: supported custom property tab in stored procedure and setting page

* added extension field

* chanegs as per comments

* chanegs as per comments
2023-09-04 17:28:29 +05:30
vanshika18
db592a157e
fix #12518 support get column lineage in spline (#13030) 2023-09-04 17:16:04 +05:30
Pere Miquel Brull
a3bfd4e696
Part of #11968 - Restructure Profiler Workflow and PII Processor (#13059)
* Structure PII

* Restructure Profiler Workflow

* Update signature for abc

* remove profiler sink

* Fix tests

* Fix lint

* Fix test

* Fix test
2023-09-04 11:02:57 +02:00
Teddy
2e608987f7
fix: flaky report data tests (#13066)
* fix: remove concurrency tests

* fix: dates in delete test
2023-09-04 10:12:40 +02:00
Shilpa Vernekar
f8a534ab4a
Adding articles to How-to Guides (#13068) 2023-09-04 11:44:54 +05:30
Mayur Singal
029786d773
Fix #9207: Add source in lineage details (#13046) 2023-09-04 11:05:56 +05:30
Sriharsha Chintalapani
111950bd81
fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities (#13041)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-CYPRESSREQUEST-5871337

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-03 17:34:42 +05:30
Shailesh Parmar
67c2e3d402
ui: added skeleton loader for table (#12936)
* ui: added skeleton loader for table

* addressing comments

* updated table skeletan loader logic and component

* updated skeletan loader for table

* refactor role and policy component and updated page with skeletan loader

* updated tags page with skeletan loader

* added unit test for table component and fixed failing unit test

* fixed failing unit test

* addressing comment

* addressing comments

* fixed failing unit test
2023-09-03 12:27:02 +05:30
Sarath Saleem
c07068c44e
[Docs] Add SSAL_SSL config info for Confluent kafka with SSL encryption (#13024) 2023-09-02 11:07:46 -07:00
Onkar Ravgan
d24155e173
rmv fqn field tableau (#13064) 2023-09-02 12:00:33 +02:00
Aniket Katkar
44f7dd35e1
fix #11221: added version pages for missing entities (#13019)
* Added changes for database version page

* added version changes for database schema

* code optimization for service and schema version pages

* added missing changes for schema version page

* Added version changes for classifications

* Added cypress tests for database, database schema and classification version pages

* Added cypress tests for glossary version page

* fixed failing cypress test

* Fixed flaky and failing cypress tests

* fixed failing cypress tests

* worked on comments

* updated the data-row-keys to id for tables

* fixed glossary version cypress
2023-09-02 09:54:25 +05:30
Teddy
0ef085cfc2
fix: summary for logical test suite (#13005)
* fix: summary for logical test suite + DI aggregation on OS

* fix: added logic to attached test case result summary to logical test suite

* fix: test case timestamp in ingestion to milliseconds

* fix: updated entityExtensionTimeSeries DAO to dataQualityDataTimeSeries DAO

* fix: revert aggregation changes
2023-09-01 18:01:59 +02:00
Teddy
ab3042e8ee
Issue 12297 bis -- Delete Insert logic in the DI workflow (#13058)
* fix: updated ingestion to delete existing data for the ingestion day

* fix: added delete endpoint for the report data

* fix: added migration to delete duplicate data + added tables creation & data deltion logic in a transaction

* fix: made deletion SQL engine aware

* fix: added ES deletion logic back while we work on DI event publisher
2023-09-01 18:01:20 +02:00
mohitdeuex
c3f3a976f8 Use String.format properly 2023-09-01 16:51:30 +05:30
Teddy
c198970217
fix: removed single relationship test between testCase and testSuite + throw error if no executable test suite can be found for a test case (#13032) 2023-08-31 18:53:05 +02:00
gauthk6
ba2201f4ea
draft: implementation of lightdash connector. (#12957)
* Fixes a bug while patching the description of a TestCase

* Update docker-compose.yml

* Update docker-compose.yml

* Ran pre-commit checks and linter

* Added some clarifying points and fixed some grammatical errors in the documentation for installation instructions.

* revert changes made to docs

* implementation of lightdash connector.

* ui: add icon for lightdash service

* chore: update lightdash image

* chore: update the icon

* Cleaned up code (took out debug statements, etc.). Still TODO: yield_dashboard_lineage_details() not being called just yet.

* fix: ran linting

* added null checks

* Delete openmetadata-server.md

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-08-31 17:28:07 +02:00
07Himank
ac28d85973
exact match on sourceUrl (#13051) 2023-08-31 19:39:30 +05:30
Pere Miquel Brull
1188831cd5
Fix e2e for tableau, metabase and powerbi (#13050)
* Fix e2e

* Fix e2e
2023-08-31 15:45:41 +02:00