2200 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
90d1e87cd2
Fix #12898: Support custom properties for Glossary and Glossary Term (#13125) 2023-09-13 00:15:55 +05:30
Sriharsha Chintalapani
1af4941797
Minor fix: Do not re-run migration for properly formed native test su… (#13124)
* Minor fix: Do not re-run migration for properly formed native test suites

* rename 1.1.3 to 1.1.5

* rename 1.1.3 to 1.1.5 and add 1.1.4

* Fix table -> native testsuite migration
2023-09-12 11:43:10 -07:00
Pere Miquel Brull
3afb5212ec
[Docs] - Use a.b.x as version pattern (#13161)
* [Docs] - Use a.b.x as version pattern

* Fix image path
2023-09-12 19:41:21 +02:00
Sriharsha Chintalapani
2f18a31a0f
Revert "Fix #11715: Add Owner EntityRef type validation (#13126)" (#13159)
This reverts commit ba1e930910f304e1b590bbf785d64aa8d04c2953.
2023-09-12 09:45:31 -07:00
Sriharsha Chintalapani
ba1e930910
Fix #11715: Add Owner EntityRef type validation (#13126) 2023-09-12 09:44:18 -07:00
Pere Miquel Brull
f0995cbddc
Part of #12998 - Prep Stored Procedures Skeleton for Snowflake (#13121)
* Prep Stored Procedures Skeleton for Snowflake

* Update pylint and add migrations

* Fix test

* Reuse source url computation
2023-09-12 14:25:42 +02:00
07Himank
1960c68355
doc issue fix (#13148) 2023-09-12 16:27:33 +05:30
karanh37
54e7e81c09
feat: domains ui part 2 (#13133)
* feat: add domain version page

* added domain index .. . support for domain name .. experts and delete is left

* checkstyle

* domain list

* fix: domain selectable list changes

* fix: add missing fields

* fix: add services support for domain

* fix: review comments

* fix: review comments

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-09-12 14:17:36 +05:30
Mayur Singal
2e3e50f0cb
Add used by field in query entity (#13096) 2023-09-11 17:30:34 +05:30
07Himank
e98cb244a4
Refactoring search clients (#13016)
* working on refactoring the search clients

* indention

* working on refactoring

* working on refactoring

* working on the refotring the whole search

* working on the refotring the whole search

* working on update indexes from repository

* Refactoring the clients

* cleanup code

* added index removed comments

* ..

* checkstyle

* working on adding new indexes

* style

* incorrect changes

* missed a catch statement

* error handling at one place and async call to clients

* added new indexes to jp,zh async call , many small handlings

* task type fix

* fixing CI

* checkStyle

* fixed CI testes

* fixed CI glossary test issue

* remove reindexing from the inportcsv

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-09-09 12:24:46 +05:30
Mohit Yadav
5f5aeef7f0
Transaction for Delete @UnitOfWork (#13115)
* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* rebase with main

* Fix styling

* Add jdbiUnitOfWork

* Improvements for Change Event Repository and missing Annotations

* Add connection commit/rollback

* push schemaChange fix

* Improvements for Change Event Repository and missing Annotations

* Pass wrapped collectionDAO everywhere

* Pass wrapped collectionDAO everywhere

* Separate event handlers transactions

* Fix checkstyle

* Wrap PUT , POST, and DELETE in transactions

* Add Patch for transactions

* Add primary key to tag.id

* Proxy internal @CreateSQLObjects

* Fix exception handling in ManagedHandleInvocationHandler

* Java typo

* Update schema files

* Checkstyle fix and conflicts resolve issue

* Remove @JdbiUnitOfWOrk from Feed Repository

* remove unnecessary @JdbiUnitOfWork annotation

* Test Failures fix

* Test Failures fix

* Increase wait time , changeEventDAO takes time due to handle.commit()

* commit change

* No need to use commit in ChangeEventHandler

* Add a lookup for avoiding transaction that are not started and should not be rolled back

* remove JdbiUnitOfWork.java

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-08 23:19:44 +05:30
Mohit Yadav
e70f7afe4b
Add Voting to Entities (#13101)
* Add Voting to Entities

* Fix Failing test and maven build failure in main

* revert files
2023-09-08 16:23:32 +05:30
Mayur Singal
4e633877b3
Fix ElasticSearch Test Connection & Deploy (#13061) 2023-09-08 12:40:48 +05:30
Teddy
5d780dc8eb
fix: alerting for entiyFQN filter and testResult filter for test cases (#13113)
* fix: alerting for entiyFQN filter and testResult filter for test cases

* fix: handle empty array
2023-09-07 17:40:42 +02:00
Suresh Srinivas
cd2c61ad5e
Cleanup task resolution and closing with task workflows (#13097) 2023-09-06 07:11:16 -07:00
Onkar Ravgan
d8e78a32d8
Added Life Cycle fields, API and ingestion integration (#13014)
* Added initial code

* temp commit

* Added snowflake changes

* Added postgres migration

* removed non req changes

* review comments one

* Added ometa tests

* lint fix

* fix lint naming

* fixed merge changes
2023-09-06 12:37:55 +02:00
Teddy
c52af7eba0
fix: added upsert logic back for system metrics (#13092) 2023-09-06 08:12:38 +02:00
Teddy
9e9319096a
Issue 13080 - Added logic to update Summary on test case deletion (#13081)
* fix: add logic to update summary on test case deletion

* fix: java linting

* fix: python linting

* fix: empty commit to trigger CI tests
2023-09-06 08:12:11 +02:00
Mayur Singal
011eaf8ad5
Fix #13001: Fix query not populating to all tables (#13004) 2023-09-05 14:16:37 +05:30
Teddy
2e608987f7
fix: flaky report data tests (#13066)
* fix: remove concurrency tests

* fix: dates in delete test
2023-09-04 10:12:40 +02:00
Teddy
0ef085cfc2
fix: summary for logical test suite (#13005)
* fix: summary for logical test suite + DI aggregation on OS

* fix: added logic to attached test case result summary to logical test suite

* fix: test case timestamp in ingestion to milliseconds

* fix: updated entityExtensionTimeSeries DAO to dataQualityDataTimeSeries DAO

* fix: revert aggregation changes
2023-09-01 18:01:59 +02:00
Teddy
ab3042e8ee
Issue 12297 bis -- Delete Insert logic in the DI workflow (#13058)
* fix: updated ingestion to delete existing data for the ingestion day

* fix: added delete endpoint for the report data

* fix: added migration to delete duplicate data + added tables creation & data deltion logic in a transaction

* fix: made deletion SQL engine aware

* fix: added ES deletion logic back while we work on DI event publisher
2023-09-01 18:01:20 +02:00
mohitdeuex
c3f3a976f8 Use String.format properly 2023-09-01 16:51:30 +05:30
Teddy
c198970217
fix: removed single relationship test between testCase and testSuite + throw error if no executable test suite can be found for a test case (#13032) 2023-08-31 18:53:05 +02:00
gauthk6
ba2201f4ea
draft: implementation of lightdash connector. (#12957)
* Fixes a bug while patching the description of a TestCase

* Update docker-compose.yml

* Update docker-compose.yml

* Ran pre-commit checks and linter

* Added some clarifying points and fixed some grammatical errors in the documentation for installation instructions.

* revert changes made to docs

* implementation of lightdash connector.

* ui: add icon for lightdash service

* chore: update lightdash image

* chore: update the icon

* Cleaned up code (took out debug statements, etc.). Still TODO: yield_dashboard_lineage_details() not being called just yet.

* fix: ran linting

* added null checks

* Delete openmetadata-server.md

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-08-31 17:28:07 +02:00
07Himank
ac28d85973
exact match on sourceUrl (#13051) 2023-08-31 19:39:30 +05:30
Sriharsha Chintalapani
c0d46a236f
Fix test suite migrations to 1.1.4 (#13042)
* Fix test suite migrations to 1.1.4

* Fix test suite migrations to 1.1.4

* Fix test suite migrations to 1.1.4

* Fix test suite migrations to 1.1.4
2023-08-31 12:47:55 +02:00
Mohit Yadav
673512d7f6
Changes For Knowledge Center Dev (#13043) 2023-08-31 11:42:34 +05:30
Suresh Srinivas
cc04a0d245
Add a flag to differentiate prepare for create from update (#13034) 2023-08-30 15:09:27 -07:00
Sriharsha Chintalapani
1bed16fa14
Fix test suite migrations for 1.1.x (#13037) 2023-08-30 08:25:08 +02:00
vanshika18
3cc15e6d0b
Fixed #8418 added new connector couchbase (#12836) 2023-08-29 11:16:32 +05:30
Teddy
867e1c4946
Issue-12914 -- Split profiler, data quality and data insight table from entity_time_series_extension (#12991)
* fix: write testCase result testSuite to compute summary

* fix: empty commit to trigger CI

* fix: extracted report data out of entity_extension_time_series and into report_data_time_series

* fix: split profiler data  from entity_extension_time_series

* fix: split data quality data time series table

* fix: updated migration file
2023-08-28 08:14:15 +02:00
mohitdeuex
60eaeecf25 Fix Formatting 2023-08-25 18:35:31 +05:30
mohitdeuex
6966dd3cea Name should be quoted before hashing 2023-08-25 18:25:20 +05:30
Pere Miquel Brull
050021cb2f
[Docs] - Update path for generating API description (#13000) 2023-08-25 09:25:16 +02:00
Sriharsha Chintalapani
19b5c946a7
Fix #12167: Support for Stored Procedures as another entity under Database Schema (#12999)
* Add Stored Procedure Entity

* Stored Procedure repository

* Stored Procedure repository

* Fix #12998: Support for Stored Procedures as another entity under Database Schema

* Fix #12998: Support for Stored Procedures as another entity under Database Schema
2023-08-25 08:14:30 +02:00
Pere Miquel Brull
7715ffa088
[WIP] - Add testSuite query param for listing Ingestion Pipelines (#12963)
* Add testSuite query param for listing Ingestion Pipelines

* replace API call param from serviceFilter to testSuite for getAllIngestionWorkflows in TestSuitePipelineTab component

* Filter pipeline type IN condition

* updated pipelineType for ingestionPipeline

* updated cypress

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-08-23 17:17:37 +02:00
Mohit Yadav
6988334b45
- LowerCase the UserNames and Email in user_entity (#12942)
* - LowerCase the UserNames and Email in user_entity
-- Added Migrations for the same

* revert name

* Fix Test

* Fix Failing User tests

* Move LowerCase to DAO

* Remove Unnecessary toLowerCase

* Reverted changes

* Fix Failing Test

* remove dao level shouldLowerCaseFQN

* Remove unnecesarry changes
2023-08-23 13:03:48 +05:30
Suresh Srinivas
3fce9cfbc3
Update dependencies (#12931) 2023-08-22 07:45:09 -07:00
Shailesh Parmar
ec1e5732cd
ui: NO option to edit associated tables "Query used by other tables:" while editing query #12346 (#12837)
* ui: NO option to edit associated tables  "Query used by other tables:" while editing query #12346

* miner update

* updated query patch creation

* ui: NO option to edit associated tables  "Query used by other tables:" while editing query #12346

* miner update

* updated query patch creation

* Fix query patch

* Fix query patch

* added edit support for queryUsedIn and unit test for the same

* added cypress test for query change

* showing current table in queryUsedIn

* fixed failing unit test

* addressing comment

* Fix activity update and test

* Fix checkstyle

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-22 18:50:27 +05:30
Mayur Singal
f6d5c7413f
Fix #6700: Add support for table properties: file format for datalake (#12920)
* Fix #6700: Add support for table properties: file format for datalake & storage

* pylint fix

* resolve review comments
2023-08-22 09:46:22 +02:00
Mohit Yadav
c101b3c9d1
Fix Test Suite Migrations (#12934) 2023-08-21 14:34:58 +05:30
Suresh Srinivas
28b5e00c0c
Clean up documentation typos and grammar issues (#12930) 2023-08-20 20:08:30 -07:00
Teddy
edea862082
fix: DELETE endpoint for profiler data (#12912) 2023-08-18 20:48:04 +02:00
Teddy
a45c644bc4
Issue-12884: Fix Test Case Summary Performance Issues (#12907) 2023-08-18 20:47:47 +02:00
Pere Miquel Brull
191754ff20
Set Test Suite FQN (#12890)
* Set Test Suite FQN

* quoteName

* quoteFqn is false for TestSuites

* Fix tests
2023-08-18 18:56:26 +05:30
Pere Miquel Brull
ccad601a4f
Fix postgres migration files (#12923) 2023-08-18 14:54:43 +02:00
Mohit Yadav
9712337b01
[SecurityHeaders] Fixed issue with Security Headers (#12921) 2023-08-18 17:48:17 +05:30
07Himank
64a258fc3d
delete alias only if it exist (#12918) 2023-08-18 17:36:25 +05:30
Mayur Singal
2f7a2193e0
Fix #12302: Add ElasticSearch Ingestion Source (#12892) 2023-08-18 15:10:31 +05:30