739 Commits

Author SHA1 Message Date
Pere Miquel Brull
9900764961
Pipeline Service Client - Handle unexpected status response (#13314)
* airflow install docs

* Pipeline Service Client - Handle unexpected response
2023-09-26 12:58:39 +02:00
Pere Miquel Brull
a4b9a2d2cb
Fix #13023 - Fix ingestionPipeline list parameters (#13289)
* Fix ingestionPipeline list parameters

* Fix test

* support filters from ui

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-26 10:57:14 +02:00
Suresh Srinivas
dc5de12668
13188 (#13331)
* WIP

* Fixes #13188 Non-admin user can't add term on glossary after policy assigned
2023-09-25 12:09:25 -07:00
Sriharsha Chintalapani
106db87eec
Update EnumBackwardCompatibilityTest.java (#13328) 2023-09-25 09:53:40 -07:00
Suresh Srinivas
eb865a997d
Add BindUUID JDBI support to directly pass UUID to queries (#13315) 2023-09-22 12:21:22 -07:00
Pere Miquel Brull
880907f8c8
Check for required fields before update (#13308) 2023-09-22 15:27:17 +02:00
Sriharsha Chintalapani
c368157036
Move 1.1.4 migrations to 1.1.6 and add an empty dir for 1.1.6 migrations to invoke the data migration (#13300) 2023-09-21 16:36:45 -07:00
Teddy
e9ef7b5e81
Issue-12857: Remove ES Dependency from DI Workflow (#13303)
* feat: move elasticsearch indexing to backend + introduced EntityTimeSeries interface for timeseries type object

* feat: make reportData.json inherit from EntityTimeSeriesInterface

* feat: updated type to Object

* feat: deleted elasticsearch dependencies

* feat: removed elasticsearch indexing from workflow

* feat: added data insight sample data

* feat: cleaned up tests
2023-09-21 16:17:47 -07:00
07Himank
8292ad0078
addded aggreagtions for new indexes and fields and missing things (#13278) 2023-09-21 10:41:38 +05:30
Sriharsha Chintalapani
e0ecf49585
Fix #11970: Search by FQN; Refactor Search Indexing, Add API to searc… (#13271)
* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Fix #11970: Search by FQN; Refactor Search Indexing, Add API to search for specific field

* Add wildcard support

* Fix GlossaryTerm Patch
2023-09-20 14:40:10 +05:30
Suresh Srinivas
f45d82484d
Fixes #3090 Glossary Term approval workflow (#13269) 2023-09-19 18:30:20 -07:00
Pere Miquel Brull
ad27b09fac
Clean migration and pass nameHashColumn as param when needed (#13265) 2023-09-19 10:37:42 -07:00
Sriharsha Chintalapani
03dfd9e6b2
Fix transactions , remove unnecessary autoCommit flag check (#13234)
* Fix transactions intermittent test failures

* Fix transactions intermittent test failures

* fix serachIndex list from ui side

* invalid file name

* Revert "Fix transactions intermittent test failures"

This reverts commit 44c4c8c42824beb3e7420e51af0c5f2c6f4de90d.

* Fix commit issue and unnecessary closure in NotificationHandler

* Remove HTTPGetEventlistner, wrap get handle in try

* Fix code style

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-09-19 09:53:55 -07:00
Pere Miquel Brull
351df08957
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#13224)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGECLIPSEJETTY-5902998

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-09-19 08:30:58 -07:00
Pere Miquel Brull
18a4513ccc
Fix #13237 - Rename to instanceDomain and test DomoDashboard charts (#13247)
* Rename sandboxDomain to instanceDomain

* Test Get Charts in DomoDashboard

* Fix schemas

* Fix test

* Fix test

* Rename to Auto Tag PII

* Fix query test

* Fix query test

* Fix query test
2023-09-19 14:14:04 +02:00
Sriharsha Chintalapani
c2ed4f422f
Fix LifeCycle inconsistencies in Schema, make it common entity field (#13252)
* Fix LifeCycle inconsistencies in Schema; Add DELETE api

* set autocommit to true for non transactional

* make lifecycle common field for entities

* Add LifeCycle as common entity field

* Fix python life cycle code

* Fix search indexes

* remove unnecessary constant

* Add test back to entity resource test

* Fix lint

* Fix lint

* Fix lint

* Fix lint

* Add missing schema

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-09-19 14:03:57 +02:00
Teddy
b07dac8c1d
Issue-12305 - Add logic to sort test cases result by latest execution (#13143)
* fix: added logic to store test case result state with test case entity

* fix: added relative path logic in python unit test

* fix: added logic to sort testCases based on last execution date of test case result

* fix: ran python linting

* fix: added test case listing order param in frontend call

* fix: added tests around test suite result summary state

* fix: remove isDeleted repeated check

* fix: isolated test suite for maven tests + fix some UI failing tests

* fix: run java linting
2023-09-19 08:21:38 +02:00
Pere Miquel Brull
22b0f44e38
Part of #12998 - Query Service & Lineage filter processed queries (#13215)
* Update mapping

* Prep

* prep

* Prep query migration

* Add query index deletion fix

* Docs and Maven CI fix

* Fix tests

* Add service filter

* Add query entity FQN col migration

* Fix lint

* supported serviceFQN in query api

* Prep repo

* Prep ES query search

* Do not recompute lineage

* Format

* Fix test

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2023-09-19 07:37:47 +02:00
Shailesh Parmar
a268f2adf8
cypress: fixed cypress failure in the main (#13221)
* cypress: fixed cypress failure in the main

* fixed flaky cypress for glossary

* fixed failing cypress

* fixed flaky cypress specs

* fixed failing cypress for query and users

* Add immediate refresh policy

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2023-09-18 17:54:43 +05:30
Sriharsha Chintalapani
734629f846
Fix #9972: Add Style with color or icon for Tags,GlossaryTerm, Domain… (#13233)
* Fix #9972: Add Badge with color or icon for Tags,GlossaryTerm, Domain and DataProducts

* Fix #9972: Add Style with color or icon for Tags,GlossaryTerm, Domain and DataProducts

* Add style to TagLabel
2023-09-17 20:01:55 -07:00
Sriharsha Chintalapani
02094179e6
Fix #12899: UI to use Tier TAG displayName if provided (#13232)
* Fix #12899: UI to use Tier TAG displayName if provided

* fix python test
2023-09-17 14:28:10 -07:00
Suresh Srinivas
f7ee1c76a0
Code cleanup necessary for Glossary workflow (#13219) 2023-09-17 09:37:29 -07:00
karanh37
e0e246772d
feat(ui): add data products page (#13178)
* changed properties of dataProducts

* feat: add data products ui

* fix: assets tab widget layout

* fix: assets tab layout in data products

* fix: minor css issues

* fix: review comments

* fix: update domain icon

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-09-16 17:37:00 +05:30
Suresh Srinivas
3abb83052d
Fixes #13049 - Glossary recursive delete fails (#13182) 2023-09-15 10:21:38 -07:00
07Himank
d10d28da0c
Delete relationship of domain (#13202) 2023-09-15 08:15:10 -07:00
Mayur Singal
5f56732449
Fix: Stored Procedure Lineage not visible on detail page (#13198) 2023-09-15 06:00:27 -07:00
07Himank
ae55b81a36
fix suggest api bug for new indexes.. added entityType for new Indexes (#13192) 2023-09-14 19:59:05 +05:30
Teddy
4396cada65
fix: use entityLink FQN vs entityFQN when checking against entity FQN in alerting (#13189) 2023-09-14 11:37:36 +02:00
Teddy
a9ce04c129
fix: move testSuite summary state update to preDelete (#13180)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-14 07:58:08 +02:00
Sriharsha Chintalapani
ffa5248ef2
Fix #11715: Add Owner EntityRef type validation (#13162)
* Fix #11715: Add Owner EntityRef type validation

* Fix #11715: Add Owner EntityRef type validation
2023-09-13 20:28:47 -07:00
Sriharsha Chintalapani
03fc4d8be5
set autocommit to true for non transactional (#13184)
* set autocommit to true for non transactional

* set autocommit to true for non transactional
2023-09-13 15:20:17 -07:00
07Himank
0059645b64
added data products index and missing code of stored procedure index (#13175) 2023-09-13 18:52:49 +05:30
Mohit Yadav
c5edf37cfe
Close unnecessary connections (#13177) 2023-09-13 18:37:36 +05:30
Ashish Gupta
4aab921d10
fix(ui): supported upvoting in data asset (#13138)
* supported upvoting in entities

* Add api endpoint for voting in MLModel and Pipeline

* fix unit test

* disable header button in case of deleted entity and minor changes

* fix conflict unit test

* supported upvoting in glossaries

* supported cypress and unit test for entities

* changes as per comments

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-13 14:38:13 +05:30
Pere Miquel Brull
42393f5de3
Part of #12998 - Add Stored Procedures support in BigQuery (#13160)
* Fix snowflake SP source url

* Update sourceUrl on PUT

* Add BigQuery Stored Procedures support

* Linting

* Linting

* lint

* Linting
2023-09-13 08:47:45 +02:00
Onkar Ravgan
1e4d48a034
Added Life Cycle sample data and changed datetime to timestamp (#13141) 2023-09-13 10:59:19 +05:30
Mohit Yadav
6d4e425f36
Remove Cleanups for JdbiUnitOfWorkProvider + added cases for autocomm… (#13163)
* Remove Cleanups for JdbiUnitOfWorkProvider + added cases for autocommit in case of non transactional events

* remove unnecessary clear

* typos
2023-09-12 20:28:42 -07:00
Suresh Srinivas
1865f46ab5
Fixes 13146 - Patch operation not working for Domain (#13164) 2023-09-12 20:28:00 -07:00
Suresh Srinivas
a22d7bb87f
Update dependencies (#13158) 2023-09-12 15:48:33 -07:00
Sriharsha Chintalapani
90d1e87cd2
Fix #12898: Support custom properties for Glossary and Glossary Term (#13125) 2023-09-13 00:15:55 +05:30
Sriharsha Chintalapani
1af4941797
Minor fix: Do not re-run migration for properly formed native test su… (#13124)
* Minor fix: Do not re-run migration for properly formed native test suites

* rename 1.1.3 to 1.1.5

* rename 1.1.3 to 1.1.5 and add 1.1.4

* Fix table -> native testsuite migration
2023-09-12 11:43:10 -07:00
Pere Miquel Brull
3afb5212ec
[Docs] - Use a.b.x as version pattern (#13161)
* [Docs] - Use a.b.x as version pattern

* Fix image path
2023-09-12 19:41:21 +02:00
Sriharsha Chintalapani
2f18a31a0f
Revert "Fix #11715: Add Owner EntityRef type validation (#13126)" (#13159)
This reverts commit ba1e930910f304e1b590bbf785d64aa8d04c2953.
2023-09-12 09:45:31 -07:00
Sriharsha Chintalapani
ba1e930910
Fix #11715: Add Owner EntityRef type validation (#13126) 2023-09-12 09:44:18 -07:00
Pere Miquel Brull
f0995cbddc
Part of #12998 - Prep Stored Procedures Skeleton for Snowflake (#13121)
* Prep Stored Procedures Skeleton for Snowflake

* Update pylint and add migrations

* Fix test

* Reuse source url computation
2023-09-12 14:25:42 +02:00
07Himank
1960c68355
doc issue fix (#13148) 2023-09-12 16:27:33 +05:30
karanh37
54e7e81c09
feat: domains ui part 2 (#13133)
* feat: add domain version page

* added domain index .. . support for domain name .. experts and delete is left

* checkstyle

* domain list

* fix: domain selectable list changes

* fix: add missing fields

* fix: add services support for domain

* fix: review comments

* fix: review comments

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-09-12 14:17:36 +05:30
Mayur Singal
2e3e50f0cb
Add used by field in query entity (#13096) 2023-09-11 17:30:34 +05:30
07Himank
e98cb244a4
Refactoring search clients (#13016)
* working on refactoring the search clients

* indention

* working on refactoring

* working on refactoring

* working on the refotring the whole search

* working on the refotring the whole search

* working on update indexes from repository

* Refactoring the clients

* cleanup code

* added index removed comments

* ..

* checkstyle

* working on adding new indexes

* style

* incorrect changes

* missed a catch statement

* error handling at one place and async call to clients

* added new indexes to jp,zh async call , many small handlings

* task type fix

* fixing CI

* checkStyle

* fixed CI testes

* fixed CI glossary test issue

* remove reindexing from the inportcsv

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-09-09 12:24:46 +05:30
Mohit Yadav
5f5aeef7f0
Transaction for Delete @UnitOfWork (#13115)
* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* Fix #12494: Jdbi Transactions opens a new connection per DAO causing recursive delete to not to rollback

* rebase with main

* Fix styling

* Add jdbiUnitOfWork

* Improvements for Change Event Repository and missing Annotations

* Add connection commit/rollback

* push schemaChange fix

* Improvements for Change Event Repository and missing Annotations

* Pass wrapped collectionDAO everywhere

* Pass wrapped collectionDAO everywhere

* Separate event handlers transactions

* Fix checkstyle

* Wrap PUT , POST, and DELETE in transactions

* Add Patch for transactions

* Add primary key to tag.id

* Proxy internal @CreateSQLObjects

* Fix exception handling in ManagedHandleInvocationHandler

* Java typo

* Update schema files

* Checkstyle fix and conflicts resolve issue

* Remove @JdbiUnitOfWOrk from Feed Repository

* remove unnecessary @JdbiUnitOfWork annotation

* Test Failures fix

* Test Failures fix

* Increase wait time , changeEventDAO takes time due to handle.commit()

* commit change

* No need to use commit in ChangeEventHandler

* Add a lookup for avoiding transaction that are not started and should not be rolled back

* remove JdbiUnitOfWork.java

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-08 23:19:44 +05:30