1565 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
19b5c946a7
Fix #12167: Support for Stored Procedures as another entity under Database Schema (#12999)
* Add Stored Procedure Entity

* Stored Procedure repository

* Stored Procedure repository

* Fix #12998: Support for Stored Procedures as another entity under Database Schema

* Fix #12998: Support for Stored Procedures as another entity under Database Schema
2023-08-25 08:14:30 +02:00
Pere Miquel Brull
7715ffa088
[WIP] - Add testSuite query param for listing Ingestion Pipelines (#12963)
* Add testSuite query param for listing Ingestion Pipelines

* replace API call param from serviceFilter to testSuite for getAllIngestionWorkflows in TestSuitePipelineTab component

* Filter pipeline type IN condition

* updated pipelineType for ingestionPipeline

* updated cypress

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-08-23 17:17:37 +02:00
Mohit Yadav
6988334b45
- LowerCase the UserNames and Email in user_entity (#12942)
* - LowerCase the UserNames and Email in user_entity
-- Added Migrations for the same

* revert name

* Fix Test

* Fix Failing User tests

* Move LowerCase to DAO

* Remove Unnecessary toLowerCase

* Reverted changes

* Fix Failing Test

* remove dao level shouldLowerCaseFQN

* Remove unnecesarry changes
2023-08-23 13:03:48 +05:30
Suresh Srinivas
3fce9cfbc3
Update dependencies (#12931) 2023-08-22 07:45:09 -07:00
Shailesh Parmar
ec1e5732cd
ui: NO option to edit associated tables "Query used by other tables:" while editing query #12346 (#12837)
* ui: NO option to edit associated tables  "Query used by other tables:" while editing query #12346

* miner update

* updated query patch creation

* ui: NO option to edit associated tables  "Query used by other tables:" while editing query #12346

* miner update

* updated query patch creation

* Fix query patch

* Fix query patch

* added edit support for queryUsedIn and unit test for the same

* added cypress test for query change

* showing current table in queryUsedIn

* fixed failing unit test

* addressing comment

* Fix activity update and test

* Fix checkstyle

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-22 18:50:27 +05:30
Mayur Singal
f6d5c7413f
Fix #6700: Add support for table properties: file format for datalake (#12920)
* Fix #6700: Add support for table properties: file format for datalake & storage

* pylint fix

* resolve review comments
2023-08-22 09:46:22 +02:00
Mohit Yadav
c101b3c9d1
Fix Test Suite Migrations (#12934) 2023-08-21 14:34:58 +05:30
Suresh Srinivas
28b5e00c0c
Clean up documentation typos and grammar issues (#12930) 2023-08-20 20:08:30 -07:00
Teddy
edea862082
fix: DELETE endpoint for profiler data (#12912) 2023-08-18 20:48:04 +02:00
Teddy
a45c644bc4
Issue-12884: Fix Test Case Summary Performance Issues (#12907) 2023-08-18 20:47:47 +02:00
Pere Miquel Brull
191754ff20
Set Test Suite FQN (#12890)
* Set Test Suite FQN

* quoteName

* quoteFqn is false for TestSuites

* Fix tests
2023-08-18 18:56:26 +05:30
Pere Miquel Brull
ccad601a4f
Fix postgres migration files (#12923) 2023-08-18 14:54:43 +02:00
Mohit Yadav
9712337b01
[SecurityHeaders] Fixed issue with Security Headers (#12921) 2023-08-18 17:48:17 +05:30
07Himank
64a258fc3d
delete alias only if it exist (#12918) 2023-08-18 17:36:25 +05:30
Mayur Singal
2f7a2193e0
Fix #12302: Add ElasticSearch Ingestion Source (#12892) 2023-08-18 15:10:31 +05:30
Mohit Yadav
ef2634970f
Fix Classification Migration for missing fqn in json causing failures (#12913) 2023-08-18 14:51:50 +05:30
Onkar Ravgan
5b47fd4acf
Added source url to entities (#12901)
* Added source url to entites

* added support to create and update sourceUrl

* fixed pytests

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-18 10:17:38 +02:00
Sriharsha Chintalapani
524e611edc
Deprecate Flyway and use Native migrations (#12865)
* Add ascii_bin for fqnhash, Add Constraints on timeseries

* Attemp of moving migrations to files

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Move upstream migrations to new path
2023-08-17 14:39:05 -07:00
Mohit Yadav
801d07289c
Added LogBack File (#12897) 2023-08-17 12:20:09 +05:30
Teddy
751c96e437
Fixes Issue #12297 - Added upsert logic for DI (#12466)
* fix: enforce DB upsert on DI ingestion

* fix: ran python linting

* feat: fix conflict and added BindFQN while removing hash

* feat: update aggregation from day to minute

* feat: ran python linting
2023-08-17 08:07:44 +02:00
07Himank
ad3871b3bc
Added source url to search indexes and missing entites (#12773)
* added sourceUrl to missing entites and added sourceUrl to search  indexes

* edited desc in json files

* edited desc in json files

* working on adding api for getting entity from sourceUrl

* added API for getting Entity from sourceUrl

* added api to fetch entity based on sourceUrl

* remove desc

* working on adding alias
2023-08-16 15:56:27 +05:30
Ayush Shah
d7606dd4b8
Fix Ldap (#12872) 2023-08-14 20:15:13 +05:30
Teddy
8e4388c35e
Issue 11345 (#12859)
* feat: added serviceName dimension to entity report

* feat: fix python test
2023-08-14 08:05:14 +02:00
Suresh Srinivas
e3c0539301
12142 Task 4 - Add support for adding entities as part of Data Product (#12867) 2023-08-12 15:45:56 -07:00
Mohit Yadav
c13892d5c2
test suite listing fixes (#12864) 2023-08-12 08:22:46 +05:30
Sriharsha Chintalapani
b6eb51d503
Fix Cypress Test failures for search (#12850) 2023-08-10 23:42:19 -07:00
Sriharsha Chintalapani
192a2ec5fe
Fix #12346: Allow updating Query used by other tables while editing … (#12847)
* Fix #12346: Allow updating Query used by other tables  while editing query

* Fix #12346: Allow updating Query used by other tables  while editing query

---------

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-08-10 23:20:13 -07:00
Sriharsha Chintalapani
7aaf654f01
Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch (#12782)
* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Rebase fixes with main

* Add Sample Data

* lint fix

* remove unused import

* Fix service count test

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-08-10 16:47:37 -07:00
Sriharsha Chintalapani
da0c79cf78
Fix bulk soft-delete or restore from search indexes (#12807)
* Fix bulk soft-delete or restore from search indexes

* Fix bulk soft-delete or restore from search indexes

* Add entityRestored to list events api
2023-08-09 23:24:10 -07:00
Pere Miquel Brull
d8e288626c
Storage connection naming, ADLS service and namespace packaging (#12810)
* Update storage connection naming

* Update storage services and remove typing of generic service

* Remove inits for namespace package

* Add test connection

* Revert "Remove inits for namespace package"

This reverts commit 89f1ae9ea8a633593776f51caf2586d2110d4636.

* Add enum

* Remove init to allow namespace packaging in some modules

* Remove init to allow namespace packaging in some modules

* Move examples and fix test

* Format

* Linting
2023-08-10 07:32:58 +02:00
Sriharsha Chintalapani
a60af7c019
Fix #10164: Check any name voilations during the import dryrun (#12800)
* Fix #10164: Check any name voilations during the import dryrun

* Fix test

* fix test

* Fix checkstyle
2023-08-09 18:50:50 -07:00
Suresh Srinivas
8acc1f61ec
12803.part2 - Display names are not updated in entity references (#12829) 2023-08-09 17:17:55 -07:00
Ayush Shah
d09d0689ec
Fix Test Case (#12818) 2023-08-09 18:41:25 +05:30
Suresh Srinivas
340a029807
Fixes #12802 Add support for generic entity cache (#12803)
* Add entity cache in EntityRepository for all the entities

* Set entity fields only when it is not already set

* Clone entities from the cache

* Remove SubjectCache

* Remove RoleCache

* Remove PolicyCache

* Remove TagLabelCache

* Deleting lingering files

* Test failure fixes

* Remove getEntityReference methods from EntityDAO

* Move quoteName logic to EntityRepository

* Fix test failures
2023-08-08 16:42:54 -07:00
Suresh Srinivas
0e08d6d412
Turn JSONProcessingException into Runtime Exception (#12765) 2023-08-06 18:16:04 -07:00
Mohit Yadav
505a70982a
test suite listing fixes (#12758) 2023-08-04 16:53:51 +05:30
Suresh Srinivas
dc819d0369
Fixes #12741 Getting entity by name does not return inherited properties (#12742) 2023-08-04 03:46:06 -07:00
07Himank
cda004e35e
fixed issue for when classification has . in name the termCount was n… (#12729)
* fixed issue for when classification has . in name the termCount was not getting

* fix url encoding issues

* changes as per comments and sonar fix

* changes as per comments

* fixed issue for when classification has . in name and testcase and pytest issue

* checkstyle

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2023-08-04 11:37:17 +05:30
Suresh Srinivas
c5e7a63fbb
Fixes #11305 Delete tasks corresponding to an entity when the entity is deleted (#12740) 2023-08-03 18:27:01 -07:00
07Himank
00885380b6
fixed displayName issue for owner (#12724) 2023-08-03 19:09:35 +05:30
Mohit Yadav
daf6012374
Fix Failing TestSuite Migration (#12730) 2023-08-03 17:06:30 +05:30
Sriharsha Chintalapani
ef6e281f05
separate mysql/postgres tests (#12703)
* separate mysql/postgres tests

* separate mysql/postgres tests

* separate mysql/postgres tests

* separate mysql/postgres tests

* Update pom.xml
2023-08-02 05:59:09 -07:00
Mohit Yadav
191cee2da0
Fix Test Suite Migrations (#12697)
* Fix Test Suite Migrations

* Fix Test Suite Migrations

* Fix Test
2023-08-02 16:58:22 +05:30
Esmaeil Chitgar
744a3d403f
add automate exception message for invalid enum value as api request parameter (#12400)
* add exception Message for invalid enum value

when enum value is incorrect in api call, this method generates the exactly message as we expect. for example the Include.java in databaseServiceResource.java list() api.

* add an example for invalid enum value as unit test for databaseServiceResource class.

A unit test example that shows how to use invalidEnumValue() method instead of traditional way i.e. writing plain string.

* apply google-formatter

* Merge branch 'EsmaeilChitgar-AddExceptionMessageForInvalidEnumValue' of https://github.com/EsmaeilChitgar/OpenMetadata into EsmaeilChitgar-AddExceptionMessageForInvalidEnumValue

* fix reported issues in pull request

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-01 22:52:48 -07:00
Sriharsha Chintalapani
43e06357a2
Fix #8208: OpenMetadata server supports Postgres 15 (#12370)
* Fix #8208: OpenMetadata server supports Postgres 15

* fix: PSQL 15 Initial scripts to make database owners for permissions

* Update to generic base image tag

* fix: type for airflow username

---------

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-08-02 11:13:28 +05:30
Ashish Gupta
de06d50e7f
fix(ui): ui breaking as url was not encoded. (#12643)
* fix ui breaking because of url having percent in it

* added support for % in about

* fix test cases

* checkstyle

* url fix

* fix storage url

* encoded topic, mlmodel and pipeline entity

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-01 14:12:47 +05:30
Sriharsha Chintalapani
878fda47a1
Fix tests logging; do not initialize the search client if the search … (#12681)
* Fix tests logging; do not initialize the search client if the search config is not present

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C
2023-07-31 23:35:08 -07:00
Chirag Madlani
098625c549
feat(server): description support for team hierarchy (#12638) 2023-08-01 11:25:42 +05:30
Suresh Srinivas
19e223eabd
Fix exceptions thrown as reflections scan non java classes (#12680) 2023-07-31 17:33:47 -07:00
Suresh Srinivas
d968304853
Add BindFQN jdbi annotation to change fqn to fqnHash (#12658) 2023-07-31 11:51:40 -07:00