743 Commits

Author SHA1 Message Date
Yu Ishikawa
6b6d4bba76
Support to impersonate a service account in the Bigquery source (#10127) 2023-08-20 19:20:02 +05:30
Sachin Chaurasiya
6e2a8d0e4f
feat(ui): generate ingestion workflow form from schema (#12774) 2023-08-20 12:01:06 +05:30
Teddy
a45c644bc4
Issue-12884: Fix Test Case Summary Performance Issues (#12907) 2023-08-18 20:47:47 +02:00
Mayur Singal
2f7a2193e0
Fix #12302: Add ElasticSearch Ingestion Source (#12892) 2023-08-18 15:10:31 +05:30
Sriharsha Chintalapani
524e611edc
Deprecate Flyway and use Native migrations (#12865)
* Add ascii_bin for fqnhash, Add Constraints on timeseries

* Attemp of moving migrations to files

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Deprecate Flyway and use Native migrations

* Move upstream migrations to new path
2023-08-17 14:39:05 -07:00
Onkar Ravgan
3114ef9b5c
Add support for JWT auth in Trino (#12823)
* Added jwt field in trino

* fixed postgres migration

* fixed pytests
2023-08-17 07:22:58 +02:00
07Himank
ad3871b3bc
Added source url to search indexes and missing entites (#12773)
* added sourceUrl to missing entites and added sourceUrl to search  indexes

* edited desc in json files

* edited desc in json files

* working on adding api for getting entity from sourceUrl

* added API for getting Entity from sourceUrl

* added api to fetch entity based on sourceUrl

* remove desc

* working on adding alias
2023-08-16 15:56:27 +05:30
Teddy
8e4388c35e
Issue 11345 (#12859)
* feat: added serviceName dimension to entity report

* feat: fix python test
2023-08-14 08:05:14 +02:00
Suresh Srinivas
e3c0539301
12142 Task 4 - Add support for adding entities as part of Data Product (#12867) 2023-08-12 15:45:56 -07:00
Sriharsha Chintalapani
7aaf654f01
Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch (#12782)
* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Fix #12779: Add support for SearchIndexes for ElasticSearch and OpenSearch

* Rebase fixes with main

* Add Sample Data

* lint fix

* remove unused import

* Fix service count test

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-08-10 16:47:37 -07:00
Sriharsha Chintalapani
da0c79cf78
Fix bulk soft-delete or restore from search indexes (#12807)
* Fix bulk soft-delete or restore from search indexes

* Fix bulk soft-delete or restore from search indexes

* Add entityRestored to list events api
2023-08-09 23:24:10 -07:00
Pere Miquel Brull
d8e288626c
Storage connection naming, ADLS service and namespace packaging (#12810)
* Update storage connection naming

* Update storage services and remove typing of generic service

* Remove inits for namespace package

* Add test connection

* Revert "Remove inits for namespace package"

This reverts commit 89f1ae9ea8a633593776f51caf2586d2110d4636.

* Add enum

* Remove init to allow namespace packaging in some modules

* Remove init to allow namespace packaging in some modules

* Move examples and fix test

* Format

* Linting
2023-08-10 07:32:58 +02:00
Suresh Srinivas
8acc1f61ec
12803.part2 - Display names are not updated in entity references (#12829) 2023-08-09 17:17:55 -07:00
Pere Miquel Brull
e97d4befb1
Fix #12770 - Cleanup DL structure & Readers & Python 3.8 (#12776) 2023-08-09 16:07:16 +05:30
Suresh Srinivas
340a029807
Fixes #12802 Add support for generic entity cache (#12803)
* Add entity cache in EntityRepository for all the entities

* Set entity fields only when it is not already set

* Clone entities from the cache

* Remove SubjectCache

* Remove RoleCache

* Remove PolicyCache

* Remove TagLabelCache

* Deleting lingering files

* Test failure fixes

* Remove getEntityReference methods from EntityDAO

* Move quoteName logic to EntityRepository

* Fix test failures
2023-08-08 16:42:54 -07:00
Sachin Chaurasiya
23b127aa23
chore: add type in json schema (#12780) 2023-08-08 10:46:38 +05:30
Pere Miquel Brull
a82c2f001c
Fix #9704 - Add inline TNS string (#12711)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-07 11:04:13 +02:00
Pere Miquel Brull
ac06f55bd0
[Docs] - host.docker.internal docs & postgres ingestAllDatabases below db input (#12744) 2023-08-04 08:35:33 +02:00
karanh37
521711940e
fix: ui fixes 1.1.1 (#12694)
* fix: long text ellipsis wrapping

* fix: node suggestions long text issue

* replace name with fqn for tags

* fix cypress issue

* change the header label ui of explore page

* fixed classificatin issue for .

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-02 18:17:45 +05:30
Ashish Gupta
de06d50e7f
fix(ui): ui breaking as url was not encoded. (#12643)
* fix ui breaking because of url having percent in it

* added support for % in about

* fix test cases

* checkstyle

* url fix

* fix storage url

* encoded topic, mlmodel and pipeline entity

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-01 14:12:47 +05:30
Sriharsha Chintalapani
878fda47a1
Fix tests logging; do not initialize the search client if the search … (#12681)
* Fix tests logging; do not initialize the search client if the search config is not present

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C

* Fix logging and parallelization defaults 1C
2023-07-31 23:35:08 -07:00
Chirag Madlani
098625c549
feat(server): description support for team hierarchy (#12638) 2023-08-01 11:25:42 +05:30
Suresh Srinivas
19e223eabd
Fix exceptions thrown as reflections scan non java classes (#12680) 2023-07-31 17:33:47 -07:00
Josh Liberty
5d53335d83
Update storageService.json (#12529)
Add support to using a custom storage connection
2023-07-31 09:01:37 -07:00
Mayur Singal
5f07c6281a
Clickhouse: Make https protocol as permanent field (#12303) 2023-07-31 19:26:03 +05:30
Mayur Singal
dacd13f6d0
Fix #11778: Add support for hive metastore ingestion (#12599) 2023-07-31 15:56:02 +05:30
Suresh Srinivas
8830d1707d
Initialize EntityResoruceTest support flags automatically (#12513) 2023-07-27 20:42:10 -07:00
Mohit Yadav
f192185151
add aws-cognito to service provider (#12614)
* add aws-incognito to service provider

* Update openMetadataConnection.json

* chore(ui): auth provider changes

* chore: remove type casting

* fix: unit test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-07-27 19:29:50 +05:30
Mayur Singal
c6de61f6bc
Add Lineage Parsing timeout and filtering condition (#12560) 2023-07-27 12:28:53 +05:30
Pere Miquel Brull
6773541d15
[1.1.1] - Bump size for FQN (#12092)
* Bump size for FQN

* Bump table entityName size

* Bump table entityName size

* Fix table resource tests

* Remove pattern from fqn

* Remove pattern from fqn

* Remove pattern from fqn

* Generalize get_by_name in ometa client

* Generalize get_by_name in ometa client

* Format

* Fix test suite

* Remove limit from FQN max size

* Remove limit from FQN max size

* Add sample data

* Update lint names

* Add more sample data

* Bump column name size

* 1024 max FQN length

* 1024 max FQN length

* 1024 max FQN length

* Bump FQN
2023-07-26 12:36:42 -07:00
Sriharsha Chintalapani
67b68a70c9
Fix #7712: Align AuthProvider values in the JSON schema definition (#11508)
* Fix #7712: Align AuthProvider values in the JSON schema definition

* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured

* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured

* Handle new providers

* Lint

* Fix #7712: Align AuthProvider values in the JSON schema definition

* Handle new providers

* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured

* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured

* Lint

* fix rebase

* Fix test

* Fix test

* Fix Usage of Auth Provider in User Resource

* remove unused function

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-07-26 11:34:58 -07:00
Onkar Ravgan
0f8ebf4afe
Fixed Tableau-Bigquery lineage issue (#12570) 2023-07-26 16:07:48 +05:30
Ayush Shah
307dcbf629
Add DateTimeRange support in postgres (#12583) 2023-07-26 14:31:48 +05:30
Ayush Shah
cdb0b2fd63
Add Special Character Support (#12600) 2023-07-26 14:31:07 +05:30
vanshika18
72e4d0070f
Support MSSLQ handle multiple databases with pyodbc connection (#12526) 2023-07-26 10:43:24 +05:30
Ayush Shah
246bf15476
Add Clickhouse profiler fix (#12531) 2023-07-21 10:19:56 +05:30
vanshika18
c1c61c16df
fix #2936: Support Usage connector for Trino (#12483) 2023-07-20 19:51:17 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image (#12490) 2023-07-20 13:34:35 +05:30
Mayur Singal
0c6435ae9b
Fix #2957: Add support for qlik sense enterprise connector (#12450) 2023-07-19 21:08:05 +05:30
Suresh Srinivas
35154615d4
Code cleanup.20230718 (#12493)
* Move setting common patch and updated fields to EntityRepository

* Cleanup entityReferenceList.json and references
2023-07-18 15:10:22 -07:00
07Himank
b6d5a438ec
Support '%' in entity Name (#12382)
* added support for the % in entity name

* added support for the % in glossary and glossary term  name

* Added U exclude

* Fixed pytest

* fix: support % in glossary name

* added suppport for % in entityName

* fix % issue in the glossary or term

* fix: glossary with % encoding

* fix: tags redirect issue for glossaries with %

* fix: glossary import path

* fixed CI

* fixed Py Test

* fixed PyTest

* fixed glossary resource test

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
2023-07-18 17:58:16 +05:30
Sachin Chaurasiya
8734e77acc
fix: json schema ref and id path (#12471) 2023-07-18 07:52:23 +00:00
Mohit Yadav
ac9ccc3c2b
Add missing Expert Enum name (#12454) 2023-07-17 11:49:41 +05:30
Suresh Srinivas
0d119de96e
Fixes #12447 Use JSON schema constrain validation in CSV imports (#12448) 2023-07-15 15:02:17 -07:00
Pere Miquel Brull
3433e2b5dd
Ingestion Pipeline - Bulk deploy API & Status response updated (#12365)
* Redeploy in tables init

* Use Status class

* Update response Status

* Format

* Rename pipelineServiceClientResponse
2023-07-14 07:38:29 +02:00
vanshika18
bbe58b1b5f
Handle Table type for Snowflake Transient Tables (#12274)
* Handle Table type for Snowflake Transient Tables

* Clean the code by removing comments

* Optimize the code

* Optimize the code

* Clean the code

* Rename includeTempTables with includeTransientTables

* Rename includeTempTables to includeTransientTables

* Update Documentation and resolved migartion query error

* Resolved migartion query for postgres connection

---------

Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-07-13 19:25:46 +02:00
Pere Miquel Brull
f0f74dbe59
Fix #12368 - Make sourcePythonClass not required to allow generic use of custom connectors (#12408) 2023-07-13 18:03:14 +02:00
Onkar Ravgan
e200a42926
Removed datamodels references from dashboard and datamodels (#12371) 2023-07-13 14:26:28 +05:30
Mohit Yadav
2c02052e21
Fix Pom versions (#12396) 2023-07-12 15:18:05 +02:00
Pere Miquel Brull
1b7c5e3233
Fix #12321 - Deprecate impala scheme from Hive (#12327)
* Deprecate impala scheme from Hive

* Add migrations
2023-07-11 17:38:32 +02:00