433 Commits

Author SHA1 Message Date
Nahuel
b2f2320145
Fix#10584: Update Lineage API to support lineage from table to dashboard data model (#11489)
* Fix: Update Lineage API to support lineage from table to dashboard data model

* Minor change
2023-05-08 22:02:11 -07:00
Pere Miquel Brull
80af2b20bb
Centralize SSL Schemas & Add SSL for Airflow REST (#11363) 2023-05-08 21:05:10 +02:00
Mohit Yadav
f50bf5ec70
Bootstrap users fix + Ldap Fix error message (#11463)
* Fix issues in Bootstrapping Admin Users

* Fix Ldap Binding Message

* Remove delete

* do not remove the user on own

* failing tests fix

* null should also add auth-mechanism
2023-05-08 23:52:55 +05:30
07Himank
196681b499
fixed elastic search update issue when entity is restored (#11488)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-08 23:52:41 +05:30
Mohit Yadav
98201724c3
Fix for test logging exception for metadata service + updated Insight Template URl (#11485) 2023-05-08 21:25:41 +05:30
Ayush Shah
65fc94a292
Fix Dynamodb connection (#11473)
---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-05-08 15:48:38 +00:00
Mohit Yadav
498873c011
Data insight reporting + extras (#11317)
* Refactor Data Insight Chart for Reusability

* Data Insight Reporting

* Add Schedule Info

* Add Error Handling

* Add Profile Field

* Remove Endpoint as required field

* Missing Language

* Reformat

* Remove Task and Test Result Settings

* Fix test

* fix: typescript errors

* fix: send alertType for subscriptions request

* feat: add alert data insights report page

* Fix test

* fix: alert type typescript error

* fix: loading flicker on alerts page

* chore: add placeholders for data insight report alert page

* fix: alert icon styling

* fix: confirmation is not showing up for delete operation for subscription.

* fix: delete operation is not working from alert details page

* fix Activity Feed Errors on update

* fix: test

* chore: change the description text area to the markdown editor

* Data Insight Reporting should be created on system startup

* Restrict DataInsight Report to only one

* Review Comments

* feat: show the default DataInsightReport data

* sonar fixes

* sonar fixes

* deprecate ConfirmationModal

* trigger should be updated

* feta: add edit flow for data insight report

* remove custom option for schedule info

* chore: update data insight report icon

* test: add unit test for add data insight alert form

* fix: update cypress tests

* update local message

* test: add unit tests

* move sql changes to a different file

* spacing issues

* add tag provider in createRequest

* chore: send provider in create and update alert request.

* fix: code smells

* fix: comment typo

* fix: permission issue for event subscription

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-05-08 16:54:45 +05:30
07Himank
9d61d63ce4
solve the issue for mutually exclusive tags validation for PUT API (#11428)
* solve the issue for mutually exclusive tags validation for PUT API

* checkstyle

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-05-08 15:06:42 +05:30
Nahuel
41ea49d11e
Fix: Secrets Manager not working with Airflow AWS config (#11459)
* Fix: Secrets Manager not working with Airflow config

* Address Python Checkstyle

* Minor change
2023-05-08 07:54:31 +00:00
Suresh Srinivas
6606576575
Fixes #11397 hasAnyRole and inAnyTeam condition policy error (#11471) 2023-05-06 16:55:31 -07:00
Suresh Srinivas
52cd031036
Fixes #11245 - fix test failures (#11465) 2023-05-05 16:52:33 -07:00
Teddy
7db9f3eb24
fix: updated service name in test connection error message (#11461) 2023-05-05 21:43:06 +02:00
Onkar Ravgan
c7902344cb
Added tableau owner test connection step (#11436)
* Added tableau owner test connection

* typo fixed

* remvoed generic exception
2023-05-05 18:29:50 +05:30
Mohit Yadav
1b7fb192d0
[Reindexing] Fixes and Addition for Reindexing (#11447)
* Remove Entries on Reindexing

* Fix Reindexing Count Issues

* Reindexing Cursor Print in case of error

* Add afterCursor to Request

* add comment for function
2023-05-05 14:19:51 +05:30
Suresh Srinivas
ad1ecff79f
Fixes #11404 - build resource operation list programmatically (#11432) 2023-05-04 10:05:36 -07:00
Sriharsha Chintalapani
3e9288be9a
Add Description Ngram for search (#11395)
* Add Description Ngram for search

* Fix glosssary aggregation
2023-05-04 12:46:06 +05:30
07Himank
544d8c722f
fixed issue for column children name (#11392)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-04 12:23:24 +05:30
Suresh Srinivas
82dbf49ad5
Cleanup FeedRepository and ChangeEventHandler (#11372) 2023-05-03 07:43:35 -07:00
07Himank
98d6617c42
added mapping for ldap and saml to openmetadata (#11406)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-03 19:05:50 +05:30
Parth Panchal
6cc448c071
Fixed#11286: mutually exclusive tags addition check is not working for some entities (#11331)
* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-01 20:34:33 -07:00
Suresh Srinivas
fd243dc5cb
FeedDAO cleanup (#11369)
* Cleanup FeedDAO implmentation

* Use FeedFilter to avoid repeated code for forward/reverse pagination
2023-04-30 16:50:29 -07:00
Nahuel
a4af11fba4
Fix: Improve error messages (#11244) 2023-04-27 08:45:25 -07:00
07Himank
9b5ee0ab68
Ingestion pipeline by service type (#11295)
* solved issue for displaying ingestion pipeling by serviceType

* fixed for postgres

* removed unnecessary param

* just cleary declared the examples

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-27 15:20:42 +05:30
mohitdeuex
fbe8513247 Remove Glossary from Reindex 2023-04-27 12:03:11 +05:30
Mohit Yadav
4dd395e90a
Add Email Field + Subscription to Profile to Teams (#11280)
* Add Email Field to Teams

* Add Subscription Config to Profile

* Added Test Cases for Profile and Team Email
2023-04-26 20:26:32 +05:30
mohitdeuex
e5f6f8a277 Fix reindexing issue in broken relationships 2023-04-26 01:39:51 +05:30
07Himank
aa492ffda7
Lineage task new (#11231)
* working on pipeline lineage fix

* solved issue for lineage not visible when added from pipeline to table

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-25 10:00:49 +05:30
Sriharsha Chintalapani
f468bfb3bb
Fix #11247: Tags , are not getting applied to Pipeline Tasks in PATCH request; Tables/Topics/Containers doesn't validate nested fields for mutually exclusive tags (#11248) 2023-04-24 21:25:42 -07:00
Suresh Srinivas
e419457b29
Fixes #11245 Some entities are missing EditOwner and EditTags permissions (#11246) 2023-04-24 20:17:49 -07:00
Mohit Yadav
49d6a0a0e6
Fix for WorkFlow appearing in Activity Feed + Updated Email Configuration doc (#11227)
* Remove WORKFLOW in the activity feed

* Update Email Configuration

* Update Email Configuration

* minor improvement

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-24 18:59:09 +05:30
Pere Miquel Brull
d3d523e96d
Ingestion md docs review (#11219)
* Update workflow docs

* Remove duplicate key

* Update Custom connector docs

* Update Domo connector docs

* Dashboard docs updates

* Some databases docs updates

* Finish db docs updates

* Remove Pulsar

* Messaging docs

* Metadata docs

* ML docs

* S3 docs

* Fix rendering

* Update title and description of the databaseSchema

* Pipeline Service docs

* remove pulsar from tests

* Format

* Fix test

* Remove pulsar

* Remove pulsar
2023-04-23 18:43:46 +02:00
Mayur Singal
99f7a0e447
Remove Validation On Display Datatype (#11208) 2023-04-22 16:23:03 +05:30
Keith Sirmons
97b58c65f5
Impalaconnection (#11151)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala

* added cast to decimal for column when running average in mean.py

* fixed lint error

* fixed ui ordering of precision and scale.
Precision should be ordred in front of scale since the precision is set first in decimal data types

* first pass for impala connector

* updated default auth_mechanism to be one of the enum values.

* updated UI documentation to match fields for the impalaconneciton.

refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added.

Removed reference to hive for type mapping

added impala to the pip setup

* py_format updates

* removed print statement

* Lints and fixes

* Updated database documentation to follow new style

* Flag as BETA

* Remove tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-21 09:57:13 +02:00
Suresh Srinivas
d3db1cb95c
Fixes #11507 - Non-admin user can't join open teams (#11131) 2023-04-19 07:11:04 -07:00
Mohit Yadav
d4d2a266db
Fix Query Pagination Issue (#11127) 2023-04-18 18:23:48 -07:00
karanh37
072dfd199c
fix: show task action buttons for members of team (#10884)
* fix: show task action buttons for members of team

* fix: update redirection path for users and teams

* fix: show task action buttons for members of team

* fix: update redirection path for users and teams

* Fetch user teams during the task permission check

* feat: update tag suggestion and description component

* Update v009__create_db_connection_info.sql

* fix: review comments

* fix: persist default state for update tags

* fix: update css styles for form

* fix: resolve code smells

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-17 09:58:06 -07:00
Hawkins
4e63d6809f
ISSUE-11035: add ZH ElasticSearch index mapping (#11042)
Co-authored-by: wanghj <wanghaojie12345>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-04-17 09:16:09 -07:00
Onkar Ravgan
bc6ce22a2b
Added oneof selection for tableau auth types (#11049)
* Added tableau oneof fields

* Fixed pytests

* fixed field in test

* Handle tableau auth converter

* Fixed java tests and imports

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-14 13:49:36 +05:30
Teddy
77b94f9ebb
fix: rename tests endpoint to dataQuality/<specificity> (#10970) 2023-04-14 00:14:49 -07:00
Mohit Yadav
05ae862f15
Fix for issue leading to vulnerability flags + extras (#11044)
* Rest passwrod link update + Fix the socket connection error issue RFC

* prevent logging of stackTrace

* add default created ingestion pipelines

* provider added

* provider added
2023-04-14 11:31:36 +05:30
Nahuel
26c7c20cfe
Fix: Minor bug introduced in #10914 (#11053) 2023-04-13 21:58:51 +00:00
Ayush Shah
de70c585bc
Fix 9399: issue with validating profile sample input for percentage to be between 0 and 100 (#11028) 2023-04-13 17:01:21 +05:30
Suresh Srinivas
17893f5bd9
Update dependencies for 1.0 release (#11013) 2023-04-12 06:49:56 -07:00
Mohit Yadav
a7760dc2be
Fix some Email Issue (#11025)
* Fix some Email Issue

* Restore default email setting

* Removed Unused config
2023-04-12 19:11:10 +05:30
Pere Miquel Brull
b5cb1d464a
Deprecate location and old storage service (#11004)
* Deprecate location and old storage service

* Format

* Fix test

* Refactor

* Clean location

* Rename object store to storage

* Rename object store to storage

* Rename object store to storage

* Format

* Format

* Refactor object store for storage

* Refactor object store for storage

* Rename object store to storage

* Fix test

* Fix test

* Format

* chore(ui): change Objectstore to  Storage

* Fixes

* Fix test

* Remove storage service from Glue cypress

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-04-12 11:44:46 +02:00
Suresh Srinivas
32e9ae337f
Remove space before : in before update activity feed message (#10992)
* Misc WIP

* Remove space before : in before update activity feed message

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-12 10:32:29 +02:00
Suresh Srinivas
2b2d1e68bf
Fix IDE flagged code issues (#11012) 2023-04-11 20:00:45 -07:00
Deepa Rao
147b7c551e
Fixes #10854 - Create/Update Chart Not working as Expected (#10991) 2023-04-11 06:28:01 -07:00
Sriharsha Chintalapani
a49b2b501a
Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work (#10611)
* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work

* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work
2023-04-11 07:31:43 +02:00
Mohit Yadav
5563935fbf
Avoid ES Bulk Calls for not requests (#10981) 2023-04-10 16:50:14 +05:30