2200 Commits

Author SHA1 Message Date
07Himank
fb4e7c3c74
Fix Docker Image Java Vulnerabilities (#11623)
* fixed vulnerablity issue

* jackson-dataformat

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-05-17 16:38:05 -07:00
mohitdeuex
6b250a8f78 Fix Descriptor File in Pom 2023-05-17 20:36:21 +05:30
Sriharsha Chintalapani
923360c47a
Fix #11543: Elasticsearch Re-index with language other than EN will m… (#11628)
* Fix #11543: Elasticsearch Re-index with language other than EN will make error appears

* Fix tag mappings
2023-05-17 11:18:07 +02:00
Sachin Chaurasiya
4df64ef6fe
feat(#11596): add support for custom logo config in settings (#11597)
* feat(#11596): add support for custom logo config in settings

* fix: edit custom logo config

* chore: update application config provider

* fix: unit test

* fate: create separate brand logo component

* Add Accessible Logo Config From ConfigResource

* update custom logo api

* minor change

* fix: styling and use brand logo component

* fix(#11503) Custom Login Logo does not change after adding new custom logo

* restored delete files

* doc: update custom logo config doc

* update the icon

* test: add unit test for brand logo

* test: add unit test for custom logo config setting page

* test: add unit test for custom logo config form

* test: fix cy test

* fix: url input validation

* test: add cypress test

* test: update cy test to check for validation

* update the doc

* test: fix cypress test

* chore: make height and width required in BrandLogo component

* chore: update component name

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-05-17 11:26:34 +05:30
Mohit Yadav
c40c5dc478
Fix Descriptor File (#11629) 2023-05-17 11:07:43 +05:30
Akash Jain
92d5bfa94e
fix: versions in main branch (#11478)
* fix: versions in main branch

* Prepare main branch for next release 1.1.0

* prepare main for latest release 1.0.1
2023-05-15 10:42:29 +05:30
Suresh Srinivas
e72125c3a1
11579 task - Change schema regex to allow parenthesis in the entity name (#11580) 2023-05-14 06:58:38 -07:00
Mohit Yadav
d12d32bf65
Add settings to Db for Custom Logo (#11583)
* Add settings to Db for Custom Logo

* Add test for Settings
2023-05-12 23:34:02 +05:30
Pere Miquel Brull
4c77eaea72
Filter tables by databaseSchema (#11574) 2023-05-12 10:25:08 -07:00
Mohit Yadav
93e97674c5
Data Insight Report Improvement (#11547)
* Fix Mail to be sent to Team Users in case the email is missing

* Unwanted Comment
2023-05-11 13:55:57 +05:30
Suresh Srinivas
14b622efd0
11287 Task - Add retention period and customer properties to Database, Schema, and Tables (#11511) 2023-05-10 16:08:21 -07:00
mohitdeuex
944a07cbd5 Trigger Api Only admin can invoke 2023-05-10 23:57:21 +05:30
Mohit Yadav
5bbd49cc60
[InsightReport] DataInsight Manual trigger Job (#11538)
* Add Manual Trigger for Insight Reports

* unrequ change

* add time diff comment
2023-05-10 23:49:50 +05:30
Mohit Yadav
647ff49dcb
Sonar Fixes P1 (#11507)
* sonar lint fixes

* PARENT_FIELD

* review comments

* Fix failing glossaryTest
2023-05-10 20:30:17 +05:30
Mohit Yadav
0aa6c08cf6
Servlets Log Error Messages (#11514)
* remove stack trace logging

* Fixed Error Messages

* Feed Servelt logging
2023-05-10 10:56:28 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460)
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
2023-05-09 12:05:35 +02:00
Louie
5bce6447f6
Fixed typo SMPTS to SMTPS (#11487)
* Fixed typo SMPTS to SMTPS

* sonar lint fixes

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-05-09 11:22:20 +05:30
Nahuel
b2f2320145
Fix#10584: Update Lineage API to support lineage from table to dashboard data model (#11489)
* Fix: Update Lineage API to support lineage from table to dashboard data model

* Minor change
2023-05-08 22:02:11 -07:00
Pere Miquel Brull
80af2b20bb
Centralize SSL Schemas & Add SSL for Airflow REST (#11363) 2023-05-08 21:05:10 +02:00
Mohit Yadav
f50bf5ec70
Bootstrap users fix + Ldap Fix error message (#11463)
* Fix issues in Bootstrapping Admin Users

* Fix Ldap Binding Message

* Remove delete

* do not remove the user on own

* failing tests fix

* null should also add auth-mechanism
2023-05-08 23:52:55 +05:30
07Himank
196681b499
fixed elastic search update issue when entity is restored (#11488)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-08 23:52:41 +05:30
Mohit Yadav
98201724c3
Fix for test logging exception for metadata service + updated Insight Template URl (#11485) 2023-05-08 21:25:41 +05:30
Ayush Shah
65fc94a292
Fix Dynamodb connection (#11473)
---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-05-08 15:48:38 +00:00
Mohit Yadav
498873c011
Data insight reporting + extras (#11317)
* Refactor Data Insight Chart for Reusability

* Data Insight Reporting

* Add Schedule Info

* Add Error Handling

* Add Profile Field

* Remove Endpoint as required field

* Missing Language

* Reformat

* Remove Task and Test Result Settings

* Fix test

* fix: typescript errors

* fix: send alertType for subscriptions request

* feat: add alert data insights report page

* Fix test

* fix: alert type typescript error

* fix: loading flicker on alerts page

* chore: add placeholders for data insight report alert page

* fix: alert icon styling

* fix: confirmation is not showing up for delete operation for subscription.

* fix: delete operation is not working from alert details page

* fix Activity Feed Errors on update

* fix: test

* chore: change the description text area to the markdown editor

* Data Insight Reporting should be created on system startup

* Restrict DataInsight Report to only one

* Review Comments

* feat: show the default DataInsightReport data

* sonar fixes

* sonar fixes

* deprecate ConfirmationModal

* trigger should be updated

* feta: add edit flow for data insight report

* remove custom option for schedule info

* chore: update data insight report icon

* test: add unit test for add data insight alert form

* fix: update cypress tests

* update local message

* test: add unit tests

* move sql changes to a different file

* spacing issues

* add tag provider in createRequest

* chore: send provider in create and update alert request.

* fix: code smells

* fix: comment typo

* fix: permission issue for event subscription

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-05-08 16:54:45 +05:30
07Himank
9d61d63ce4
solve the issue for mutually exclusive tags validation for PUT API (#11428)
* solve the issue for mutually exclusive tags validation for PUT API

* checkstyle

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-05-08 15:06:42 +05:30
Nahuel
41ea49d11e
Fix: Secrets Manager not working with Airflow AWS config (#11459)
* Fix: Secrets Manager not working with Airflow config

* Address Python Checkstyle

* Minor change
2023-05-08 07:54:31 +00:00
Suresh Srinivas
6606576575
Fixes #11397 hasAnyRole and inAnyTeam condition policy error (#11471) 2023-05-06 16:55:31 -07:00
Suresh Srinivas
52cd031036
Fixes #11245 - fix test failures (#11465) 2023-05-05 16:52:33 -07:00
Teddy
7db9f3eb24
fix: updated service name in test connection error message (#11461) 2023-05-05 21:43:06 +02:00
Onkar Ravgan
c7902344cb
Added tableau owner test connection step (#11436)
* Added tableau owner test connection

* typo fixed

* remvoed generic exception
2023-05-05 18:29:50 +05:30
Mohit Yadav
1b7fb192d0
[Reindexing] Fixes and Addition for Reindexing (#11447)
* Remove Entries on Reindexing

* Fix Reindexing Count Issues

* Reindexing Cursor Print in case of error

* Add afterCursor to Request

* add comment for function
2023-05-05 14:19:51 +05:30
Suresh Srinivas
ad1ecff79f
Fixes #11404 - build resource operation list programmatically (#11432) 2023-05-04 10:05:36 -07:00
Sriharsha Chintalapani
3e9288be9a
Add Description Ngram for search (#11395)
* Add Description Ngram for search

* Fix glosssary aggregation
2023-05-04 12:46:06 +05:30
07Himank
544d8c722f
fixed issue for column children name (#11392)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-04 12:23:24 +05:30
Suresh Srinivas
82dbf49ad5
Cleanup FeedRepository and ChangeEventHandler (#11372) 2023-05-03 07:43:35 -07:00
07Himank
98d6617c42
added mapping for ldap and saml to openmetadata (#11406)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-03 19:05:50 +05:30
Parth Panchal
6cc448c071
Fixed#11286: mutually exclusive tags addition check is not working for some entities (#11331)
* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-01 20:34:33 -07:00
Suresh Srinivas
fd243dc5cb
FeedDAO cleanup (#11369)
* Cleanup FeedDAO implmentation

* Use FeedFilter to avoid repeated code for forward/reverse pagination
2023-04-30 16:50:29 -07:00
Nahuel
a4af11fba4
Fix: Improve error messages (#11244) 2023-04-27 08:45:25 -07:00
07Himank
9b5ee0ab68
Ingestion pipeline by service type (#11295)
* solved issue for displaying ingestion pipeling by serviceType

* fixed for postgres

* removed unnecessary param

* just cleary declared the examples

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-27 15:20:42 +05:30
mohitdeuex
fbe8513247 Remove Glossary from Reindex 2023-04-27 12:03:11 +05:30
Mohit Yadav
4dd395e90a
Add Email Field + Subscription to Profile to Teams (#11280)
* Add Email Field to Teams

* Add Subscription Config to Profile

* Added Test Cases for Profile and Team Email
2023-04-26 20:26:32 +05:30
mohitdeuex
e5f6f8a277 Fix reindexing issue in broken relationships 2023-04-26 01:39:51 +05:30
07Himank
aa492ffda7
Lineage task new (#11231)
* working on pipeline lineage fix

* solved issue for lineage not visible when added from pipeline to table

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-25 10:00:49 +05:30
Sriharsha Chintalapani
f468bfb3bb
Fix #11247: Tags , are not getting applied to Pipeline Tasks in PATCH request; Tables/Topics/Containers doesn't validate nested fields for mutually exclusive tags (#11248) 2023-04-24 21:25:42 -07:00
Suresh Srinivas
e419457b29
Fixes #11245 Some entities are missing EditOwner and EditTags permissions (#11246) 2023-04-24 20:17:49 -07:00
Mohit Yadav
49d6a0a0e6
Fix for WorkFlow appearing in Activity Feed + Updated Email Configuration doc (#11227)
* Remove WORKFLOW in the activity feed

* Update Email Configuration

* Update Email Configuration

* minor improvement

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-24 18:59:09 +05:30
Pere Miquel Brull
d3d523e96d
Ingestion md docs review (#11219)
* Update workflow docs

* Remove duplicate key

* Update Custom connector docs

* Update Domo connector docs

* Dashboard docs updates

* Some databases docs updates

* Finish db docs updates

* Remove Pulsar

* Messaging docs

* Metadata docs

* ML docs

* S3 docs

* Fix rendering

* Update title and description of the databaseSchema

* Pipeline Service docs

* remove pulsar from tests

* Format

* Fix test

* Remove pulsar

* Remove pulsar
2023-04-23 18:43:46 +02:00
Mayur Singal
99f7a0e447
Remove Validation On Display Datatype (#11208) 2023-04-22 16:23:03 +05:30
Keith Sirmons
97b58c65f5
Impalaconnection (#11151)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala

* added cast to decimal for column when running average in mean.py

* fixed lint error

* fixed ui ordering of precision and scale.
Precision should be ordred in front of scale since the precision is set first in decimal data types

* first pass for impala connector

* updated default auth_mechanism to be one of the enum values.

* updated UI documentation to match fields for the impalaconneciton.

refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added.

Removed reference to hive for type mapping

added impala to the pip setup

* py_format updates

* removed print statement

* Lints and fixes

* Updated database documentation to follow new style

* Flag as BETA

* Remove tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-21 09:57:13 +02:00