1565 Commits

Author SHA1 Message Date
07Himank
98d6617c42
added mapping for ldap and saml to openmetadata (#11406)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-03 19:05:50 +05:30
Parth Panchal
6cc448c071
Fixed#11286: mutually exclusive tags addition check is not working for some entities (#11331)
* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

* Fixed#11286: mutually exclusive tags addition check is not working for some entities

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-05-01 20:34:33 -07:00
Suresh Srinivas
fd243dc5cb
FeedDAO cleanup (#11369)
* Cleanup FeedDAO implmentation

* Use FeedFilter to avoid repeated code for forward/reverse pagination
2023-04-30 16:50:29 -07:00
Nahuel
a4af11fba4
Fix: Improve error messages (#11244) 2023-04-27 08:45:25 -07:00
07Himank
9b5ee0ab68
Ingestion pipeline by service type (#11295)
* solved issue for displaying ingestion pipeling by serviceType

* fixed for postgres

* removed unnecessary param

* just cleary declared the examples

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-27 15:20:42 +05:30
mohitdeuex
fbe8513247 Remove Glossary from Reindex 2023-04-27 12:03:11 +05:30
Mohit Yadav
4dd395e90a
Add Email Field + Subscription to Profile to Teams (#11280)
* Add Email Field to Teams

* Add Subscription Config to Profile

* Added Test Cases for Profile and Team Email
2023-04-26 20:26:32 +05:30
mohitdeuex
e5f6f8a277 Fix reindexing issue in broken relationships 2023-04-26 01:39:51 +05:30
07Himank
aa492ffda7
Lineage task new (#11231)
* working on pipeline lineage fix

* solved issue for lineage not visible when added from pipeline to table

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-25 10:00:49 +05:30
Sriharsha Chintalapani
f468bfb3bb
Fix #11247: Tags , are not getting applied to Pipeline Tasks in PATCH request; Tables/Topics/Containers doesn't validate nested fields for mutually exclusive tags (#11248) 2023-04-24 21:25:42 -07:00
Suresh Srinivas
e419457b29
Fixes #11245 Some entities are missing EditOwner and EditTags permissions (#11246) 2023-04-24 20:17:49 -07:00
Mohit Yadav
49d6a0a0e6
Fix for WorkFlow appearing in Activity Feed + Updated Email Configuration doc (#11227)
* Remove WORKFLOW in the activity feed

* Update Email Configuration

* Update Email Configuration

* minor improvement

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-24 18:59:09 +05:30
Pere Miquel Brull
d3d523e96d
Ingestion md docs review (#11219)
* Update workflow docs

* Remove duplicate key

* Update Custom connector docs

* Update Domo connector docs

* Dashboard docs updates

* Some databases docs updates

* Finish db docs updates

* Remove Pulsar

* Messaging docs

* Metadata docs

* ML docs

* S3 docs

* Fix rendering

* Update title and description of the databaseSchema

* Pipeline Service docs

* remove pulsar from tests

* Format

* Fix test

* Remove pulsar

* Remove pulsar
2023-04-23 18:43:46 +02:00
Mayur Singal
99f7a0e447
Remove Validation On Display Datatype (#11208) 2023-04-22 16:23:03 +05:30
Keith Sirmons
97b58c65f5
Impalaconnection (#11151)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala

* added cast to decimal for column when running average in mean.py

* fixed lint error

* fixed ui ordering of precision and scale.
Precision should be ordred in front of scale since the precision is set first in decimal data types

* first pass for impala connector

* updated default auth_mechanism to be one of the enum values.

* updated UI documentation to match fields for the impalaconneciton.

refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added.

Removed reference to hive for type mapping

added impala to the pip setup

* py_format updates

* removed print statement

* Lints and fixes

* Updated database documentation to follow new style

* Flag as BETA

* Remove tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-21 09:57:13 +02:00
Suresh Srinivas
d3db1cb95c
Fixes #11507 - Non-admin user can't join open teams (#11131) 2023-04-19 07:11:04 -07:00
Mohit Yadav
d4d2a266db
Fix Query Pagination Issue (#11127) 2023-04-18 18:23:48 -07:00
karanh37
072dfd199c
fix: show task action buttons for members of team (#10884)
* fix: show task action buttons for members of team

* fix: update redirection path for users and teams

* fix: show task action buttons for members of team

* fix: update redirection path for users and teams

* Fetch user teams during the task permission check

* feat: update tag suggestion and description component

* Update v009__create_db_connection_info.sql

* fix: review comments

* fix: persist default state for update tags

* fix: update css styles for form

* fix: resolve code smells

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-17 09:58:06 -07:00
Hawkins
4e63d6809f
ISSUE-11035: add ZH ElasticSearch index mapping (#11042)
Co-authored-by: wanghj <wanghaojie12345>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-04-17 09:16:09 -07:00
Onkar Ravgan
bc6ce22a2b
Added oneof selection for tableau auth types (#11049)
* Added tableau oneof fields

* Fixed pytests

* fixed field in test

* Handle tableau auth converter

* Fixed java tests and imports

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-14 13:49:36 +05:30
Teddy
77b94f9ebb
fix: rename tests endpoint to dataQuality/<specificity> (#10970) 2023-04-14 00:14:49 -07:00
Mohit Yadav
05ae862f15
Fix for issue leading to vulnerability flags + extras (#11044)
* Rest passwrod link update + Fix the socket connection error issue RFC

* prevent logging of stackTrace

* add default created ingestion pipelines

* provider added

* provider added
2023-04-14 11:31:36 +05:30
Nahuel
26c7c20cfe
Fix: Minor bug introduced in #10914 (#11053) 2023-04-13 21:58:51 +00:00
Ayush Shah
de70c585bc
Fix 9399: issue with validating profile sample input for percentage to be between 0 and 100 (#11028) 2023-04-13 17:01:21 +05:30
Suresh Srinivas
17893f5bd9
Update dependencies for 1.0 release (#11013) 2023-04-12 06:49:56 -07:00
Mohit Yadav
a7760dc2be
Fix some Email Issue (#11025)
* Fix some Email Issue

* Restore default email setting

* Removed Unused config
2023-04-12 19:11:10 +05:30
Pere Miquel Brull
b5cb1d464a
Deprecate location and old storage service (#11004)
* Deprecate location and old storage service

* Format

* Fix test

* Refactor

* Clean location

* Rename object store to storage

* Rename object store to storage

* Rename object store to storage

* Format

* Format

* Refactor object store for storage

* Refactor object store for storage

* Rename object store to storage

* Fix test

* Fix test

* Format

* chore(ui): change Objectstore to  Storage

* Fixes

* Fix test

* Remove storage service from Glue cypress

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-04-12 11:44:46 +02:00
Suresh Srinivas
32e9ae337f
Remove space before : in before update activity feed message (#10992)
* Misc WIP

* Remove space before : in before update activity feed message

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-12 10:32:29 +02:00
Suresh Srinivas
2b2d1e68bf
Fix IDE flagged code issues (#11012) 2023-04-11 20:00:45 -07:00
Deepa Rao
147b7c551e
Fixes #10854 - Create/Update Chart Not working as Expected (#10991) 2023-04-11 06:28:01 -07:00
Sriharsha Chintalapani
a49b2b501a
Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work (#10611)
* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work

* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work
2023-04-11 07:31:43 +02:00
Mohit Yadav
5563935fbf
Avoid ES Bulk Calls for not requests (#10981) 2023-04-10 16:50:14 +05:30
Mayur Singal
9f2b10f6e2
Fix #10858: Fix dashbaord & pipeline url (#10957) 2023-04-10 09:48:49 +00:00
Mohit Yadav
ee4f1b4e51
Add Stop Functionality For Reindex (#10971)
* Add stop Reindexing Job

* Languages

* Add Status

* Add Status

* Add messages
2023-04-10 13:15:44 +05:30
Aniket Katkar
d112b40a3f
fix(ui): API endpoints to fetch elastic search data on settings page. (#10946)
* Made changes to use the newly created APIs for fetching elasticSearch re-indexing data

* DOcs Fix and add validation

* Fixed APIs to fetch the batchJob reIndex data
worked on comments

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-04-07 11:53:51 +05:30
Ashish Gupta
c997d8c80b
Feat #10584 : Support Activity tab for DataModel Entity (#10941)
* Supported DataModel in Dashboard Page

* url fqn changes

* Support Activity tab for DataModel Entity

* Remove dataModel resource descriptor

* Fix tasks for dashboard data models

* changes as per comments

* minor fix

* changes as per comments and minor improvements

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-04-06 23:05:40 -07:00
Pere Miquel Brull
ac9979070a
[WIP] - Fixes #10725 - Fix extension in ingestion pipeline and delete statuses api (#10866)
* Fix extension in ingestion pipeline and delete statuses api

* Add tests for ingestion pipeline status

* Format
2023-04-06 19:12:18 +00:00
Pere Miquel Brull
cdd473c3b7
Add ingestionIpInfoEnabled configuration (#10870)
* Add ingestionIpInfoEnabled configuration

* Format

* hide ip address if api response if not 200

* removing dependancy on ip-modal and checking default state

* updated status code for ip to 204 to check default state

* fixed failing cypress

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-04-06 16:27:07 +02:00
Mohit Yadav
ec6ff78b80
fixes for Reindex (#10948)
* fixes for Reindex

* review comments
2023-04-06 10:50:08 +05:30
Pere Miquel Brull
c53c7b680d
Rel #10828 - Update container index and fix airflow ingestion (#10873)
* Update container index and fix airflow ingestion

* Fix lint

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-04-06 07:09:38 +02:00
Deepa Rao
38d4afb6cb
Fixes #10924 - Trim the redundant permissions in the permission list (#10928)
* Fixes #10924 - Trim the redundant permissions in the permission list

* Fixes #10924 - Trim the redundant permissions in the permission list
2023-04-05 19:01:27 -07:00
Sriharsha Chintalapani
eb92ea9069
Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Cont… (#10809)
* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..

* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..
2023-04-05 16:50:12 +02:00
Mohit Yadav
07b821844a
Restructured Reindexing + Added Automated Reindexing on Glossary import (#10882)
* Restructured Reindexing + Added Automated Reindexing on Glossary import

* Revert Openmetadata yaml

* Fix pending issues

* Fix stats

* Refactor to workflows and SearchIndex

* Fix Failing tests

* Get status for stream and push status with

* fix UI build failing

* replace all with entity list before hit api

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-05 18:47:51 +05:30
Sriharsha Chintalapani
b1c2040cb2
Fix #10904, Glossary Search: no Matches info for Synonyms (#10909) 2023-04-05 05:57:20 -07:00
Mayur Singal
9ed1fc4e17
Test Connection Improvements: Short Circuit Test Connection & Improve Error Messages (#10913) 2023-04-05 13:23:57 +05:30
07Himank
b97d6d9014
solved url isse when space is involed in fqn (#10929)
Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-04-05 13:14:41 +05:30
Chirag Madlani
5a9173df0f
fix(ui): entity selection for es re-indexing (#10783)
* fix(ui): entity selection for es re-indexing

* Add query and container for reindexing

* add tree view for entity selection

* fix tree view for entities

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-04-05 10:49:57 +05:30
Mohit Yadav
a095d23fb5
Handle Email From UI (#10906)
* Handle Email From UI

* Resolved Conflicts

* Fix Failing Tests

* Fix Failing Tests

* Fix Failing checkstyle failing

* Return Masked Password + handle null in case of Saml Missing Config
2023-04-05 10:31:51 +05:30
Mayur Singal
5bd476da23
Test Connection Improvements: Use patch instead of put (#10897)
* Test Connection Improvements: Use patch instead of put

* Update openmetadata-service/src/main/java/org/openmetadata/service/jdbi3/WorkflowRepository.java

Co-authored-by: Nahuel <nahuel@getcollate.io>

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-04-04 14:15:51 +00:00
Suresh Srinivas
6cf357ed2a
Fixes #10907 Parent glossary term should not be allowed moved under its child term (#10908) 2023-04-04 06:51:19 -07:00