7010 Commits

Author SHA1 Message Date
Ashish Gupta
f54efc649b
Fixes #10543 : Fix searchbar persistence issue after user get deleted by search. (#10753)
* Fix the searchbar on user page after delete action

* minor changes
2023-03-26 20:06:03 +05:30
Cristian Calugaru
3ffde9a293
Fixes #9064 - Ingestion for S3 bucket containers (#10515)
* Prep skeleton for object store connector

* First of of ingestion piepline for bucket containers.

* addressed PR review comments.

* swaped random with secrets due to security warning.

* linter issues.

* added prefix population for containers.

* more linting

* removed temp file.

* object store unit tests, PR comments and minor refactorings

* docs update and new TestConnection approach.

* linting

* removed isStructured field from containermeta schema

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-26 11:35:34 +02:00
Sachin Chaurasiya
0f3e929b75
doc: update doc for how to add new language support (#10734)
* doc: update doc for how to add new language support

* chore: minor fix

* address comments
2023-03-25 13:08:17 +05:30
Shailesh Parmar
5bbac9185c
fixed issue test result graph not displaying full axis values #10704 (#10715)
* fixed issue test result graph not displaying full axis values #10704

* added additional test case for digitFormatter function
2023-03-25 10:43:39 +05:30
Suresh Srinivas
ea8e1fda46
Fixes #10759 A Non-Privileged user can add new 'Roles' to Teams (#10760) 2023-03-24 19:23:22 -07:00
Chirag Madlani
c4c510443b
fix(test): redshiftWithDBT cypress failure for lineage (#10754)
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-25 00:30:17 +05:30
Nahuel
ef759c7e88
Fixes#8038: Change how status is handled after running workflow (#10710)
* Change how status is handled after running workflow

* Reset changes in config files

* Add auxiliary Summary class

* Improve failures handling

* Pylint error

* Pylint error

* Show result in table

* Add test

* Fix setup.py

* Add comments
2023-03-24 17:59:06 +01:00
Shailesh Parmar
0b50380b97
ui: unit test for query as entity ui changes (#10699)
* added edit support for description, tags and owner for queries

* updated style of left panel and center panel of query tab

* translation sync

* full entity ref

* added ui changes for query used in other table

* translation-sync

* move const value to constant file

* implemented permission API for edit actions

* implemented pagination

* sync-language

* translation sync

* implemented vote up and vote down functionality for query

* refactor code

* added filter dropdown for query entity

* translation-sync

* fixed unit test and refactor query files

* localization-sync

* fixed failing unit test and cursor blink issue in readOnly mode for editor

* refactor

* addressing comments

* updated edit condition

* updated description heading

* added unit test for QueryCardExtraOption component

* added unit test for tableQueryRightPanel

* updated floating query used by other table element

* translation sync

* updated default paging value

* updated unit test with new changes

* added unit test for QueryUsedByOtherTable component

* updated query card test

* updated expand collapse icon for query

* added border top for card footer

* addressing comment

* import fix

* fixed cypress for postgress

* removing py changes,

* updated unit test as per new change

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-03-24 09:32:51 -07:00
Mohit Yadav
11032a2d48
SAML feature (#10669)
* Added Saml Feature

* add localization

* fix tests

* added collate copyright

* remove thread.getType

* fixed keystore issues and updated review comments

* remove private key getter

* update test saml config

* update test saml config

* Update openmetadata-service/src/main/java/org/openmetadata/service/security/saml/OMMicrometerHttpFilter.java

Co-authored-by: Nahuel <nahuel@getcollate.io>

* review comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-24 21:56:49 +05:30
Jan-Pieter van den Heuvel
c46732a4ff
Fix year of latest release in releases documentation page (#10664) 2023-03-24 17:08:21 +01:00
Sachin Chaurasiya
c6746507d9
fix#10662: Update tier functionality is not working as expected on the containers page (#10720)
* fix#10662: Update tier functionality is not working as expected on the containers page

* chore: remove unwanted change

* test: add unit test

* chore: add container entity icon

* chore: fix spacing issue

* chore: add support for lineage info drawer

* fix: locale missing key issue

* refactor: entity info drawer
2023-03-24 18:13:44 +05:30
Mohit Yadav
fb02cbfeed
fix failing Py test due to backend change (#10749) 2023-03-24 17:41:52 +05:30
Aniket Katkar
218e07808a
ui: explore page filters refactoring (#10524)
* changed behavior of quick dropdown filters to be same as left panel filters
- AND condition across different fields
- OR condition inside the same field filters
Applying left panel filters will now sent data as `post_filter` to prevent aggregations updating

* Added a separate API call without any filters to get all the left panel filter options

* separated url parameter variables to store 'facet' 'quick' and 'advanced search' filters
updated the logic to change facet filters according to selection.

* Fixed following bugs
- facet filters updating if filters are applied from quick dropdown or advanced search
- count for the filters were not updating with filter selection
- optimized API calls on explore page

* updated facet filters behavior where only counts will updated on filter selection instead of actual filters list

* Removed unnecessary code
Removed code smells

* worked on comments to improve the code

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-24 14:15:50 +05:30
Pere Miquel Brull
4913aeb53b
Docs - Add Airflow version support (#10707) 2023-03-24 06:31:38 +01:00
karanh37
f7dc89f727
feat: add glossary and tags to global search (#10677)
* feat: add global search for glossary and tags

* fix: missing localization keys

* fix: select issues

* feat: add glossary and tags in explore page

* fix: review comments

* fix: add missing icons

* feat: added glossary term summary panel

* feat: add tags panel

* fix: update glossary icon

* fix: separate out interfaces for summary entities

* fix: remove fragment

* fix: jest tests
2023-03-24 11:01:06 +05:30
Ashish Gupta
9e2b2d1926
Fix the breaking remove owner from Services (#10717) 2023-03-24 10:54:51 +05:30
Ashish Gupta
99cac0ea82
Fix the icon on lineage summary panel (#10733) 2023-03-24 10:54:28 +05:30
Shailesh Parmar
13e846d894
Feat: Query tab improvement (#10635)
* added edit support for description, tags and owner for queries

* updated style of left panel and center panel of query tab

* translation sync

* full entity ref

* added ui changes for query used in other table

* translation-sync

* move const value to constant file

* implemented permission API for edit actions

* implemented pagination

* sync-language

* translation sync

* implemented vote up and vote down functionality for query

* refactor code

* added filter dropdown for query entity

* translation-sync

* fixed unit test and refactor query files

* localization-sync

* fixed failing unit test and cursor blink issue in readOnly mode for editor

* refactor

* addressing comments

* updated edit condition

* updated description heading

* updated floating query used by other table element

* translation sync

* updated default paging value

* updated expand collapse icon for query

* added border top for card footer

* addressing comment

* import fix

* fixed cypress for postgress

* removing py changes,

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-03-24 10:29:50 +05:30
Shailesh Parmar
c188a63b51
fix: issue App Analytics summary not adjusting to the datetime [UI] #10571 (#10728) 2023-03-24 10:29:21 +05:30
Sriharsha Chintalapani
d911e0caba
Add query index (#10682)
* Add query index

* add QueryUsage ChangeEvent

* fix test

* Add query index

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-03-23 21:26:27 -07:00
Sachin Chaurasiya
cc27a6ce0d
chore(ui): Bring back the count for services, teams, and users, and remove the count for glossaries on the landing page. (#10719) 2023-03-24 09:23:34 +05:30
Suresh Srinivas
b80fc39632
Fixes #10740 Inherited ownership must not overwrite manually entered ownership (#10741) 2023-03-23 17:15:55 -07:00
NiharDoshi99
bfa0905093
update druid docs (#10735) 2023-03-23 22:16:14 +05:30
Milan Bariya
48cc249b11
Fix glue ingestion issue (#10732) 2023-03-23 20:53:43 +05:30
Ashish Gupta
c24710a811
UI : Fix the overflow issue of tags (#10673)
* Fix the overflow issue of tags

* Changes as per comments
2023-03-23 15:45:23 +05:30
Onkar Ravgan
c9feba826f
Kinesis bug fixed (#10578)
* Kinesis bug fixed

* Added sample data fix

* Fixed typo

* Added constansts

* Added try catch for sample data

* Added fixes on review comments

* Modified models

* Added sample data py models

* Fix pylint

* fixed code smell

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-23 13:38:56 +05:30
Mohit Yadav
acb0e71a3e
Fix Email sent everytime a admin owns an Entity during startup (#10697)
* Fix Email sent everytime a admin owns an Entity during startup

* fix
2023-03-23 11:58:54 +05:30
Teddy
3d8e7e6d41
Fixes #10290 - NUMERIC type assigned the wrong dtype in converter.py (#10708)
* fix: profiler refactor

* fix: catch division by zero error

* fix: instantiated new column object from name to delegate type handler back to dbapi

* fix: reverted columns instantiation and updated NUMBER type to NUMERIC

* fix: updated doc string for process_pii_sensitive method
2023-03-23 07:22:19 +01:00
Mayur Singal
bbce9c5aa4
Fix #10489: Handle unknown data types & store raw data type (#10563) 2023-03-23 11:41:29 +05:30
Teddy
b2e1eed842
doc: added best practice section to profiler (#10712)
* doc: added best practice section to profiler

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update openmetadata-docs/content/connectors/ingestion/workflows/profiler/index.md

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-22 19:36:42 +01:00
Pere Miquel Brull
51f4e0b170
UI - Add ES log retrieval (#10667) 2023-03-22 17:52:58 +01:00
Pere Miquel Brull
ba7690f14e
Update PR template (#10700)
* Update PR template

* Update PR template
2023-03-22 16:50:13 +01:00
Ashish Gupta
f15a752706
UI : Added show deleted table in Database schema level (#10672)
* Added show deleted table in Database scheam level

* Changes as per comments

* fix cypress issue

* make switch label static

* other language

* fix cypress issue
2023-03-22 16:16:08 +05:30
Pere Miquel Brull
ebbd611825
Update counts after #10265 (#10693) 2023-03-22 06:32:18 +01:00
Pere Miquel Brull
e2a2bcc8da
Fix search by email index keyword (#10698)
* Fix search by email index keyword

* Fix search by email index keyword
2023-03-21 20:50:47 -07:00
Mayur Singal
9f99296ea0
Bigquery Docs Fix (#10692)
* Bigquery Docs Fix

* typo fix

* keycloak sso

* GCP Create Custom Role
2023-03-21 16:55:57 +01:00
Suresh Srinivas
b8e0ae489a
Fixes #10679 - Add policy functions inAnyTeam and hasAnyRole (#10680) 2023-03-21 07:24:41 -07:00
Sachin Chaurasiya
55fde2d775
chore(ui): add glossary and glossary terms count on landing page (#10640)
* chore(ui): add glossary and glossary terms count on landing page

* sync local files

* chore: update icon for glossary term

* fix: cy test

* sync locales

* address comment

* fix: cy test

* fix: cy test

* fix: cy test
2023-03-21 19:33:44 +05:30
Sachin Chaurasiya
f77ccb6364
chore(ui): add support for service documentation md file (#10666)
* chore(ui): add support for service documentation md file

* sync local

* chore: add method for fetching markdown file

* chore: move fields to connections
2023-03-21 18:43:41 +05:30
Pere Miquel Brull
4dbe5e4f5c
Simplify Data Insight workflow builder (#10688) 2023-03-21 14:12:20 +01:00
Nahuel
dd225d1463
Fix: Clean Source and SourceStatus inheritance (#10687)
* Fix: clean source and sourcestatus inheritance

* Remove auth parameters from mysql.yaml

* Fix failing test

* Fix pylint checks

* Add missing docstrings
2023-03-21 12:57:48 +01:00
Teddy
64205cf231
feat: Added custom event event type for web analytics (#10554)
* feat: Added custom event event type for web analytics

* feat: renamed  to

* Update openmetadata-spec/src/main/resources/json/schema/analytics/webAnalyticEventType/customEvent.json

Co-authored-by: Nahuel <nahuel@getcollate.io>

* Update openmetadata-spec/src/main/resources/json/schema/analytics/webAnalyticEventType/customEvent.json

Co-authored-by: Nahuel <nahuel@getcollate.io>

* feat: move common type to basic.json

* feat: ran linting

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-21 10:12:15 +01:00
Ayush Shah
133bdfbf64
Add Okta Doc fix, Athena lineage fix, quicksight permissions (#10683) 2023-03-21 12:44:58 +05:30
Mohit Yadav
06498bc011
Update alerts api (#10265)
* Refactored Alerts Api

* missing semicolon

* fixed Test Cases

* missing files

* Randomly run webhook in tests

* - update EventResource to ChangeEventResource

* - remove trigger config

* - missing ResourceDescriptors.json entity entry

* remove alertAction

* fix typos

* fix typos

* updated ui as per new alert API

* updated delete functionality and cypress

* fixed failing cypress test

* review comments

* Revert "- update EventResource to ChangeEventResource"

This reverts commit 90290cebd6c9572c021af3bde75eaf63c289b749.

* ChangeEventList -> EventList

* Change SQL Query

* add Subscription Status Builder

* fix java style

* update name back to EventSubscription

* Fixed Tests

* Fix import

* missing .

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-21 10:12:49 +05:30
Pere Miquel Brull
cdb14f30ff
Create stage location in the workflow, not the apis (#10676)
* Create stage location in the workflow, not the apis

* Format
2023-03-20 18:14:27 +01:00
Mohit Yadav
d5afb864ab
Fix Import errors (#10674) 2023-03-20 20:10:16 +05:30
Pere Miquel Brull
40b4c9c487
Fix ES reindex (#10663) 2023-03-20 13:00:51 +01:00
Suresh Srinivas
6d717c6c33
Fixes #10656 Fix permissions API bug (#10657)
* Fixes #10656 Fix permissions API bug

* Remove parseTags method and add getAllTags to ContainerRepository

* Implement getAllTags for Topic
2023-03-20 04:42:03 -07:00
Mohit Yadav
55d5b4ed7c
Added Vote for Queries (#10655)
* added Vote for entities

* fix failing test

* fixed failing unit test

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-20 13:58:20 +05:30
Schlameel
df855ad8c3
Issue #3809: Add python client for Roles and Policies (#10531)
* Issue #3809: Add python client for Roles and Policies
Includes Tests

* #3809: Add python client for Roles and Policies
- Moved constants to enums in client_utils.py
- Updated all patch methods to utilized new enums
- includes tests

* #3809: Add python client for Roles and Policies
- includes tests
- merged upstream updates and updated to use new enums
2023-03-20 08:42:01 +01:00