7194 Commits

Author SHA1 Message Date
karanh37
63edc5d5ca
feat(ui): Glossary name modal (#10802)
* feat: initial commit glossary redesign

* chore: add localization

* fix: update glossary ui

* fix: missing localization

* feat: update glossary ui

* fix: jest tests

* fix: jest tests

* fix: update breadcrumbs

* fix: update cypress tests

* chore: remove logs

* fix: update glossary right panel

* fix: jest tests

* fix: add reviewer functionality

* feat: add entity name and entity display name rename modal

* fix: add missing localization

* fix: update cypress tests

* fix: jest tests

* fix: redesign reviewer panel

* fix: remove breadcrumb sizing
2023-03-29 15:32:20 +05:30
Sachin Chaurasiya
0a92a897a1
chore(ui): add support for service documentation (part-1) (#10668)
* chore(ui): add support for service documentation md file

* sync local

* chore: add method for fetching markdown file

* chore(ui): add support for service documentation

* chore: move fields to connections

* chore: update logic to fetch requirements

* chore: right panel component for service

* fix: key prop is not present in the skeleton component

* chore: only fetch md files when required fields are present

* chore: use hook for fetching airflow status

* chore: refactor add service component

* chore: remove id prefix and id separator prop from form builder

* fix: fieldName issue on right panel

* fix: active Field name issue

* fix:unit test

* test: add unit test

* chore: handle edit service form

* chore: add fallback logic

* fix: cy test

* chore: update service doc md files/folder structure,

* chore: push image example

* Athena docs

* Add glue docs

* Add hive related changes

* chore: take last field for fetching field doc

* add datalake

* Added connection information for oracle and redshift (english + french)

* fix: fallback logic

* Bigquery & Snowflake Requirements

* mysql and amundsen requirements (#10752)

* Revert removal of descriptions

* Add Doc For Mssql and Postgres

* Added powerbi conn md files

* Align requirements files

* Add Kafka and Redpanda

* refined powerbi docs

* Add Tableu requirements, move Athena and Glue fields, change footer some connectors

* Add missing connectors fields descriptions default

* re: datalake

* Add Tableau field descriptions

* fix: markdown styling

* chore: improve button styling

* chore: rename right panel to service right panel and move it to common

* fix: doc for select and list field , cy test.

* fix: unit test

* fix: test connection service type issue

* Added powerbi docs link in req

* Add info on hive

* Remove unused markdowns

* Add req for datalake

* add hive requirements header

* Snowflake & Biguqery

* Update Mssql and Postgres

* mysql and amundsen requirements updated

* Update Mssql and Postgres

* added username

* chore: fix cy expression issue

* chore: reset active field state on step change.

* fix: affix target container issue

* fix: unit test

* fix: cypress for postgres and glue

---------

Co-authored-by: Milan Bariya <52292922+MilanBariya@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: NiharDoshi99 <51595473+NiharDoshi99@users.noreply.github.com>
Co-authored-by: Milan Bariya <milanbariya12@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
2023-03-29 14:18:17 +05:30
Ayush Shah
28cc956c90
Fix bigquery profiler ingestion for all regions (#10815) 2023-03-29 13:28:17 +05:30
Onkar Ravgan
4fa98b2703
Updated count for mysql e2e filters (#10816) 2023-03-29 13:09:26 +05:30
Onkar Ravgan
5d6e18dc28
Fix 10642: Mark delete entities and tags toggle (#10695)
* Added mark delete logic

* Final test and optimization

* After merge fixes

* Added include tags for dash pipelines dbt

* added docs and fixed test

* Fixed py tests

* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags

* Fixed failing unit tests

* updated json files of localization for other languages

* Improved localization changes

* added localization changes for other languages

* Updated mark deleted desc

* updated the ingestion fields descriptions in the ingestion form for UI

* automated localization changes for other languages

* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json

* fixed issue where includeTags field was being sent in the dbtConfigSource

* Added flow to input taxonomy while adding BigQuery service.

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-03-29 12:41:44 +05:30
Chirag Madlani
53ec29bc82
feat(ui): support assets selection from glossary page (#10803)
* feat: initial commit glossary redesign

* chore: add localization

* fix: update glossary ui

* fix: missing localization

* feat: update glossary ui

* fix: jest tests

* fix: jest tests

* fix: update breadcrumbs

* fix: update cypress tests

* chore: remove logs

* fix: update glossary right panel

* fix: jest tests

* fix: add reviewer functionality

* feat(ui): support assets selection from glossary page

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
2023-03-29 05:59:11 +00:00
karanh37
a75bc74433
fix: glossary cypress (#10813) 2023-03-29 10:54:08 +05:30
karanh37
5447bd6059
UI: Glossary design change (#10716)
* feat: initial commit glossary redesign

* chore: add localization

* fix: update glossary ui

* fix: missing localization

* feat: update glossary ui

* fix: jest tests

* fix: jest tests

* fix: update breadcrumbs

* fix: update cypress tests

* chore: remove logs

* fix: update glossary right panel

* fix: jest tests

* fix: add reviewer functionality
2023-03-29 09:52:41 +05:30
Suresh Srinivas
263da23220
Fixes #10791 Add tests for various Resource & Policy scenarios (#10792) 2023-03-28 18:30:53 -07:00
Pere Miquel Brull
4dad80e2fe
S3 Improvements for test connection and connector status (#10795)
* Handle test connection for S3 and new status

* Remove exception

* Update endpoint

* Update endpoint

* Update endpoint

* chore: remove toast messages for test connection

* chore: change objectstoreService to objectStoreService

* minor fix

* Use the default service param for listing filters

* Format

* Format

* address comments

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-03-28 17:52:47 +02:00
Mayur Singal
cc35749454
Minor Fixes for test connection (#10800) 2023-03-28 15:25:33 +00:00
Nahuel
bea38d7200
Fix#10584: Add Data Model as an entity (#10636)
* Add Data Model as entity

* Add sample_data + update dashboard resource and repository with data models

* Fix Java style

* Addess PR comments

* Update bootstrap/sql/com.mysql.cj.jdbc.Driver/v009__create_db_connection_info.sql

* Pylint error

* Address PR comments

* Address PR comments

* Address PR comments

* Minor change

* Fix error in sample_data

* Fix failing test

* Add missing resource and event sub descriptors
2023-03-28 15:07:38 +00:00
VolkovGeoPhy
86febae17c
GX up to 0.16 (#10746) 2023-03-28 16:09:46 +02:00
karanh37
8e8e8a3dc9
fix: lineage ui issues (#10737)
* fix: lineage ui issues

* fix: lineage menu item overflow

* fix: remove tailwind classes

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-28 19:38:31 +05:30
NiharDoshi99
46afe69811
improvement in pii tagging (#10696)
* improvement in pii tagging

* fix conflict and changes as per comment

* Added confidence field

* changes as per comments

* Apply suggestions from code review

Co-authored-by: Teddy <teddy.crepineau@gmail.com>

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-03-28 19:37:48 +05:30
Pere Miquel Brull
4853dfc6c8
Deprecate test_connection endpoint (#10798) 2023-03-28 15:52:36 +02:00
Teddy
fc9b64b52a
Fix histogram labels (#10797)
* fix: added logic to format bin labels for histogram metric

* fix: histogram labels

* fix: added types for arguments
2023-03-28 12:59:45 +02:00
Anuj359
52c9a0f0df
Limiting cypress actions on openmetadata-ui (#10796)
* Limiting cypress actions on openmetadata-ui

* Limiting cypress actions on openmetadata-ui

* Updating cypress actions pull_request_target

---------

Co-authored-by: Anuj Joshi <anuj@Anujs-Air.fritz.box>
2023-03-28 15:38:39 +05:30
Chirag Madlani
bae95c5314
feat(ui): consistent user dropdown for owner and reviewers (#10617)
* feat(ui): consistent user dropdown for owner and reviewers

* feat(ui): consistent user dropdown for owner and reviewers

* make component working with pages
update styles
add few more components like count details, color update on tags

* remove AddUserModal component

* fix owner edit for netity page

* add tests for selectable list

* remove reference for OwnerWidgetWrapper
update tests to reduce console error on test run

* remove count

* fix sonarcloud and ui

* remove OwnerWidget

* minor fixes

* verify reviewer and owner modal behavior

* fix tests

* fix minor UI glitches

* fix unit tests

* fix cypress

* fix cypress failures

* fix search and glossary cypress failure

* minor fix

* fix remaining cypress tests

* remove intercept for terms

* fix issues

* address comments

* skip falky test to avoid failures
2023-03-28 14:39:41 +05:30
Parth Panchal
8f424e1787
Fixed#10565: Make Prometheus Mappings Configurable (#10671)
* Fixed#10565: Make Prometheus Mappings Configurable

* Fixed#10565: Make Prometheus Mappings Configurable

* Fixed#10565: Make Prometheus Mappings Configurable

* Addressing comments and fixed nullpointer in tests

* Fixed#10565: Make Prometheus Mappings Configurable

* Addressing comments

* Fixing tests
2023-03-28 12:51:52 +05:30
Shailesh Parmar
4b260f1736
fixes 10357: Update Partitionning Setting Flow for Profiler (#10743)
* initial commit for #10357

* added form based on partition condition

* localization sync

* added unit test

* updated sql editor with common component

* updated form based on switch

* addressing comment

* added form type and provided to form instance

* added default value for partitionValues in initialValue field
2023-03-28 12:13:16 +05:30
Milan Bariya
65297e5b1d
Fix Sample data ingestion which have enum type columns (#10756)
* Fix Sample data ingestion which have enum type columns

* Change based on comments

* Change based on comments

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-28 11:52:12 +05:30
Ashish Gupta
21d5de6ee4
Fixes #10771 : Supported more properties in Object Store detail Page header (#10772)
* Added more properties in Object Store detail Page

* localisation key added

* bytes converted to kb and mb

* changes as per comments

* changes as per comments

* reverted last commit changes
2023-03-28 11:48:22 +05:30
Milan Bariya
3d1bbb1037
Add a configurationto skip Snowflake transient and tmp tables (#10665)
* Add a configurationto skip  Snowflake transient and tmp tables

* Fix Python checkstyle

* add separate query for transient tables

* Move skipTempTables into SnowflakeConnection

* Fix merge conflict

* change skip word to include

* Add title in json file

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-28 06:29:59 +02:00
Pere Miquel Brull
78d7dd8789
[WIP] - Test Connection - Prepare the new test connection ingestion+UI logic (#10660)
* Prepare the new test connection ingestion logic

* Update test assert

* Update Test Connection for SQA Sources

* Correct return type and method doc

* Handle decryption

* Non SQA Database Sources

* Add the run_automation script in ingestion-base

* Dashboard Test Connection Changes

* Pipeline, Messagin, MlModel & Metadata Sources

* ui: test connect flow-1

* Unmask connection parameters before sending to Ariflow

* ui: test connect flow-2

* Address review comments and pylint

* pytest fix

* ui: test connect flow-3 (refactoring and style fix)

* ui: test connect flow-4 (fix test connection status logic)

* sync local file

* ui: test connect flow-5 (fix lowercase issue and styling)

* ui: test connect flow-5 (show toast notifications)

* test: add unit test

* ui: test connect flow-5 (update service page test connection button)

* Databrick fix & pytest fix

* pylint

* Update test

* Fix merge

* S3 Test connection

* add style for mandatory step

* sync locales

* chore: add service name in workflow request

* Unmask using original service connection parameters

* Fix test connection unmasking

* Wrap inspector function to eliminate error outside test conn

* Fix linting

* fix:cy test

* Fix linting

* address comment

* refactor and fix connection type casing issue

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-03-28 06:29:13 +02:00
Mohit Yadav
13edb4ccdf
Return proper message in case invalid or missing token (#10788) 2023-03-27 21:56:39 +00:00
Mohit Yadav
29119dda89
Add docs for SAMl and AWS saml setup (#10787) 2023-03-28 01:05:21 +05:30
Shailesh Parmar
e2913c68a3
cypress: skipping tagsAddRemove spec for mlmodel entity (#10786) 2023-03-27 18:54:24 +00:00
Mohit Yadav
bdb6a16430
Fix Query Used In (#10784) 2023-03-27 23:03:33 +05:30
Teddy
31d4662abe
Fixes #10775 -- BQ partitionning for datetime dtype (#10780)
* fix: BQ partitionning for datetime dtype

* Update ingestion/src/metadata/profiler/orm/functions/datetime.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update ingestion/src/metadata/profiler/orm/functions/datetime.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update ingestion/src/metadata/profiler/orm/functions/datetime.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-27 15:28:34 +02:00
dependabot[bot]
4db2a74c26
chore(deps): bump spring-core from 5.3.24 to 5.3.26 (#10742)
Bumps [spring-core](https://github.com/spring-projects/spring-framework) from 5.3.24 to 5.3.26.
- [Release notes](https://github.com/spring-projects/spring-framework/releases)
- [Commits](https://github.com/spring-projects/spring-framework/compare/v5.3.24...v5.3.26)

---
updated-dependencies:
- dependency-name: org.springframework:spring-core
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-27 12:01:36 +00:00
Nahuel
da808bbe75
Fix: Update when GH actions are triggered (#10777) 2023-03-27 12:16:10 +02:00
Pere Miquel Brull
cc3d2b448b
Clean Airflow lineage test (#10745) 2023-03-27 11:46:34 +02:00
Ashish Gupta
c50390da80
Make the modal not closable on outside click (#10748)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-27 12:57:59 +05:30
Ashish Gupta
f54efc649b
Fixes #10543 : Fix searchbar persistence issue after user get deleted by search. (#10753)
* Fix the searchbar on user page after delete action

* minor changes
2023-03-26 20:06:03 +05:30
Cristian Calugaru
3ffde9a293
Fixes #9064 - Ingestion for S3 bucket containers (#10515)
* Prep skeleton for object store connector

* First of of ingestion piepline for bucket containers.

* addressed PR review comments.

* swaped random with secrets due to security warning.

* linter issues.

* added prefix population for containers.

* more linting

* removed temp file.

* object store unit tests, PR comments and minor refactorings

* docs update and new TestConnection approach.

* linting

* removed isStructured field from containermeta schema

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-26 11:35:34 +02:00
Sachin Chaurasiya
0f3e929b75
doc: update doc for how to add new language support (#10734)
* doc: update doc for how to add new language support

* chore: minor fix

* address comments
2023-03-25 13:08:17 +05:30
Shailesh Parmar
5bbac9185c
fixed issue test result graph not displaying full axis values #10704 (#10715)
* fixed issue test result graph not displaying full axis values #10704

* added additional test case for digitFormatter function
2023-03-25 10:43:39 +05:30
Suresh Srinivas
ea8e1fda46
Fixes #10759 A Non-Privileged user can add new 'Roles' to Teams (#10760) 2023-03-24 19:23:22 -07:00
Chirag Madlani
c4c510443b
fix(test): redshiftWithDBT cypress failure for lineage (#10754)
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-25 00:30:17 +05:30
Nahuel
ef759c7e88
Fixes#8038: Change how status is handled after running workflow (#10710)
* Change how status is handled after running workflow

* Reset changes in config files

* Add auxiliary Summary class

* Improve failures handling

* Pylint error

* Pylint error

* Show result in table

* Add test

* Fix setup.py

* Add comments
2023-03-24 17:59:06 +01:00
Shailesh Parmar
0b50380b97
ui: unit test for query as entity ui changes (#10699)
* added edit support for description, tags and owner for queries

* updated style of left panel and center panel of query tab

* translation sync

* full entity ref

* added ui changes for query used in other table

* translation-sync

* move const value to constant file

* implemented permission API for edit actions

* implemented pagination

* sync-language

* translation sync

* implemented vote up and vote down functionality for query

* refactor code

* added filter dropdown for query entity

* translation-sync

* fixed unit test and refactor query files

* localization-sync

* fixed failing unit test and cursor blink issue in readOnly mode for editor

* refactor

* addressing comments

* updated edit condition

* updated description heading

* added unit test for QueryCardExtraOption component

* added unit test for tableQueryRightPanel

* updated floating query used by other table element

* translation sync

* updated default paging value

* updated unit test with new changes

* added unit test for QueryUsedByOtherTable component

* updated query card test

* updated expand collapse icon for query

* added border top for card footer

* addressing comment

* import fix

* fixed cypress for postgress

* removing py changes,

* updated unit test as per new change

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-03-24 09:32:51 -07:00
Mohit Yadav
11032a2d48
SAML feature (#10669)
* Added Saml Feature

* add localization

* fix tests

* added collate copyright

* remove thread.getType

* fixed keystore issues and updated review comments

* remove private key getter

* update test saml config

* update test saml config

* Update openmetadata-service/src/main/java/org/openmetadata/service/security/saml/OMMicrometerHttpFilter.java

Co-authored-by: Nahuel <nahuel@getcollate.io>

* review comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-24 21:56:49 +05:30
Jan-Pieter van den Heuvel
c46732a4ff
Fix year of latest release in releases documentation page (#10664) 2023-03-24 17:08:21 +01:00
Sachin Chaurasiya
c6746507d9
fix#10662: Update tier functionality is not working as expected on the containers page (#10720)
* fix#10662: Update tier functionality is not working as expected on the containers page

* chore: remove unwanted change

* test: add unit test

* chore: add container entity icon

* chore: fix spacing issue

* chore: add support for lineage info drawer

* fix: locale missing key issue

* refactor: entity info drawer
2023-03-24 18:13:44 +05:30
Mohit Yadav
fb02cbfeed
fix failing Py test due to backend change (#10749) 2023-03-24 17:41:52 +05:30
Aniket Katkar
218e07808a
ui: explore page filters refactoring (#10524)
* changed behavior of quick dropdown filters to be same as left panel filters
- AND condition across different fields
- OR condition inside the same field filters
Applying left panel filters will now sent data as `post_filter` to prevent aggregations updating

* Added a separate API call without any filters to get all the left panel filter options

* separated url parameter variables to store 'facet' 'quick' and 'advanced search' filters
updated the logic to change facet filters according to selection.

* Fixed following bugs
- facet filters updating if filters are applied from quick dropdown or advanced search
- count for the filters were not updating with filter selection
- optimized API calls on explore page

* updated facet filters behavior where only counts will updated on filter selection instead of actual filters list

* Removed unnecessary code
Removed code smells

* worked on comments to improve the code

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-24 14:15:50 +05:30
Pere Miquel Brull
4913aeb53b
Docs - Add Airflow version support (#10707) 2023-03-24 06:31:38 +01:00
karanh37
f7dc89f727
feat: add glossary and tags to global search (#10677)
* feat: add global search for glossary and tags

* fix: missing localization keys

* fix: select issues

* feat: add glossary and tags in explore page

* fix: review comments

* fix: add missing icons

* feat: added glossary term summary panel

* feat: add tags panel

* fix: update glossary icon

* fix: separate out interfaces for summary entities

* fix: remove fragment

* fix: jest tests
2023-03-24 11:01:06 +05:30
Ashish Gupta
9e2b2d1926
Fix the breaking remove owner from Services (#10717) 2023-03-24 10:54:51 +05:30