7010 Commits

Author SHA1 Message Date
Aniket Katkar
2dc8440bc7
fix#10859: permission issue in test suite details page (#10997)
* fixed permission bug for test cases

* added unit tests for the changed permissions logic
2023-04-11 16:18:52 +05:30
Milan Bariya
ff3e19498a
Doc update for Data-insight (#10985) 2023-04-11 12:18:00 +02:00
Ashish Gupta
331f043d3b
Fixes #10584 : Improvements in DataModel Entity (#10983)
* Improvements in DataModel Entity

* Added lineage view in DataModel Entity

* changes as per commets

* fix unit test issue

* fix code smell

* changes as per commets
2023-04-11 14:04:10 +05:30
Pere Miquel Brull
09b283818d
Rel to #10927 - Looker DataModel (#10945)
* Organise calls

* Prepare skeleton

* Add looker model handling

* Parse files as sql

* Handle labels

* Linting

* Format

* Fix version

* Also check the API for explore lineage
2023-04-11 08:44:00 +02:00
Chirag Madlani
1a451fe2a8
cypress(test): enable cypress for all the PRs (#10994) 2023-04-11 05:48:47 +00:00
Sriharsha Chintalapani
a49b2b501a
Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work (#10611)
* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work

* Fix Search Indexes: Normalize display name to be lowercase, such that upper or lowercase searches can work
2023-04-11 07:31:43 +02:00
Pere Miquel Brull
4084d3b0d5
Add ES translations (#10986) 2023-04-11 06:31:28 +02:00
Aniket Katkar
0bbcfc5b3d
fixed console errors in the ui for ElasticSearchReIndexPage (#10982) 2023-04-10 23:29:22 +05:30
Chirag Madlani
b3e7919c92
fix(ui): upgrade cy machine to 3 (#10987) 2023-04-10 21:10:38 +05:30
Aniket Katkar
1d93000466
fix(ui): fixed flaky cypress test for TeamsHierarchy spec (#10958)
* Fixed flaky TeamsHierarchy spec

* updated cypres.config

* updated cy config

* fixed flaky service related cypress

* fixed addRoleandAssigntouser spec

* updated test

* updated merge conflict issue

* reduce machine to 2 for cypress

* skipping tags cypress due to #10979

* unskip test

* revert check for status code not checking

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-04-10 15:16:20 +00:00
Ayush Shah
02a52b3ddf
Fix table name with underscore (#10980) 2023-04-10 11:41:36 +00:00
Mohit Yadav
5563935fbf
Avoid ES Bulk Calls for not requests (#10981) 2023-04-10 16:50:14 +05:30
Onkar Ravgan
3c32658d7a
Fixed dbt logging (#10977)
* Fixed dbt logging

* Fixed pytests

* Fixed pycheckstyle
2023-04-10 10:04:25 +00:00
Mayur Singal
9f2b10f6e2
Fix #10858: Fix dashbaord & pipeline url (#10957) 2023-04-10 09:48:49 +00:00
Mayur Singal
3d345f9b37
Fix #10273: Parse nested json for datalake (#10956) 2023-04-10 14:58:02 +05:30
Ayush Shah
6ff3557917
Issue 10975 - fix workflow break at none (#10976) 2023-04-10 09:05:38 +00:00
Mohit Yadav
ee4f1b4e51
Add Stop Functionality For Reindex (#10971)
* Add stop Reindexing Job

* Languages

* Add Status

* Add Status

* Add messages
2023-04-10 13:15:44 +05:30
Shailesh Parmar
751919e6ca
fixes App Analytics summary not adjusting to the datetime [UI] #10571 (#10961)
* fixes App Analytics summary not adjusting to the datetime [UI] #10571

* added comments to the code

* updated sum logic, used sumBy method from lodash

* addressing comment
2023-04-10 07:38:44 +00:00
Chirag Madlani
6568d0df08
fix(test): reduce machin to 2 2023-04-10 12:45:09 +05:30
Shailesh Parmar
d79974dba1
ui: move queries from ES to REST API (#10947)
* initial commit for moving from ES to REST

* updated filters

* miner fix

* fixed failing unit test

* fixed failing cypress
2023-04-10 10:21:27 +05:30
karanh37
445ac90ef9
feat(ui): glossary versions page (#10966)
* fix: glossary right panel position fix

* fix: review comments

* feat: add deeplinks to tabs in glossary terms page

https://github.com/open-metadata/OpenMetadata/issues/10713

* fix: glossary feedback

* chore: update svg icon

* fix: missing localization keys

* fix: review comments

* fix: missing localization keys

* fix: review comments

* fix: jest tests

* feat: glossary ui improvements

* fix: missing localization keys

* fix: added error placeholder for assets

* fix: add icon to references

* fix: table issues

* feat: add glossary versions page

* fix: remove display name validations

* fix: localization keys

* fix cypress

* fix: button alignment

* fix: glossary version improvements

* fix: remove tooltip as not needed

* fix: update space direction

* fix cypress failure for ingestion tab

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-08 15:26:43 +05:30
karanh37
d5a0aa9af6
fix(ui): glossary improvements (#10823)
* fix: glossary right panel position fix

* fix: review comments

* feat: add deeplinks to tabs in glossary terms page

https://github.com/open-metadata/OpenMetadata/issues/10713

* fix: glossary feedback

* chore: update svg icon

* fix: missing localization keys

* fix: review comments

* fix: missing localization keys

* fix: review comments

* fix: jest tests

* feat: glossary ui improvements

* fix: missing localization keys

* fix: added error placeholder for assets

* fix: add icon to references

* fix: table issues

* fix: remove display name validations

* fix: localization keys

* fix: button alignment

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-07 20:55:49 +05:30
Chirag Madlani
8c6ae7f682
fixes: #10604: json viewer not loading properly (#10868)
* fix(ui): owner assignment issue
fix refresh token frame timeout issue
improve tier card
 - Remove clear all button
 - add remove button at tier level
fix: #10604

* fix tier select button styling
fix follow unfollow for dashboard

* fix unit tests

* fix unit tests

* change active tab based on owner

* fix sonar-cloud code smells

* fix edit owner cy failure

* fix cypress

* fix cypress for service and entityDetails

* fix cypress

* fix dashboard entityName issue

* fix unit tests

* fix cypress tests

* fix owner assigning cypress
2023-04-07 19:44:37 +05:30
Teddy
203f17fa49
fix: add rollback logic to custom sql query to exit out of transaction (#10968) 2023-04-07 14:46:05 +02:00
Aniket Katkar
d112b40a3f
fix(ui): API endpoints to fetch elastic search data on settings page. (#10946)
* Made changes to use the newly created APIs for fetching elasticSearch re-indexing data

* DOcs Fix and add validation

* Fixed APIs to fetch the batchJob reIndex data
worked on comments

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-04-07 11:53:51 +05:30
Ashish Gupta
c997d8c80b
Feat #10584 : Support Activity tab for DataModel Entity (#10941)
* Supported DataModel in Dashboard Page

* url fqn changes

* Support Activity tab for DataModel Entity

* Remove dataModel resource descriptor

* Fix tasks for dashboard data models

* changes as per comments

* minor fix

* changes as per comments and minor improvements

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-04-06 23:05:40 -07:00
Keith Sirmons
27984c25f3
Fixes 10959: MSSQL profile has error when averaging large integer column (#10960)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala

* added cast to decimal for column when running average in mean.py

* fixed lint error
2023-04-07 06:48:18 +02:00
Sriharsha Chintalapani
7c6b9b3c56
Update python sdk client connection details (#10963)
* Update python sdk client connection details

* Update index.md
2023-04-06 20:44:36 -07:00
Pere Miquel Brull
ac9979070a
[WIP] - Fixes #10725 - Fix extension in ingestion pipeline and delete statuses api (#10866)
* Fix extension in ingestion pipeline and delete statuses api

* Add tests for ingestion pipeline status

* Format
2023-04-06 19:12:18 +00:00
Hemal Mamtora
0206af0303
[WIP] Fixes #10721: created client file for metabase and moved get request to client file (#10838)
* ingestion/metadata - created client file and moved get request to client file

* moved code to client.py, created models.py

* added, self to MetabaseClient constructor

* added status_code in metabase client functions and handled Optional datatype in metabase metadata functions

* moved api calls to client

* passing service_connection and metabase_session from constructor to MetabaseClient

* renamed client to metabaseClient to avoid rewriting DashboardServiceSource.client

* moved post request from connection.py to client.py

* run make py_format

* moved client code to init constructor

* added Dashboard Model for Metabase

* updated client type to MetabaseClient and used get_dashboards_list() function in custom_executor

* updated client type to MetabaseClient and used get_dashboards_list() function in custom_executor

* make py_format

* pylint issues resolved

* pylint and run make py_format

* calling init method in Metabase source

* removed init method
2023-04-06 19:26:52 +02:00
karanh37
c1cbee3d1b
fix: user selectable list popover issues (#10799)
* fix: user selectable list popover issues

* fix: skip glossary tests

* fix: team cypress tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-06 22:55:45 +05:30
Keith Sirmons
42000053aa
Fixed Issue #10943: Impala query engine metadata ingestion and median function profiler (#10944)
* updated metadata to work with the impala query engine.
Uses the describe function to grab column names, data types, and comments.

* added the ordinalPosition data point into the Column constructor.

* renamed variable to better describe its usage.

* updated profile errors.
Hive connections now comment columns by default.

* removed print statements

* Cleaned up code by pulling check into its own function

* Updated median function to return null when it is being used for first and third quartiles.

* removed print statements and ran make py_format

* updated to fix some pylint errors.
imported Dialects to remove string compare to "impala" engine

* moved huge comment into function docstring.
This comment shows us the sql to get quartiles in Impala
2023-04-06 18:07:42 +02:00
Ashish Gupta
6f055fdb34
Fixes : #8732 Support displayName field in at Tags (#10767)
* Added displayName field in Tags

* localisation key added

* minor changes

* added tooltip

* remove rename option from outside and added it inside the form

* minor changes

* fix cypress issue

* changes as per comments

* fix cypress issue

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-06 21:15:37 +05:30
Pere Miquel Brull
cdd473c3b7
Add ingestionIpInfoEnabled configuration (#10870)
* Add ingestionIpInfoEnabled configuration

* Format

* hide ip address if api response if not 200

* removing dependancy on ip-modal and checking default state

* updated status code for ip to 204 to check default state

* fixed failing cypress

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-04-06 16:27:07 +02:00
Aniket Katkar
942649f3b6
fixes #10755: Changed description change method for service connections from 'Put' to 'PATCH' (#10876)
* Changed description change method for service connections from 'Put' to 'PATCH'

* worked on comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-06 19:42:17 +05:30
Ashish Gupta
8e3e0002db
Feat #10584: Support Lineage for DataModel Entity (#10936)
* Supported DataModel in Dashboard Page

* url fqn changes

* Support Lineage for DataModel Entity

* added datamodel icon

* minor changes

* changes as per comments

* remove unwanted lineage code
2023-04-06 19:33:49 +05:30
Shailesh Parmar
c45d889d5f
cypress: fix failing cypress test (#10953) 2023-04-06 12:22:11 +00:00
Ashish Gupta
059f53b0da
Change object label and added container filter pattern in Metadata (#10861)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-06 17:26:06 +05:30
Ashish Gupta
8fb2f13f1e
Feat #10584 : Support SQL tab in Data Model Entity (#10938)
* Supported DataModel in Dashboard Page

* url fqn changes

* Added Sql tab in Data Model Entity

* if sql is not there tab will not be shown

* fix the delete entity failure
2023-04-06 17:23:09 +05:30
Aniket Katkar
d0c0942e1b
fix 10685: test suite related bug fixes and improvements (#10899)
* made changes to redirect user to test suite listing page after test suite deletion instead of homepage

* removed unnecessary fields being passed to API call for fetching for entity summary panel

* removed unnecessary fields being passed to API call for fetching test case results in dataset details page

* Added action column to the test suite list page inside tables for delete action

* fixed an issue with the test case form where going back and forth through steps was making fields unresponsive

* fixed unit tests

* fixed test suite deletion issue

* Revert changes for TableProfilerV1
2023-04-06 15:19:53 +05:30
Ashish Gupta
4001aa0ccc
feat #10584 : Supported DataModel in Dashboard Page (#10931)
* Supported DataModel in Dashboard Page

* url fqn changes

* changes as per comments
2023-04-06 15:03:30 +05:30
Nahuel
62b88b0404
Fix#10584: Add lineage for Tableau data models (#10923)
* Refactor Tableau ingestion

* Add lineage from DB -> DataModel -> Dashboard

* Address PR comments

* Address PR comments
2023-04-06 07:28:41 +02:00
Mohit Yadav
ec6ff78b80
fixes for Reindex (#10948)
* fixes for Reindex

* review comments
2023-04-06 10:50:08 +05:30
Pere Miquel Brull
c53c7b680d
Rel #10828 - Update container index and fix airflow ingestion (#10873)
* Update container index and fix airflow ingestion

* Fix lint

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-04-06 07:09:38 +02:00
Deepa Rao
38d4afb6cb
Fixes #10924 - Trim the redundant permissions in the permission list (#10928)
* Fixes #10924 - Trim the redundant permissions in the permission list

* Fixes #10924 - Trim the redundant permissions in the permission list
2023-04-05 19:01:27 -07:00
Sachin Chaurasiya
922a8079b1
fix(#10905):API documentation does not show bullets from Markdown (#10932) 2023-04-05 23:00:30 +05:30
Teddy
06b8d8e7ce
fix: explicitly state USE CATALOG for databricks connection (#10940) 2023-04-05 18:47:18 +02:00
Teddy
4683bee91a
Fixes #10911 - Improve Data Insight Logging (#10915) 2023-04-05 18:46:39 +02:00
Shailesh Parmar
8ac6ce9f7a
cypress: fix flaky cypress test from main (#10937)
* cypress: fix flaky cypress test from main

* fixed tags spec

* skipping `Add tag at DatabaseSchema level with task & suggestions` test
2023-04-05 20:32:48 +05:30
Sriharsha Chintalapani
eb92ea9069
Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Cont… (#10809)
* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..

* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..
2023-04-05 16:50:12 +02:00