5395 Commits

Author SHA1 Message Date
Pere Miquel Brull
a45728cf02
Add approval CI workflow (#8620)
* Add approval workflow

* Add approval workflow
2022-11-09 16:47:27 +01:00
Pere Miquel Brull
f064ab1e89
Test Java checkstyle pull request write (#8616)
* Test PR write permissions

* Test PR write permissions
2022-11-09 16:18:43 +01:00
Pere Miquel Brull
7b2d224b2d
Test PR write permissions (#8615) 2022-11-09 16:17:30 +01:00
Pere Miquel Brull
ccf16cbfac
Fix permissions (#8614) 2022-11-09 16:07:06 +01:00
Pere Miquel Brull
c07f636e88
Test workflow permissions fix syntax (#8613)
* Test workflow permissions

* Fix permissions
2022-11-09 16:02:54 +01:00
Pere Miquel Brull
09ac3be112
Test workflow permissions (#8611) 2022-11-09 15:53:10 +01:00
Meet Parita Munesh Shah
9c360fb61c
added docs for DOMO (#8543)
* added docs for DOMO

* Changed As Per Comment

* Change as per comment

* Changes as per comment

Co-authored-by: Meet <meet.s@deuexsolutions.com>
2022-11-09 16:44:02 +05:30
Chirag Madlani
c83690d07e
feat(ui): update pipeline status UI (#8253)
* feat(ui): update pipeline status UI

* fix typos

* minor update

* Merge branch 'main' into support-7127

* design updates

* minor fixes

* address review comments

* fix tests

* fix cypress failing due to wrong localization keys
2022-11-09 16:04:47 +05:30
Sachin Chaurasiya
70e2fda452
Feat ( #8161) Implement logic to fetch report data part-1 (#8499)
* Feat  ( #8161) Implement logic to fetch report data

* Add profile picture support for user and owner

* Add custom tooltip for graph

* Add description for charts

* Change WebAnalytics to Web Analytics

* Update entities to datasets

* Change dropdown to select widget

* Add KPIs Button

* Add constant for tab

* Add constant and utils

* Add APIs and interface

* Add state in the data insight page

* Change total to latest

* Create prepareGraphData util

* Add API integration to get TotalEntitiesByType chart

* Create common method to get the graph data

* Rename common method

* Add method to get the graph data by tier type

* Add API integration to get PercentageOfEntitiesWithDescriptionByType chart

* Add API integration to get PercentageOfEntitiesWithOwnerByType chart

* Fis unit test

* Add API integration to get TotalEntitiesByTier chart

* Add unit test

* Add logic to get latest count

* Fix typescript warnings

* Make dataReportIndex as default param for API request

* Add debounce to graphs

* Add filtering support for charts

* Addressing review comments

* Address review comment

* Address review comments
2022-11-09 14:31:22 +05:30
NiharDoshi99
4ed088f55e
WIP: Fixed amundsen ingestion (#8544) 2022-11-09 14:21:44 +05:30
Shailesh Parmar
3c6e467829
Feat: UI Added feature to show edge information onClick of edge (#8599)
* Feat: UI Add feature to show edge information onClick of edge

* move interface to separate file
2022-11-09 13:21:02 +05:30
Mohit Yadav
5bd4e56b3f
Feat kpis (#8584)
* Added Kpi Resource

* Fix typo

* Fixed failing test

* Review Suggestions
2022-11-09 13:06:13 +05:30
Mayur Singal
1d93d0e650
Fix #8570: Parsing Workflow Gracefully on Deploy (#8585)
* Fix #8570: Parsing Workflow Gracefully on Deploy

* use entity_class

* py format
2022-11-09 08:30:22 +01:00
Aniket Katkar
7c395a82d4
Feat(UI): Added EntitySummaryPanel in Explore page (#8591)
* Added EntitySummaryPanel in Explore page

* Worked on comments to optimise code for EntitySummaryPanel

* fixed faling unit test for explore component
2022-11-09 11:11:01 +05:30
dependabot[bot]
e1806b50a5
Bump loader-utils in /openmetadata-ui/src/main/resources/ui (#8578)
Bumps [loader-utils](https://github.com/webpack/loader-utils) from 1.4.0 to 1.4.1.
- [Release notes](https://github.com/webpack/loader-utils/releases)
- [Changelog](https://github.com/webpack/loader-utils/blob/v1.4.1/CHANGELOG.md)
- [Commits](https://github.com/webpack/loader-utils/compare/v1.4.0...v1.4.1)

---
updated-dependencies:
- dependency-name: loader-utils
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-08 22:44:02 +05:30
Teddy
dcd0bbb566
Fixes 8470 -- Implements ES aggregation for web analytic data (#8566)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* added domo to test subpackage

* cleaned up branch by removing commit from issue-8353 that were not merged in main

* Added web analytics data refinement

* Added get_status function

* Added from __futur__ for typing

* Added dailyActiveUsers aggregation

* Added page views entities aggregation and active users aggregation
2022-11-08 17:25:31 +01:00
Milan Bariya
4d16be2608
Fix: Hive connection issue (#8583)
* Fix: Hive connection issue

* Change based on comments
2022-11-08 16:22:37 +01:00
Teddy
2ffb88f6aa
Added bit -> binary column type conversion for mssql (#8581) 2022-11-08 16:21:55 +01:00
michizhou
da06d183db
feat: add QuickSight connector (#8442) 2022-11-08 19:54:49 +05:30
Shailesh Parmar
1538972341
UI: Fixed Data is getting round off at the time of formatting in en-US (#8576) 2022-11-08 16:55:05 +05:30
Aniket Katkar
00bac5c929
Fix #8481 (UI): Changed how team assets are shown similar to explore page (#8526)
* Changed how entity details are shown in 'My Data' and 'Following' tabs on user details page

* Changed how team assets are shown similar to explore page

* removed isUndefined as isEmpty will cover that

* - Renamed 'GlossaryTermAssets' interface to 'AssetsDataType' to use it commonly and made the required changes for where it was used
- Code optimisation to reuse repeated code blocks
- Localization changes for 'UserPage'

* - Code optimisation by using common util functions
- Localization changes for 'TeamsPage' and 'TeamDetailsV1'
- Fixed spelling mistakes
2022-11-08 16:42:00 +05:30
Mayur Singal
710e3d785f
Fix #8495: Update pipeline sources for pipeline as edge lineage (#8556) 2022-11-08 14:13:49 +05:30
Shailesh Parmar
abc9247899
UI: Updated lineage UI as per new mock (#8568)
* UI: Updated lineage UI as per new mock

* fixed function icon issue in edit mode

* removed unit test related to pipeline label name

* center nodes on expand/collapse column lineage view

* addressing comments
2022-11-08 13:48:28 +05:30
Abhishek Pandey
73b370b5e2
schema-filter-added-in-datalake-for-bucket (#8516)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-11-08 10:57:16 +05:30
Mayur Singal
83102d6697
Fix #8455: fix dbt test errors when run not passed (#8545) 2022-11-08 10:50:27 +05:30
Sachin Chaurasiya
ef579ce9b4
Fix #8540 Session ID does not reset for web analytic (#8562) 2022-11-07 23:21:40 +05:30
Aniket Katkar
ecee66fce9
Fixed wrong field names showing in the validation messages for add and edit announcement modal. (#8564) 2022-11-07 23:07:31 +05:30
Teddy
b44972ef60
Fixes #8470 - Implements refinement functions for web analytics events (#8528)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* added domo to test subpackage

* cleaned up branch by removing commit from issue-8353 that were not merged in main

* Added web analytics data refinement

* Added get_status function

* Added from __futur__ for typing

* Fixed typos brought up during reviews
2022-11-07 17:08:20 +01:00
Nahuel
6e1f4fdd92
Schedule security scan every Monday midnight (#8558) 2022-11-07 15:01:01 +01:00
Aniket Katkar
af7f8b691a
Fixed issue where wrong data was being sent to the PATCH API call for table resulting in error while removing tags for columns (#8557) 2022-11-07 19:30:28 +05:30
Aniket Katkar
e44fafad88
Fix #7737 (UI) : Changed how entity details are shown in 'My Data' and 'Following' tabs on user details page (#8524)
* Changed how entity details are shown in 'My Data' and 'Following' tabs on user details page

* removed isUndefined as isEmpty will cover that

* - Renamed 'GlossaryTermAssets' interface to 'AssetsDataType' to use it commonly and made the required changes for where it was used
- Code optimisation to reuse repeated code blocks
- Localization changes for 'UserPage'
2022-11-07 19:21:12 +05:30
Shailesh Parmar
5fee438b87
Feat UI: Added Tracing for lineage and Column lineage (#8542)
* Feat: Added tracing feature for lineage

* fixed stack overflow issue for tracing logic

* restrict highlighing column lineage on click of node

* added support for column lineage tracing

* added unit test for util function

* updated icon color as per font color
2022-11-07 17:00:51 +05:30
Pere Miquel Brull
8d15985117
Docs - Run connectors from MWAA (#8548)
* Run connectors from MWAA

* Run connectors from MWAA

* Update url

* Add backend conn

* Add MWAA extraction
2022-11-07 09:43:42 +01:00
Pere Miquel Brull
b23d8353fc
Docs best practices (#8541) 2022-11-07 09:27:53 +01:00
Vj-L
987e3a66fb
Updated the document for docker deployment (#8527)
* Updated the document for docker deployment

* Updated the document for docker deployment

* Updated the document for docker deployment

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-11-07 11:00:00 +05:30
Suresh Srinivas
292672a970
Clean up code warnings (#8532) 2022-11-04 11:24:46 -07:00
Pere Miquel Brull
a7347e1873
Fix Dagster migration script (#8539) 2022-11-04 09:43:52 +01:00
Sachin Chaurasiya
833883e24a
Fix data insight Json Schema filename and content (#8534)
* Fix Json Schema filename

* Remove formatting

* FIx required property and change data type from array to object

* added items to array type

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-04 14:07:36 +05:30
Sriharsha Chintalapani
5c5514a8b9
Fix mysql migration script syntax (#8536) 2022-11-04 08:31:33 +01:00
Sachin Chaurasiya
aa7c31ec31
Fix #8490 Wrong message in the required message on Policy page (#8522)
* Fix #8490 Wrong message in the required message on Policy page

* Fix unit test

* rename functions to conditionFunctions

* Address review comments

* Address review comments

* Fix cypress test data test id.

* FIx unit test
2022-11-04 11:20:36 +05:30
Mayur Singal
a49c261cbe
Add Queued Status in Ingestion Pipelines (#8529) 2022-11-04 11:19:50 +05:30
NiharDoshi99
1c1f8660f2
Fixed: dagster to connect to cloud (#8387)
* Fixed: dagster to connect to cloud

* Fixed: changed test_cases

* Fixed: lineage between the assets and jobs

* Changes as per comments

* Fix python checkstyle

* Fix as per comments

* Fix added migration scripts

* minor fixes
2022-11-03 18:19:50 +01:00
Tushar Mittal
6f2c93089c
feat: add SageMaker connector (#8435)
* feat: add sagemaker connector

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

* fix: fix linting errors and update imports

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

* test: add unit tests for sagemake source

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>
2022-11-03 18:19:20 +01:00
Aniket Katkar
d93b46ef31
(UI) #7790 : Added support to preserve search text for users and admins list page (#8478)
* Added support for preserving search text for users and admins list page

* added comments for better understanding of code

* Used URLSearchParams for adding parameters to url for userListPage

* renamed search parameter from 'name' to 'search'
2022-11-03 22:32:07 +05:30
Milan Bariya
6a7704a746
Fix: Filter Databricks history by date (#8520)
* Fix: Filter Databricks history by date

* Fix: Filter Databricks history by date

* Change based on comment
2022-11-03 22:08:56 +05:30
Milan Bariya
158bd4b9cd
Add: databricks troubleshoot page (#8523) 2022-11-03 14:27:50 +01:00
Shailesh Parmar
0f0489a7d4
Feat: Added pipeline as edge from ui (#8503)
* Feat: Added pipeline as edge from ui

* fixed failing unit test

* removed pipeline

* added unit test for util function
2022-11-03 17:46:49 +05:30
Pere Miquel Brull
c326cc1370
Move logging to DEBUG (#8519) 2022-11-03 13:04:33 +01:00
Chirag Madlani
60a97ea8bc
fix(ui): redirect to sign-in when user is not authorized (#8512) 2022-11-03 16:08:50 +05:30
Teddy
f4cc2b57a7
Fixes #8353 - Implement Aggregation Endpoint for dataInsight (#8464)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* Fix pageViewEvent import issue

* Changed dataType to PERCENTAGE and NUMBER

* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-03 14:51:14 +05:30