4912 Commits

Author SHA1 Message Date
Pere Miquel Brull
b23d8353fc
Docs best practices (#8541) 2022-11-07 09:27:53 +01:00
Vj-L
987e3a66fb
Updated the document for docker deployment (#8527)
* Updated the document for docker deployment

* Updated the document for docker deployment

* Updated the document for docker deployment

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-11-07 11:00:00 +05:30
Suresh Srinivas
292672a970
Clean up code warnings (#8532) 2022-11-04 11:24:46 -07:00
Pere Miquel Brull
a7347e1873
Fix Dagster migration script (#8539) 2022-11-04 09:43:52 +01:00
Sachin Chaurasiya
833883e24a
Fix data insight Json Schema filename and content (#8534)
* Fix Json Schema filename

* Remove formatting

* FIx required property and change data type from array to object

* added items to array type

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-04 14:07:36 +05:30
Sriharsha Chintalapani
5c5514a8b9
Fix mysql migration script syntax (#8536) 2022-11-04 08:31:33 +01:00
Sachin Chaurasiya
aa7c31ec31
Fix #8490 Wrong message in the required message on Policy page (#8522)
* Fix #8490 Wrong message in the required message on Policy page

* Fix unit test

* rename functions to conditionFunctions

* Address review comments

* Address review comments

* Fix cypress test data test id.

* FIx unit test
2022-11-04 11:20:36 +05:30
Mayur Singal
a49c261cbe
Add Queued Status in Ingestion Pipelines (#8529) 2022-11-04 11:19:50 +05:30
NiharDoshi99
1c1f8660f2
Fixed: dagster to connect to cloud (#8387)
* Fixed: dagster to connect to cloud

* Fixed: changed test_cases

* Fixed: lineage between the assets and jobs

* Changes as per comments

* Fix python checkstyle

* Fix as per comments

* Fix added migration scripts

* minor fixes
2022-11-03 18:19:50 +01:00
Tushar Mittal
6f2c93089c
feat: add SageMaker connector (#8435)
* feat: add sagemaker connector

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

* fix: fix linting errors and update imports

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

* test: add unit tests for sagemake source

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>

Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>
2022-11-03 18:19:20 +01:00
Aniket Katkar
d93b46ef31
(UI) #7790 : Added support to preserve search text for users and admins list page (#8478)
* Added support for preserving search text for users and admins list page

* added comments for better understanding of code

* Used URLSearchParams for adding parameters to url for userListPage

* renamed search parameter from 'name' to 'search'
2022-11-03 22:32:07 +05:30
Milan Bariya
6a7704a746
Fix: Filter Databricks history by date (#8520)
* Fix: Filter Databricks history by date

* Fix: Filter Databricks history by date

* Change based on comment
2022-11-03 22:08:56 +05:30
Milan Bariya
158bd4b9cd
Add: databricks troubleshoot page (#8523) 2022-11-03 14:27:50 +01:00
Shailesh Parmar
0f0489a7d4
Feat: Added pipeline as edge from ui (#8503)
* Feat: Added pipeline as edge from ui

* fixed failing unit test

* removed pipeline

* added unit test for util function
2022-11-03 17:46:49 +05:30
Pere Miquel Brull
c326cc1370
Move logging to DEBUG (#8519) 2022-11-03 13:04:33 +01:00
Chirag Madlani
60a97ea8bc
fix(ui): redirect to sign-in when user is not authorized (#8512) 2022-11-03 16:08:50 +05:30
Teddy
f4cc2b57a7
Fixes #8353 - Implement Aggregation Endpoint for dataInsight (#8464)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* Fix pageViewEvent import issue

* Changed dataType to PERCENTAGE and NUMBER

* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-03 14:51:14 +05:30
Mayur Singal
1386b43607
Fix #6141: Ingestion Pipeline Status Updates (#8216)
* Fix #6141: Ingestion Pipeline Status Updates

* List Pipeline Status API & Improvements

* Rename State field to PipelineState in UI

* Convert Pipeline Status array to single object

* fix braking UI

* Rebase Fixes

* Profiler, TestStuite & DataInsigts Pipeline

* py_format

* fix logs page not loading
add pipelineStatus endpoint

* fix recent run changes

* Fix Tests

* address review comments for ui

* fix failing checks

* fix unit tests

* fix cypress test

* remove loader test as not using it

* wait for API when we click on the tab

* fix cypress waitFor api

* fix failed cypress tests

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-11-03 14:37:26 +05:30
Onkar Ravgan
8273197b48
Fix #7767: Added new PowerBi APIs and lineage (#8485)
* Added new APIs and lineage

* Addressed review comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-11-03 08:31:31 +01:00
Mihir Kulkarni
0bc2d92aba
#7994 Updating password error message to mention numbers. (#8103) 2022-11-03 13:01:14 +05:30
Sachin Chaurasiya
63ceeb2a33
Fix #8497 Update Table styling (#8498) 2022-11-03 10:52:47 +05:30
Shailesh Parmar
91b395bc17
Fixed Cypress flakiness for add owner test in service spec (#8504) 2022-11-03 10:10:32 +05:30
Suresh Srinivas
d47f5738cb
Add support for system provided Tags, Glossaries, Policies, and Roles #8484 (#8508) 2022-11-02 14:56:31 -07:00
Sachin Chaurasiya
f3b9e2c59c
Fix UI(#8467) : Only allow admins to create and update bot and user entities (#8491)
* FIx UI : Only allow admins to create and update bot and user entities. #8467

* Add helper text for ADMIN_ONLY_ACTION
2022-11-02 22:43:46 +05:30
Pere Miquel Brull
370288f1ff
Airflow connections docs (#8493) 2022-11-02 12:07:54 +01:00
Tushar Mittal
2a65df5f36
feat: add Kinesis connector (#8452)
Signed-off-by: Tushar Mittal <chiragmittal.mittal@gmail.com>
2022-11-02 16:12:45 +05:30
Pere Miquel Brull
119763afc4
Bump datamodel-code-generator (#8492) 2022-11-02 10:31:44 +01:00
Mayur Singal
fa68a1f18f
Fix #6754: Added User Details for Usage (#8449) 2022-11-02 14:07:41 +05:30
Chirag Madlani
ef5108c47b
chore(ui): remove unused files (#8487) 2022-11-02 13:55:42 +05:30
Sachin Chaurasiya
e7e646e9a8
Revert #7292 : Add ConditionalAllow check for Create Operation Permission (#8488) 2022-11-02 11:57:42 +05:30
Milan Bariya
fbe9e59dcd
Fix: Athena connector fails to ingest complex types (#8453)
* Fix: Athena connector fails to ingest complex types

* Fix: Athena connector fails to ingest complex types

* Fix: Athena connector fails to ingest complex types

* Fix: Change based on comments
2022-11-02 07:06:39 +01:00
Suresh Srinivas
8a008022c8
Fixes #7004 Backend : conditionAllow should not be applicable to create operation (#8483) 2022-11-01 12:46:18 -07:00
Sachin Chaurasiya
19a3f1f47b
Add Unit tests for data insight component (#8469) 2022-11-01 19:07:08 +05:30
Ashish Gupta
75e8866490
UI :- Added restore option for soft deleted Teams (#8306)
* Added restore option for soft deleted Teams

* Changes as per comments

* change function name to generic and specify return type
2022-11-01 18:35:51 +05:30
Parth Panchal
af85b9629d
Fixed#8239: Query mismatch while searching for - and _ makes data overlap (#8476)
* Fixed#8239: Query mismatch while searching for - and _ makes data overlap

* Fixed#8239: Query mismatch while searching for - and _ makes data overlap
2022-11-01 18:20:03 +05:30
Sachin Chaurasiya
0701ef955e
Fix #7802 Differentiate Tags & Glossary Terms (#8471)
* Fix #7802 Differentiate Tags & Glossary Terms

* Fix governance dropdown label and arrow spacing

* Skip dashboard entity for announcement
2022-11-01 17:58:24 +05:30
Teddy
989f2911c2
Fixes #7810 - Allow to only pass min or max (#8474)
* ISSUE-7810 Added default values for min and max
For all data validations on columns:-
min_bound is set to float("-inf"), if there is no next value
max_bound is set to float("inf"), if there is no next value

* Fixed PR errors by removing tuple + added tests

Co-authored-by: demi <deepak1212365@gmail.com>
2022-11-01 13:26:51 +01:00
Shailesh Parmar
82ddcbc014
Fix UI | Enable 2-finger scroll zoom-in/zoom-out on the Lineage tab#6942 (#8477)
* Fixed UI | Enable 2-finger scroll zoom-in/zoom-out on the Lineage tab #6942

* addressing comments
2022-11-01 17:23:21 +05:30
Chirag Madlani
ca91bafa39
fix(ui): show full content for ellipsis column names (#8443)
* fix(ui): show full content for ellipsis column names

* fix unit tests and mock i18next

* address comments

* fix cypress failure

* address review comments
improve unit tests console errors
2022-11-01 16:26:40 +05:30
Onkar Ravgan
5819c45937
Databricks + DBT issue (#8391)
* Databricks dbt issue fixed

* fixed typo

* Added optimizations

* skipping flaky dashboard test

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-11-01 13:41:41 +05:30
Onkar Ravgan
a6d6cff0d5
Fixed abstract init issue (#8446)
* abstract init issue fixed

* abstract init issue fixed messaging service

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-11-01 11:40:08 +05:30
Sachin Chaurasiya
9ac438fbd1
Feat (ui #8160) : Implement Analytics report page (#8294)
* Feat (ui) : Add Data Insight Page

* Minor improvements

* Add constant and utils for data insight

* Create Separate component for each metric

* Add random data generator

* Add data-insight to the navbar

* Fix navbar

* Fix data insight route

* Remove pie charts

* Add mock data for existing graphs

* Add component for other metrics

* Fix dataKey and Y axis issue

* Correct the comment

* Add Tier Filter

* FIx data insight table styling

* Change legend positions for the graph

* Add Custom Renderer for graph legend

* Addressing review comments

* Address comment

* Address comment

* Address comment

* Address review comments

* Address review comment

* Addressing comments

* Addressing comment

* Refactor page and it's component

* Update table.less to apply border and shadow for table only if bordered prop is passed.

* Add custom style for data insight cards

* Create common component for dropdown label

* Fix dropdown label issue

* Address review comment
2022-11-01 09:50:53 +05:30
Shailesh Parmar
e68f35ec85
Fixed: Custom property failing cypress test (#8460)
* Custom property cypress

* testing out entity topic name

* Fixed Custom property topic search issue

* removed import of deleted file
2022-11-01 09:46:01 +05:30
Suresh Srinivas
e7a4a7a3e5
Fixes #6681 Add support for policy evaluation API (#8466) 2022-10-31 15:54:32 -07:00
clueless-bot
68c3e0b8fe
FIX: Add postgres usage and lineage details (#8456) 2022-11-01 00:18:05 +05:30
Onkar Ravgan
ddc66c8392
vertica query syntax issue fixed (#8463) 2022-11-01 00:16:45 +05:30
Shailesh Parmar
5bdb9d0cfd
UI: Fixed filter issue on redirection from tags page to explore page (#8457) 2022-10-31 21:39:52 +05:30
mosiac1
c4ab0c795b
Fix #8450 Explore page pagination not working (#8451)
Add useDeepCompareEffect package to handle effects with objects as
dependencies
2022-10-31 21:38:07 +05:30
Ashish Gupta
6c0008276b
Fix UI :- fix the window resizing issue in Service page on hover (#8459)
* Fix the window resizing issue in Service page on hover

* fix cypress issue
2022-10-31 21:09:21 +05:30
Shailesh Parmar
a6a02a9e55
UI: Added expand all column button and full screen view for lineage (#8425)
* UI: Added toggle button to expand and collapse column view in lineage

* added full screen view support for lineage

* added fullscreen lineage support for dashboard, pipeline and topic entity

* added full screen icon and support for mlmodal

* updated fitview and full-screen icon

* added primary color for the icons

* addressing comments

* changed constant to upper case

* removed un-necessary spaces and updated border color as per mack

* removed commented code

* fixed failing unit test
2022-10-31 20:12:29 +05:30