4912 Commits

Author SHA1 Message Date
Sachin Chaurasiya
ce87feabcd
Feat (#8608) UI : Add KPIs support for data insight (#8645)
* Feat  (#8608)UI : Add KPIs support for data insight

* Feat : Support Add KPI

* Fix label case

* Feat : Support Edit KPI

* Feat : Support Delete KPI

* Doc : change helper text and typos

* Fix : Typescript types and typos

* Change startDate and endDate format

* Add no kpi found logic

* Feat : Add Graph for KpI results

* Fix label

* Add view all kpis button to kpi graph

* Fix unit test

* Add Admin check for KPI Operation

* Add admin check for add kpi operation on kpi list page

* Add o description placeholder if there is no description.

* Add special character check for KPI name

* Fixed tooltip issue for graph

* Add kpiRecords for tooltip

* Add support for KPI latest result

* Address review comments

* Address comments

* Address review comments

* Remove tier from kpi

* Add localisation

* Add localization for tabs

* Skip the test

* Revert "Skip the test"

This reverts commit 4d1f77aedeae90fbd5fc77fdbd029b0b8af69d38.

* Fix unit test
2022-11-14 22:27:25 +05:30
Aniket Katkar
8f8c8c2d70
Added support for 'Metadata Services' connectors (#8679)
* Added support for 'Metadata Service' connectors

* Fixed failing unit tests

* Removed delete button for 'Metadata Service' connector of type OpenMetadataServer

* Code optimization for SelectServiceType component

* Fixed errors arrived due to backend changes related to OpenMetadata Services

* Added additional step for adding Metadata to ES configs while creating ingestion pipeline for Metadata Service

* Updated service-guide constants for additional step information

* Fixed ingestion tabs data not showing for profiler, lineage and usage ingestion schedule steps
2022-11-14 21:56:55 +05:30
Ashish Gupta
ab884836f1
UI :- Added restore option for soft deleted Entities (#8292)
* Added restore option for entity table

* added async await to function as per comments

* changes as per comments

* added interpolation for success and error message

* changes the entities restore endpoint

* added localisation
2022-11-14 21:46:30 +05:30
Ashish Gupta
1f24b4b1b0
UI : Changes the Payload while revoke token in Bot (#8715)
* Changes the Payload while revoke token in Bot

* change request type for registration

* revert the previous changes
2022-11-14 21:45:14 +05:30
Chirag Madlani
3b4c5d4e85
fix(ui): update default status to empty instead queued (#8716) 2022-11-14 21:30:16 +05:30
Nahuel
83003a42da
Fix#8577: Bots sensitive passwords fields are stored in secrets store (#8720)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Fix Java style
2022-11-14 16:46:05 +01:00
Shailesh Parmar
4faafe4235
UI Fixed Deleting the Tier tag category causes UI errors #5849 (#8703)
* UI Fixed Deleting the Tier tag category causes UI errors #5849

* fixed failing test

* updated logic for restricting system tags deletion
2022-11-14 19:50:36 +05:30
Mohit Yadav
db0215f964
Mapping from kpi to dichart(One to one) (#8707)
* Mapping from kpi to dichart(One to one)

* Mapping from kpi to dichart(One to one)

* Removed second tests creating KPI

* Fix some ui improve as well

* review comment changed function name

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-14 19:44:01 +05:30
Mohit Yadav
c88aac896b
Change GET APIs to PUT apis (#8693)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-14 19:25:26 +05:30
Nahuel
e5abdc8c5c
Fix#8577: Services sensitive passwords fields are stored in secrets store (#8671)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test
2022-11-14 13:48:50 +01:00
Shailesh Parmar
92781d7949
Updated cypress code and fixed flaky cypress (#8666)
* Updated cypress code and fixed flaky cypress

* miner fix

* Fixed cypress issue

* fixed localstorage issue in custom property
2022-11-14 18:09:38 +05:30
Chirag Madlani
85e1cd6456
chore(ui): explore page filter updates (#8580)
* chore(ui): explore page filter updates

* make filters working

* update advance search styling

* fix tests
2022-11-14 17:46:52 +05:30
Shailesh Parmar
c8340217e9
UI: Fixed UI | Table Detail pane on the Lineage tab doesn't show the column count #6947 (#8711) 2022-11-14 17:07:09 +05:30
Shailesh Parmar
1abd869adc
Fixed Lineage SQL query only visible on click #8628 (#8697) 2022-11-14 16:54:42 +05:30
Onkar Ravgan
39afe9cd4a
Added lineage workflow docs (#8710) 2022-11-14 15:43:45 +05:30
Sachin Chaurasiya
bcbca7df75
Fix : Types import issue for JwtAuth and SsoServiceType (#8702) 2022-11-14 14:15:17 +05:30
Teddy
4212663765
Removed User and Test Suite (#8699) 2022-11-14 09:05:03 +01:00
Mayur Singal
18cd1c99ca
Add queries in sample data for lineage (#8674) 2022-11-14 13:11:16 +05:30
Mayur Singal
01bc9f1cfe
Fix PyMSSQL Version (#8696) 2022-11-14 08:40:41 +01:00
Sriharsha Chintalapani
895a123f81
Add restore method for metadata resource (#8695) 2022-11-13 23:18:28 -08:00
Mayur Singal
c3fd972813
Docs #8501: Added 0.12 to 0.13 upgrade docs (#8502) 2022-11-14 12:38:58 +05:30
Yandisa Ntlahla
e9a120dafa
small letter was corrected on features (#8691) 2022-11-14 07:45:57 +01:00
Sriharsha Chintalapani
9e34cb8440
Fix #8416: Restore Entities after soft delete with all it's old data (#8635) 2022-11-13 10:16:01 -08:00
Milan Bariya
ebfb872e16
Fix: Filter Datalake empty files (#8677) 2022-11-13 22:09:29 +05:30
Mohit Yadav
a20945e13f
Added pipelineTypes (#8692)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix

* circular import fix

* circular import fix

* Fix FileNames Issue causing pytest failures and mismatch in connection name due to Java Class

* add dataInsight Pipeline

* Add DataInsight + elasticSearchReindexing Pipeline Types
2022-11-13 21:41:41 +05:30
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Suresh Srinivas
6306c9ac8d
Fixes #8688 Enforce mutuallyExclusive tag labels (#8689) 2022-11-12 18:44:17 -08:00
Suresh Srinivas
1db6f1c8a0
Simplify EntityRepository store method (#8690) 2022-11-12 14:11:30 -08:00
Shailesh Parmar
9bd0dbb67d
Fixed Add Partition Setting in UI for Profiler #8624 (#8673)
* Fixed Add Partition Setting in UI for Profiler #8624

* addressing comments
2022-11-12 19:23:52 +05:30
Suresh Srinivas
4d15696d71
Fixes #8506 Build tag and glossary term cache and use it instead of database lookups in list operations (#8686) 2022-11-11 14:51:41 -08:00
Aniket Katkar
072e190dd3
Fix(UI)#8659: Fixed issue with wrong link for custom attributes in activity feed (#8668)
* Fixed issue with wrong link for custom attributes in activity feed

* Function to get customAttributes path removed and used already existing function
2022-11-12 00:30:49 +05:30
Aniket Katkar
5972570f61
fixed tour flow failing on step 4 (#8667) 2022-11-12 00:28:57 +05:30
Mohit Yadav
4dc24b904f
python fix circular import (#8670)
python fix circular import (#8670)
2022-11-11 17:03:43 +01:00
NiharDoshi99
6da01b13a9
Changed format for s3 staging (#8632) 2022-11-11 12:15:37 +01:00
Pere Miquel Brull
dae85e92bd
Do not check labels on push (#8672) 2022-11-11 12:13:23 +01:00
Onkar Ravgan
eee3f9ffec
Fix:#8553 Parse Avro/Protobuf/Json schemas (#8654)
* Added topic parsers

* Fixed pylint

* Addressed review comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-11-11 16:35:09 +05:30
Pere Miquel Brull
03c1c005cf
Add Workflow label verification for CI (#8653)
* Add labeler

* Update verify with comment

* Add label verification

* Add label verification

* Update .github/teams.yml
2022-11-11 11:25:59 +01:00
Pere Miquel Brull
ff028a6eb0
Fix Mysql bigint (#8665)
* Fix mysql bigint cast

* Remove upgrade from dockerfiles
2022-11-11 10:12:23 +01:00
Nahuel
91d0460b27
Fix#8577: Refactor part of the secrets manager implementation (#8617)
* Removed part of the secrets manager implementation in the server side

* Removed part of the secrets manager implementation in the openmetadata python library side

* Remove deprecated test

* Address pylint checks

* Address new pylint checks

* Address PR comments

* Fix import on airflows apis

* Clear singleton instances for running Ometa secrets manager test
2022-11-11 09:59:15 +01:00
Mayur Singal
5476879c51
Fix #8651: Fix Hive Table Descriptions (#8652)
* Fix #8651: Fix Hive Table Descriptions

* Removed pandas
2022-11-11 09:57:32 +01:00
Mayur Singal
8c7c08ae5d
Fix py-cli-e2e-tests (#8662) 2022-11-11 08:55:34 +01:00
Mohit Yadav
2dbd43a589
Added MetadataServices for creating DataInsight and ElasticSearch Reindex (#8565)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix
2022-11-11 13:16:54 +05:30
Sachin Chaurasiya
2c430d1c7e
Fix #8642 Session ID is not unique across users (#8660) 2022-11-11 12:05:40 +05:30
Shailesh Parmar
54808a027e
Feat: Added functionality to connect node by dragging and dropping from anywhere on node (#8631)
* Feat: Added functionality to connect node by dragging and dropping from anywhere on node

* fixed rectflow warning

* updated selected node's edge style

* addressing comment
2022-11-11 11:58:10 +05:30
Teddy
9d594efcb5
Fixes #8473 - Implements KPI Workflow (#8657)
* Added KPI workflow logic

* Update ingestion/src/metadata/data_insight/runner/run_result_registry.py

* ran py format

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-11 06:35:33 +01:00
Sam Firke
6ba5f7ec90
cast to bigint to avoid overflow when summing (#8655)
* cast to bigint to avoid overflow when summing

fixes #8430

* Update ingestion/src/metadata/orm_profiler/orm/functions/sum.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-11 06:33:38 +01:00
Suresh Srinivas
86c3ae30f1
Fixes #8596 Introduce mutually exclusive tags and glossary terms (#8597) 2022-11-10 16:47:21 -08:00
Chirag Madlani
d4b2621e9d
fix(ui): pipelineDetails page update (#8582)
* fix(ui): pipelineDetails page update

* fix Lineage and Activity & Task tab UI

* complete ui changes for pipelineDetails

* fix failing tests
add localizations

* fix tree view on execution tab

* fix wrapping for tree nodes

* comment addressed

* added missed localization

* add test ids for tabs

* fix cypress failing for ingestion

* fix missing condition
2022-11-10 21:37:35 +05:30
Sachin Chaurasiya
2e158237ea
Feat #8639 UI : Show charts latest value in data insight overview card and rename datasets to data assets (#8641)
* Fix #8639 UI : Show charts latest value in data insight overview card and rename datasets to data assets

* Add data summary for entities chart

* Add Percentage symbol for Percentage chart

* Add web charts summary data

* Address review comments

* Change active user index
2022-11-10 21:18:49 +05:30
Aniket Katkar
b2e2d9cff3
Worked on UI improvements from #8513 (#8647) 2022-11-10 20:02:57 +05:30