5980 Commits

Author SHA1 Message Date
Pere Miquel Brull
11ad9192a4
Fix CI condition for gatekeeping (#8769) 2022-11-15 17:37:30 +01:00
Teddy
4ccdce50e0
Fix data insight bugs (#8761)
* - made ES ingestion of data inisght idempotent for the daily execution
- added web analytic timedelta to 1 day to fecth data from the previous day

* Added time utils

* fixed timezone
2022-11-15 16:10:30 +01:00
Ayush Shah
5be0f8ee76
Dl Profiler (#8694)
* DQ commit

* Add DL Profiler

* Fix Ingestion and Profliing pylint checks

* Fix Tests

* PyFormat files

* Fix Tests

* Resolve Comments

* Fix Tests and Format Files

* Resolve Comments

* Fix Pylint and Code smells

* Resolve Comments

* Fix S3 parquet

* Fix Metrics Code Smell
2022-11-15 16:01:10 +01:00
Mohit Yadav
771348a518
Fixes Backend : KPI patch API is not working #8774 (#8776)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

* Data Insight Index should be created on the server start, if not exist

* checkstyle fix

* Fixes Backend : KPI patch API is not working #8774

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-15 20:14:36 +05:30
Mohit Yadav
2e04ff24f9
Fixes the index not found issue on data insight page in case workflow is not run or created (#8770)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

* Data Insight Index should be created on the server start, if not exist

* checkstyle fix

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-15 18:02:03 +05:30
Sachin Chaurasiya
964cc4e0a5
UI : Update the navbar items with new placeholder text (#8756) 2022-11-15 17:04:02 +05:30
Shailesh Parmar
6d089d9e31
Fixed Selection option for new node is not visible (#8751) 2022-11-15 16:23:41 +05:30
Akash Jain
fb8cfca6af
Run Maven CI on JSON Schema Changes (#8748) 2022-11-15 16:06:25 +05:30
Parth Panchal
f77908d8b3
reverting the version change (#8762) 2022-11-15 15:54:08 +05:30
Parth Panchal
678e4e2c36
updated feign verison in openmetadata-java-client (#8758) 2022-11-15 15:31:05 +05:30
Sachin Chaurasiya
7b9fecc369
Fix Delete API failure issue (#8747) 2022-11-15 12:20:54 +05:30
Nahuel
f57fe1d507
Fix#8577: Ingestion Pipelines sensitive passwords fields are stored in secrets store (#8725)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Ingestion pipeline sensitive passwords fields are stored in secrets store

* Fix Java style

* Add update for ingestion pipelines on start up

* Add pylint exception

* Fix broken test

* Update UI references
2022-11-15 06:34:49 +01:00
Teddy
3dbaa69978
Data insight workflow (#8729) 2022-11-15 05:44:25 +01:00
Sriharsha Chintalapani
cbc18de6cb
Fix OM_DATABASE env variable name (#8743) 2022-11-15 09:10:21 +05:30
Suresh Srinivas
6a0e326f59
Fixes #7524 Backend: Allow users to rename the Glossary name and Glossary term names (#8734) 2022-11-14 14:09:00 -08:00
Suresh Srinivas
9571326d92
Fixes #8730 Backend - Support renaming tag category and tag names (#8731) 2022-11-14 10:15:55 -08:00
Pere Miquel Brull
f33003485e
ES reindex Airflow workflow (#8723)
* Added support for 'Metadata Service' connectors

* Fixed failing unit tests

* Removed delete button for 'Metadata Service' connector of type OpenMetadataServer

* Code optimization for SelectServiceType component

* Fixed errors arrived due to backend changes related to OpenMetadata Services

* init reindex

* Added additional step for adding Metadata to ES configs while creating ingestion pipeline for Metadata Service

* Add ES reindex

* Add ES reindex

* Format

* Format

* Rename service

* Pick service name from IngestionPipeline

* fix ui conflicts

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-11-14 18:59:56 +01:00
Ashish Gupta
b04485a5bc
UI : Added Password viewer on DBT fields (#8724)
* Added Password viewer on DBT fields

* Added Password viewer on services fields
2022-11-14 23:19:02 +05:30
Sachin Chaurasiya
ce87feabcd
Feat (#8608) UI : Add KPIs support for data insight (#8645)
* Feat  (#8608)UI : Add KPIs support for data insight

* Feat : Support Add KPI

* Fix label case

* Feat : Support Edit KPI

* Feat : Support Delete KPI

* Doc : change helper text and typos

* Fix : Typescript types and typos

* Change startDate and endDate format

* Add no kpi found logic

* Feat : Add Graph for KpI results

* Fix label

* Add view all kpis button to kpi graph

* Fix unit test

* Add Admin check for KPI Operation

* Add admin check for add kpi operation on kpi list page

* Add o description placeholder if there is no description.

* Add special character check for KPI name

* Fixed tooltip issue for graph

* Add kpiRecords for tooltip

* Add support for KPI latest result

* Address review comments

* Address comments

* Address review comments

* Remove tier from kpi

* Add localisation

* Add localization for tabs

* Skip the test

* Revert "Skip the test"

This reverts commit 4d1f77aedeae90fbd5fc77fdbd029b0b8af69d38.

* Fix unit test
2022-11-14 22:27:25 +05:30
Aniket Katkar
8f8c8c2d70
Added support for 'Metadata Services' connectors (#8679)
* Added support for 'Metadata Service' connectors

* Fixed failing unit tests

* Removed delete button for 'Metadata Service' connector of type OpenMetadataServer

* Code optimization for SelectServiceType component

* Fixed errors arrived due to backend changes related to OpenMetadata Services

* Added additional step for adding Metadata to ES configs while creating ingestion pipeline for Metadata Service

* Updated service-guide constants for additional step information

* Fixed ingestion tabs data not showing for profiler, lineage and usage ingestion schedule steps
2022-11-14 21:56:55 +05:30
Ashish Gupta
ab884836f1
UI :- Added restore option for soft deleted Entities (#8292)
* Added restore option for entity table

* added async await to function as per comments

* changes as per comments

* added interpolation for success and error message

* changes the entities restore endpoint

* added localisation
2022-11-14 21:46:30 +05:30
Ashish Gupta
1f24b4b1b0
UI : Changes the Payload while revoke token in Bot (#8715)
* Changes the Payload while revoke token in Bot

* change request type for registration

* revert the previous changes
2022-11-14 21:45:14 +05:30
Chirag Madlani
3b4c5d4e85
fix(ui): update default status to empty instead queued (#8716) 2022-11-14 21:30:16 +05:30
Nahuel
83003a42da
Fix#8577: Bots sensitive passwords fields are stored in secrets store (#8720)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Fix Java style
2022-11-14 16:46:05 +01:00
Shailesh Parmar
4faafe4235
UI Fixed Deleting the Tier tag category causes UI errors #5849 (#8703)
* UI Fixed Deleting the Tier tag category causes UI errors #5849

* fixed failing test

* updated logic for restricting system tags deletion
2022-11-14 19:50:36 +05:30
Mohit Yadav
db0215f964
Mapping from kpi to dichart(One to one) (#8707)
* Mapping from kpi to dichart(One to one)

* Mapping from kpi to dichart(One to one)

* Removed second tests creating KPI

* Fix some ui improve as well

* review comment changed function name

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-14 19:44:01 +05:30
Mohit Yadav
c88aac896b
Change GET APIs to PUT apis (#8693)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-14 19:25:26 +05:30
Nahuel
e5abdc8c5c
Fix#8577: Services sensitive passwords fields are stored in secrets store (#8671)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test
2022-11-14 13:48:50 +01:00
Shailesh Parmar
92781d7949
Updated cypress code and fixed flaky cypress (#8666)
* Updated cypress code and fixed flaky cypress

* miner fix

* Fixed cypress issue

* fixed localstorage issue in custom property
2022-11-14 18:09:38 +05:30
Chirag Madlani
85e1cd6456
chore(ui): explore page filter updates (#8580)
* chore(ui): explore page filter updates

* make filters working

* update advance search styling

* fix tests
2022-11-14 17:46:52 +05:30
Shailesh Parmar
c8340217e9
UI: Fixed UI | Table Detail pane on the Lineage tab doesn't show the column count #6947 (#8711) 2022-11-14 17:07:09 +05:30
Shailesh Parmar
1abd869adc
Fixed Lineage SQL query only visible on click #8628 (#8697) 2022-11-14 16:54:42 +05:30
Onkar Ravgan
39afe9cd4a
Added lineage workflow docs (#8710) 2022-11-14 15:43:45 +05:30
Sachin Chaurasiya
bcbca7df75
Fix : Types import issue for JwtAuth and SsoServiceType (#8702) 2022-11-14 14:15:17 +05:30
Teddy
4212663765
Removed User and Test Suite (#8699) 2022-11-14 09:05:03 +01:00
Mayur Singal
18cd1c99ca
Add queries in sample data for lineage (#8674) 2022-11-14 13:11:16 +05:30
Mayur Singal
01bc9f1cfe
Fix PyMSSQL Version (#8696) 2022-11-14 08:40:41 +01:00
Sriharsha Chintalapani
895a123f81
Add restore method for metadata resource (#8695) 2022-11-13 23:18:28 -08:00
Mayur Singal
c3fd972813
Docs #8501: Added 0.12 to 0.13 upgrade docs (#8502) 2022-11-14 12:38:58 +05:30
Yandisa Ntlahla
e9a120dafa
small letter was corrected on features (#8691) 2022-11-14 07:45:57 +01:00
Sriharsha Chintalapani
9e34cb8440
Fix #8416: Restore Entities after soft delete with all it's old data (#8635) 2022-11-13 10:16:01 -08:00
Milan Bariya
ebfb872e16
Fix: Filter Datalake empty files (#8677) 2022-11-13 22:09:29 +05:30
Mohit Yadav
a20945e13f
Added pipelineTypes (#8692)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix

* circular import fix

* circular import fix

* Fix FileNames Issue causing pytest failures and mismatch in connection name due to Java Class

* add dataInsight Pipeline

* Add DataInsight + elasticSearchReindexing Pipeline Types
2022-11-13 21:41:41 +05:30
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Suresh Srinivas
6306c9ac8d
Fixes #8688 Enforce mutuallyExclusive tag labels (#8689) 2022-11-12 18:44:17 -08:00
Suresh Srinivas
1db6f1c8a0
Simplify EntityRepository store method (#8690) 2022-11-12 14:11:30 -08:00
Shailesh Parmar
9bd0dbb67d
Fixed Add Partition Setting in UI for Profiler #8624 (#8673)
* Fixed Add Partition Setting in UI for Profiler #8624

* addressing comments
2022-11-12 19:23:52 +05:30
Suresh Srinivas
4d15696d71
Fixes #8506 Build tag and glossary term cache and use it instead of database lookups in list operations (#8686) 2022-11-11 14:51:41 -08:00
Aniket Katkar
072e190dd3
Fix(UI)#8659: Fixed issue with wrong link for custom attributes in activity feed (#8668)
* Fixed issue with wrong link for custom attributes in activity feed

* Function to get customAttributes path removed and used already existing function
2022-11-12 00:30:49 +05:30
Aniket Katkar
5972570f61
fixed tour flow failing on step 4 (#8667) 2022-11-12 00:28:57 +05:30