1565 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
95f0f4d9e1
Fix column name indexes (#8990) 2022-11-23 19:08:44 -08:00
Nahuel
5ef7902e19
Bug when patching an entity with SM enabled (#8972)
* Bug when patching an entity with SM enabled

* Fix failing tests
2022-11-23 13:24:58 +00:00
Sriharsha Chintalapani
8a95ec1329
Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer (#8959)
* Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer

* Refactor EmailUtil initialization

* Fix config values

* Fix smtpsettings check

* Fix uninitialize EmailUtil

* remove unused USER_REPOSITORY

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2022-11-23 08:54:20 +00:00
Teddy
14b9c1418d
Updated dataType -> chartDataType (#8956)
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-22 18:11:56 +00:00
Mohit Yadav
67cd61cf79
Add orderby for listing KpiResult Times Series (#8942)
* Add orderby for listing KpiResult Times Series

* Add order by param for kpi results

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-22 16:48:47 +00:00
Ashish Gupta
36f27e947d
UI : Mask the JWT token in Metadata service (#8842)
* Mask the Jwt token in Metadata service

* minor fix

* fix the icon alignment in Add Ingestion button

* disable the test connection for metadata service OpenMetadata type

* change the css name

* fix unit test issue

* Fix Auth Provider

* Fix add ingestion dropdown icon alignment

* Fix formatting

* Do not encryt JWT auth mechanism with secrets manager

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2022-11-22 14:17:40 +00:00
Pere Miquel Brull
f3ac6f53e6
Rename datatype (#8947) 2022-11-22 10:47:17 +00:00
Sriharsha Chintalapani
4610478688
Fix #8933: Add fixes to initSeedData from 0.12 upgrade (#8934)
* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade
2022-11-21 22:50:33 -08:00
Nahuel
5151db4ae0
Fix bug in secrets manager with SSO configuration (#8932)
* Fix bug in secrets manager with SSO configuration

* Remove comment from imports

* Sort imports

* Add missing decrypt when updating

* Add minor change
2022-11-21 22:37:20 +01:00
Nahuel
8408c32d01
Fix: Bug when deploying ingestion pipeline (#8916) 2022-11-21 11:17:34 +01:00
Mohit Yadav
8e57787ad4
Fix Url For Email Verification etc (#8904)
* Fix Url For Email Verification etc

* yaml fix
2022-11-21 09:01:05 +00:00
Sriharsha Chintalapani
397a322135
Fix #8676: Getting all entity data along with deleted one even if show deleted is true (#8827) 2022-11-18 21:57:51 -08:00
Suresh Srinivas
d758a542aa
Fix upgrade issues with new bot role feature (#8895) 2022-11-18 11:32:26 -08:00
Mohit Yadav
884b747485
Added Task Types for DataInsight and ES Reindex (#8882) 2022-11-18 15:07:13 +00:00
Mohit Yadav
e966bb343b
Refresh token Changes (#8878) 2022-11-18 17:59:32 +05:30
Nahuel
b14a3bc6ca
Review sensitive data not marked as password in the JSON schemas (#8818) 2022-11-18 11:35:08 +01:00
Suresh Srinivas
b3472b03ea
Fixes #2254 Tag usage count is incorrect when a tag name is a prefix of another tag name (#8826) 2022-11-16 17:57:54 -08:00
Sriharsha Chintalapani
422eccf6e7
Fix #8738: Improve Search Relevancy (#8739) 2022-11-16 15:43:41 -08:00
Suresh Srinivas
45d45aab70
Fixes #8821 Inherit ownership from parent container when creating children (#8824) 2022-11-16 13:59:45 -08:00
Nahuel
1bde821e9a
On init the auth provider 'openmetadata' must generate a JWT token if not present on config (#8815)
* On init the auth provider 'openmetadata' must generate a JWT token if not present on config

* Address PR comments
2022-11-16 16:53:01 +01:00
Suresh Srinivas
6a0b89c27e
Fixes #8783 Support moving glossary terms in a nested fashion (#8784) 2022-11-15 19:39:25 -08:00
Suresh Srinivas
ea8cf999ad
Fixes #8701 Unable to add condition for matchAnyTags condition policy rule expression (#8782) 2022-11-15 17:20:18 -08:00
Suresh Srinivas
2edaec4155
Fixes #7569 - Adding Reviewers at the root of the Glossary should be applied to all the children of Glossary (#8740) 2022-11-15 12:52:15 -08:00
Mohit Yadav
771348a518
Fixes Backend : KPI patch API is not working #8774 (#8776)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

* Data Insight Index should be created on the server start, if not exist

* checkstyle fix

* Fixes Backend : KPI patch API is not working #8774

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-15 20:14:36 +05:30
Mohit Yadav
2e04ff24f9
Fixes the index not found issue on data insight page in case workflow is not run or created (#8770)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

* Data Insight Index should be created on the server start, if not exist

* checkstyle fix

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-15 18:02:03 +05:30
Nahuel
f57fe1d507
Fix#8577: Ingestion Pipelines sensitive passwords fields are stored in secrets store (#8725)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Ingestion pipeline sensitive passwords fields are stored in secrets store

* Fix Java style

* Add update for ingestion pipelines on start up

* Add pylint exception

* Fix broken test

* Update UI references
2022-11-15 06:34:49 +01:00
Teddy
3dbaa69978
Data insight workflow (#8729) 2022-11-15 05:44:25 +01:00
Suresh Srinivas
6a0e326f59
Fixes #7524 Backend: Allow users to rename the Glossary name and Glossary term names (#8734) 2022-11-14 14:09:00 -08:00
Suresh Srinivas
9571326d92
Fixes #8730 Backend - Support renaming tag category and tag names (#8731) 2022-11-14 10:15:55 -08:00
Nahuel
83003a42da
Fix#8577: Bots sensitive passwords fields are stored in secrets store (#8720)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Fix Java style
2022-11-14 16:46:05 +01:00
Mohit Yadav
db0215f964
Mapping from kpi to dichart(One to one) (#8707)
* Mapping from kpi to dichart(One to one)

* Mapping from kpi to dichart(One to one)

* Removed second tests creating KPI

* Fix some ui improve as well

* review comment changed function name

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-14 19:44:01 +05:30
Mohit Yadav
c88aac896b
Change GET APIs to PUT apis (#8693)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Change GET APIs to PUT apis #8687

* change request type for registration

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-11-14 19:25:26 +05:30
Nahuel
e5abdc8c5c
Fix#8577: Services sensitive passwords fields are stored in secrets store (#8671)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test
2022-11-14 13:48:50 +01:00
Sriharsha Chintalapani
895a123f81
Add restore method for metadata resource (#8695) 2022-11-13 23:18:28 -08:00
Sriharsha Chintalapani
9e34cb8440
Fix #8416: Restore Entities after soft delete with all it's old data (#8635) 2022-11-13 10:16:01 -08:00
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Suresh Srinivas
6306c9ac8d
Fixes #8688 Enforce mutuallyExclusive tag labels (#8689) 2022-11-12 18:44:17 -08:00
Suresh Srinivas
1db6f1c8a0
Simplify EntityRepository store method (#8690) 2022-11-12 14:11:30 -08:00
Suresh Srinivas
4d15696d71
Fixes #8506 Build tag and glossary term cache and use it instead of database lookups in list operations (#8686) 2022-11-11 14:51:41 -08:00
Mohit Yadav
4dc24b904f
python fix circular import (#8670)
python fix circular import (#8670)
2022-11-11 17:03:43 +01:00
Nahuel
91d0460b27
Fix#8577: Refactor part of the secrets manager implementation (#8617)
* Removed part of the secrets manager implementation in the server side

* Removed part of the secrets manager implementation in the openmetadata python library side

* Remove deprecated test

* Address pylint checks

* Address new pylint checks

* Address PR comments

* Fix import on airflows apis

* Clear singleton instances for running Ometa secrets manager test
2022-11-11 09:59:15 +01:00
Mohit Yadav
2dbd43a589
Added MetadataServices for creating DataInsight and ElasticSearch Reindex (#8565)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix
2022-11-11 13:16:54 +05:30
Suresh Srinivas
86c3ae30f1
Fixes #8596 Introduce mutually exclusive tags and glossary terms (#8597) 2022-11-10 16:47:21 -08:00
Mohit Yadav
b4e5f6ec13
Emailing Task and Test Notification (#8626)
* Emailing Task Notification [WIP]

* Emailing Test Result to Owners of table in case it is enabled
2022-11-10 14:22:44 +05:30
Mohit Yadav
5bd4e56b3f
Feat kpis (#8584)
* Added Kpi Resource

* Fix typo

* Fixed failing test

* Review Suggestions
2022-11-09 13:06:13 +05:30
Teddy
dcd0bbb566
Fixes 8470 -- Implements ES aggregation for web analytic data (#8566)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* added domo to test subpackage

* cleaned up branch by removing commit from issue-8353 that were not merged in main

* Added web analytics data refinement

* Added get_status function

* Added from __futur__ for typing

* Added dailyActiveUsers aggregation

* Added page views entities aggregation and active users aggregation
2022-11-08 17:25:31 +01:00
Suresh Srinivas
292672a970
Clean up code warnings (#8532) 2022-11-04 11:24:46 -07:00
Mayur Singal
a49c261cbe
Add Queued Status in Ingestion Pipelines (#8529) 2022-11-04 11:19:50 +05:30
Shailesh Parmar
0f0489a7d4
Feat: Added pipeline as edge from ui (#8503)
* Feat: Added pipeline as edge from ui

* fixed failing unit test

* removed pipeline

* added unit test for util function
2022-11-03 17:46:49 +05:30
Teddy
f4cc2b57a7
Fixes #8353 - Implement Aggregation Endpoint for dataInsight (#8464)
* Moved webanalytics type in its own folder

* Added data insight chart api endpoint

* Jave formatting

* Added resource descriptor

* Added metadata entity endpoint

* Added aggregation endpoint for dataInsight

* Fix tag name

* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight

* Fix pageViewEvent import issue

* Changed dataType to PERCENTAGE and NUMBER

* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-03 14:51:14 +05:30