2200 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
e42e7e41d8
remove norms for ES index mappings (#9334) 2022-12-16 07:43:13 +00:00
Suresh Srinivas
8c08cf73b5
Fixes #9290 Policies Don't Prevent Custom Properties Modification by Object Owner (#9327) 2022-12-15 20:37:51 -08:00
Nahuel
e998ecc407
Deprecate configurations for auth provider configuration on Airflow (#8896)
* Deprecate configurations for auth provider configuration on Airflow

* Fix code after merging

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2022-12-15 12:28:46 -08:00
Mohit Yadav
ce51009eb7
Fixes for Alerts (#9316)
* Fixes for Alerts

* Fix addTestResult and Delete to updatedBy
2022-12-15 16:43:44 +00:00
Mohit Yadav
bfdc32c8c1
Alerts (#9267)
* Schema for Alerts #9248

* 1. Api for alerts
2. Api for alertAction

API for Alert and AlertAction #9266

* missing file

* fix ui failures

* Added Api to give function parameter type and additional Context for UI

* Added default Triggers in Alerts

* checkstyle fix

* docs update

* function names updated

* added timestamp for alert status update

* receiver should be unique in json schema and alerts publishers

* updated bootstrap filters

* updatated review comments

* added functions to match eventType for entities

* added migrations for alerts

* added alert config in alertACtionConfig

* Fix issue in sending mails

* removed commented part

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-12-15 00:14:10 +05:30
Ayush Shah
a6ae9fd11a
Add Test Suite Implementation for Datalake (#9235) 2022-12-14 21:14:51 +05:30
Sriharsha Chintalapani
38074f763b
Fix #8509: Add schema fields (#9209)
* Fix #8509: Add schema fields

* Fix #4675: Ingestion deployment from UI is broken

* Added sample data for topics

* Fixed pytests

* Address comments

* Refactored sampledata according to new schema

* Added return type

* Feat(ui)  : Add support for Avro editor (#9224)

* Feat(ui)  : Add support for Avro editor

* chore : add mock data for nested fields

* style: add group and opacity css

* add schema fields component to topic details and unit test

* Add locale keys

* Add support for edit description.

* refactor: expandableConfig

* test: add unit test for util method

* chore : make changes according to the schema change

* test : fix unit test and add new mock data

* chore : rename files

* Add row key

* chore : add default value for tags

* chore : update util method

* chore : add support for editing field tags

* chore : rename util files

* test : add unit test

* add comments

* addressing comments

* Address comments

* Added avro requirments

* Added requirement versions

* fixed versions

* protobuf version fix

* chore : rename util test file

* Fixed Dataype

* test: add unit test for schema component

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-12-14 19:56:37 +05:30
Teddy
d1a739ec55
Fixes #9025 -- Added deletion of WebAnalytics events in dataInsight Workflow (#9208) 2022-12-13 11:43:29 +01:00
Teddy
387cd570f7
Fixes 9192 - Add entity link in response (#9239)
* staging commit

* updated terms to french

* fix(dataInsight): updated ES response to get entityType and total non tiered entities

* fix(dataInsight): removed fields=*

* fix(dataInsight): Added entity migration

* cleaned up branch

* feat: Added entity URL for most viewed entity

* feat(dataInsight): Added href to entity

* feat(DataInsight): Added backend logic for entity href

* Fix conflict resolving typos

* Update openmetadata-service/src/main/resources/json/data/dataInsight/mostViewedEntities.json

Co-authored-by: Nahuel <nahuel@getcollate.io>

* fix: addressed comments from PR review

Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-12-13 10:39:09 +00:00
Pere Miquel Brull
c75ba751b7
Fix #9116 & #8284 - Clean tableau source, fix ownership, add description and SSL verification (#9241)
Fix #9116 & #8284 - Clean tableau source, fix ownership, add description and SSL verification (#9241)
2022-12-13 06:36:55 +01:00
Ayush Shah
6425716837
Remove Test case URL encoding (#9247) 2022-12-12 08:55:30 +00:00
Sachin Chaurasiya
0aed07aeb8
Fix(#9226): do not show error for public IP resolution (#9230)
* Fix(#9226): do not show error for public IP resolution

* Add message when failure happens

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-12-10 11:34:30 +05:30
Sriharsha Chintalapani
a12f42d85e
Fix #9218: Fix glossary and glossary term deletion updates to ES (#9225)
* Fix #9218: Fix glossary and glossary term deletion updates to ES

* Fix stylecheck
2022-12-09 21:00:49 -08:00
Teddy
4a5cb870ec
Fixes #9192 - Update ES response for DI (#9221)
* staging commit

* updated terms to french

* fix(dataInsight): updated ES response to get entityType and total non tiered entities

* fix(dataInsight): removed fields=*

* fix(dataInsight): Added entity migration

* cleaned up branch
2022-12-09 18:53:17 -08:00
Pere Miquel Brull
ba9109d318
Fix #9044 - Add prometheus event monitor (#9176)
* Add prometheus event monitor

* Format

* Format
2022-12-09 11:51:39 +01:00
07Himank
3053d57f79
Solve issues related to actitivity feed (#9199)
* solved Activity feed related issue

* solved Activity feed related issue

* Addressing comments

* test case related changes

* test case related changes

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2022-12-09 12:30:45 +05:30
Sriharsha Chintalapani
906b1b116f
Fix #9156: database service count not showing up in landing page (#9157) 2022-12-07 07:38:56 -08:00
Teddy
ac77f33b08
Fixes #7447 -- Add freshness metrics to profiler (#9159)
* refactor(profiler): integrated getter func.

Removed metric getter function from their own file.
Added metric getter to their own interface classs.
created dispatch by value methdo to dispatch metric getter func.

* feature(profiler): added systemProfiler schema

* feat(profiler): workflow fresh. & snflk impl.

* feat(profiler): freshness endpoint for put and get

* feat(profiler): added system met. for redshift

* feat(profiler): freshness met. for bigquery

* fix(profiler): keyword not found in func

* feat(profiler): Added sample data for freshness

* fix(profiler): fetch previous day for BQ

* fix(profiler): sonar + data fetching logic

* fix: typo in SystemMetric Class

* fix: linting

* fix: extracted out EntityList class into models.py
2022-12-07 14:33:30 +01:00
Sriharsha Chintalapani
26a4176851
Fix #8083: Follow-up fix to add glossary terms (#9191) 2022-12-07 12:03:38 +01:00
Sriharsha Chintalapani
25449001ca
Fix #9040: Remove fields such as tableQueries, tableProfile, tests, sample data as part of table fields (#9041) 2022-12-06 21:07:04 -08:00
Suresh Srinivas
16d97d6f96
Fix typos in JSON schemas and follow standard naming conventions (#9183) 2022-12-06 20:50:34 -08:00
07Himank
b5b29c93f5
Track new primary key (#9145) 2022-12-06 09:13:07 +05:30
Sriharsha Chintalapani
2baf6873b6
Update AbstractEventPublisher.java (#8828)
Co-authored-by: Rounak-28 <95576871+Rounak-28@users.noreply.github.com>
2022-12-05 11:27:36 -08:00
Pere Miquel Brull
58f3c01470
Fix #7056 - Automatic lineage from ML Model to ML Feature Data Source (#9113) 2022-12-05 16:43:03 +05:30
Sriharsha Chintalapani
14d82ee7b2
Fix #6463: Add support for default suggestions for suggestion API (#9090) 2022-12-02 10:31:37 -08:00
Sriharsha Chintalapani
db91a2e1d5
Fix #8323: GenerateToken can overwrite any relations that user may have (#9091)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2022-12-01 15:21:32 +05:30
Sriharsha Chintalapani
0050243479
Fix #8083: Adding a child term to a parent term in glossary produces error (#9088)
* Fix #8083: Adding a child term to a parent term in glossary produces error

* checkstyle fix

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2022-12-01 14:48:55 +05:30
Sriharsha Chintalapani
e06935d3fa
Fix #8579: Add unit test to cover the cases where columnProfile is null or not being sent by client (#9038)
* Fix #8171: add test to make sure column profile can be sent as null or empty, it shouldn't break addProfileData API

* Fix #8171: add test to make sure column profile can be sent as null or empty, it shouldn't break addProfileData API
2022-11-30 08:30:12 +01:00
Sriharsha Chintalapani
6393ed03dc
Fix #8991: Index fully qualified table name for search (#9035)
* Fix #8991: Index fully qualified table name for search

* Fix #8991: Index fully qualified table name for search
2022-11-29 21:55:05 -08:00
Teddy
80043e329e
Add micrometer page view metrics (#9062) 2022-11-29 19:37:29 +01:00
Teddy
3cad959e44
Fixes #6760 -- Implements REGEX for regex test (#9033)
feat(testCase): impelemented regex logic for test suite
2022-11-29 13:00:28 +01:00
Sriharsha Chintalapani
ce3ab68932
Fix #9042: query is being indexed causing huge payload returned (#9043)
* Fix #9042: query is being indexed causing huge payload returned

* Fix #9042: query is being indexed causing huge payload returned
2022-11-29 12:54:07 +05:30
Pere Miquel Brull
dda8f8054e
Fix #8571 - Log IngestionPipeline status change to CloudWatch (#9013)
* Prep monitoring skeleton

* Fix naming

* Push Ingestion Pipeline status to cloudwatch

* Review comments and tests

* import

* Remove singleton object

* Format
2022-11-28 17:45:18 +01:00
07Himank
d07f1a9d89
kpi resource test task done (#9006)
* kpi rsource test task done

* addressing comments

* addressing comments

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2022-11-28 14:53:04 +05:30
Sriharsha Chintalapani
fb6b1574be
Check old query users (#8998) 2022-11-24 08:03:16 +00:00
Sriharsha Chintalapani
95f0f4d9e1
Fix column name indexes (#8990) 2022-11-23 19:08:44 -08:00
Nahuel
5ef7902e19
Bug when patching an entity with SM enabled (#8972)
* Bug when patching an entity with SM enabled

* Fix failing tests
2022-11-23 13:24:58 +00:00
Sriharsha Chintalapani
8a95ec1329
Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer (#8959)
* Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer

* Refactor EmailUtil initialization

* Fix config values

* Fix smtpsettings check

* Fix uninitialize EmailUtil

* remove unused USER_REPOSITORY

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2022-11-23 08:54:20 +00:00
Teddy
14b9c1418d
Updated dataType -> chartDataType (#8956)
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-22 18:11:56 +00:00
Mohit Yadav
67cd61cf79
Add orderby for listing KpiResult Times Series (#8942)
* Add orderby for listing KpiResult Times Series

* Add order by param for kpi results

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-11-22 16:48:47 +00:00
Ashish Gupta
36f27e947d
UI : Mask the JWT token in Metadata service (#8842)
* Mask the Jwt token in Metadata service

* minor fix

* fix the icon alignment in Add Ingestion button

* disable the test connection for metadata service OpenMetadata type

* change the css name

* fix unit test issue

* Fix Auth Provider

* Fix add ingestion dropdown icon alignment

* Fix formatting

* Do not encryt JWT auth mechanism with secrets manager

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2022-11-22 14:17:40 +00:00
Pere Miquel Brull
f3ac6f53e6
Rename datatype (#8947) 2022-11-22 10:47:17 +00:00
Sriharsha Chintalapani
4610478688
Fix #8933: Add fixes to initSeedData from 0.12 upgrade (#8934)
* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade

* Fix #8933: Add fixes to initSeedData from 0.12 upgrade
2022-11-21 22:50:33 -08:00
Nahuel
5151db4ae0
Fix bug in secrets manager with SSO configuration (#8932)
* Fix bug in secrets manager with SSO configuration

* Remove comment from imports

* Sort imports

* Add missing decrypt when updating

* Add minor change
2022-11-21 22:37:20 +01:00
Nahuel
8408c32d01
Fix: Bug when deploying ingestion pipeline (#8916) 2022-11-21 11:17:34 +01:00
Mohit Yadav
8e57787ad4
Fix Url For Email Verification etc (#8904)
* Fix Url For Email Verification etc

* yaml fix
2022-11-21 09:01:05 +00:00
Sriharsha Chintalapani
397a322135
Fix #8676: Getting all entity data along with deleted one even if show deleted is true (#8827) 2022-11-18 21:57:51 -08:00
Suresh Srinivas
d758a542aa
Fix upgrade issues with new bot role feature (#8895) 2022-11-18 11:32:26 -08:00
Mohit Yadav
884b747485
Added Task Types for DataInsight and ES Reindex (#8882) 2022-11-18 15:07:13 +00:00
Mohit Yadav
e966bb343b
Refresh token Changes (#8878) 2022-11-18 17:59:32 +05:30