879 Commits

Author SHA1 Message Date
Mohit Yadav
c6110a3bc8
Fix User Startup Email (#14183) 2023-11-30 15:48:50 +05:30
Sriharsha Chintalapani
e11e262945
Minor: Add inheritedFields for list apis response (#14179)
* Minor: Add inheritedFields for list apis response

* Minor: Add inheritedFields for list apis response
2023-11-29 23:18:46 -08:00
Mohit Yadav
25d49900a4
MINOR: Change Default Report to Weekly instead of daily during Server Init (#14173)
* Change Default Report to Weekly

* Reformat Issue
2023-11-30 12:47:54 +05:30
Pere Miquel Brull
21e789b5a6
MINOR - Add Collate resources from classPath jars (#14177)
* MINOR - Add Collate resources from classPath jars

* Fix tests
2023-11-29 18:28:14 +01:00
Teddy
8ff70e31fe
MINOR: fixes ingestion of sample data for custom metrics (#14170)
* fix: updated sample data ingestoon for custom metrics

* style: fix python linting

* style: fix java linting
2023-11-29 17:28:19 +01:00
Pere Miquel Brull
eabca42e82
MINOR - Fix app init details (#14160) 2023-11-29 14:46:37 +01:00
Pere Miquel Brull
27fa5b34bb #13849 - Mention FERNET KEY changes on InvalidServiceConnectionException 2023-11-29 10:58:51 +01:00
chyueyi
b6b337e09a
feat: add support for doris datasource (#14087)
* feat: add support for doris datasource

* fix: fix python style check

* fix: add pydoris dependency

* fix: add pydoris dependency

* fix: py_format_check

* fix: parse error when doris view column is VARCHAR(*), check data length if not digit then return 1

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-11-28 13:57:52 +05:30
karanh37
853a83f8b9
fix: allow config update for external app (#14034)
* fix: allow config update for external app

* Prep config

* Add configs

* fix: call configure app on saving of configurations

* fix: add autocomplete widget for json schema forms

* ORganize configuration handling

* Allow config

* Format

* Fix test

* Prep migrations for allowConfiguration

* TODO

* Add pg migrations

* fix: add allowConfiguration support

* Autotagger

* Update install flow

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-11-27 16:55:33 -08:00
Shin-ichi Hashiba
6ad3b61322
Issue #14117: ElasticSearch index creation error in JP (#14118)
* rename elasticsearch json filename same as english

* change name om_analyzer to om_analyzer_jp
2023-11-27 16:54:59 -08:00
Chirag Madlani
40bf4a4ab3
Revert "Revert "fixes #13387: replaced ReDoc with RapiDoc for better user experience (#13388)" (#14017)" (#14122)
This reverts commit 04fbe8c01448530380c4604f2eee23c6ed3c7859.
2023-11-27 16:50:37 +05:30
Sriharsha Chintalapani
d4fa62b3bb
Issue #14067: DatabaseSchema Restore operation throws error EntityNotFound, if a table that belongs to schema is already restored (#14112)
* Issue #14067: DatabaseSchema Restore operation throws error EntityNotFound, if a table that belongs to schema is already restored

* Issue #14067: DatabaseSchema Restore operation throws error EntityNotFound, if a table that belongs to schema is already restored
2023-11-24 22:45:33 -08:00
Sriharsha Chintalapani
845a2e585e
Minor: Fix maven profiles to run tests for MySQL and Postgres using maven profiles (#14094)
* Fix maven profiles, run the default profile once

* Fix maven profiles, run the default profile once

* Minor: Fix systemPropertyVariables for maven profiles, fixes postgres tests run

* Minor: Fix systemPropertyVariables for maven profiles, fixes postgres tests run
2023-11-23 22:32:55 -08:00
Suresh Srinivas
511c8ec8b7
Use entity cache for lookup (#14062)
* Use entity cache for lookup

* Unnecessary ORDER BY clause while listing relationships
2023-11-21 17:21:57 -08:00
Suresh Srinivas
16e6e9a029
Code cleanup (#14058)
* Remove unnecessary string concatenation

* Remove unnecessary return values from methods

* Remove unnecessarily passing nameColumn to queries as it is always "name"
2023-11-21 07:45:06 -08:00
Suresh Srinivas
0443402812
Update dependencies (#14031) 2023-11-19 19:20:33 -08:00
Suresh Srinivas
c788100687
Code cleanup (#14030) 2023-11-19 17:28:14 -08:00
Suresh Srinivas
c4d6f681c8
Fixes #14006 Validate tag labels before creating/updating an entity (#14027) 2023-11-19 14:15:17 -08:00
07Himank
dbecf6d480
dont log es exceptions while migrate-all (#14019)
* dont log es exceptions while migrate-all

* improvement in message

* checkstyle

* checkstyle

* checkstyle
2023-11-17 17:53:12 +01:00
Shailesh Parmar
efb6c5f221
ui & backend: explore page count was not showing properly (#14013) 2023-11-17 21:48:59 +05:30
Teddy
f3da919329
Feat: Backend Support for Custom Metrics (#13965)
* feat: add backend support for custom metrics

* feat: fix python test
2023-11-17 19:16:35 +05:30
Shailesh Parmar
04fbe8c014
Revert "fixes #13387: replaced ReDoc with RapiDoc for better user experience (#13388)" (#14017)
This reverts commit 0c37986ad60f2396702233b2ad0bcc264922e771.
2023-11-17 14:29:17 +01:00
Mohit Yadav
8abaeb5b3d
Add Test Jar for Collate Testing (#14010)
* Add Test Jar for Collate Testing

* Add Extension Path for Tests
2023-11-17 15:11:48 +05:30
Pere Miquel Brull
6fb3f12675
App Resource - Add /configure endpoint & WAII app definition (#13983)
* App Configuration

* TODO

* Configure App with OM server info

* Remove init

* Rename configs

* Remove extra source
2023-11-17 09:28:11 +01:00
Mohit Yadav
3f8a931e39
Bump Pom Version to 1.3.0-SNAPSHOT (#14008)
* Bump Pom Version to 1.3.0-SNAPSHOT

* chore: Fix Makefile recipe

* fix: Prepare Main Branch for Next Feature Release

* fix: Syntax issue

---------

Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-11-17 11:33:47 +05:30
Suresh Srinivas
5f34bd02d3
Fixes #13595 Consolidate changes by a user in a single session to a single change (#13617)
* getChangeDescription to use entity and update type to decide previous version

* Fixes #13595 - Consolidate changes by a user in a single session to a single change
2023-11-16 18:14:27 -08:00
Suresh Srinivas
11b41a3716
getChangeDescription to use entity and update type to decide previous version (#13991) 2023-11-16 10:11:22 -08:00
Anatoliy Shulika
0c37986ad6
fixes #13387: replaced ReDoc with RapiDoc for better user experience (#13388)
* ISSUE-13387: replaced ReDoc with RapiDoc for better user experience

* fixed specUrl

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-11-16 07:56:38 -08:00
Suresh Srinivas
89e5e6d023
Check change descriptions for updates consistently across the entities (#13990) 2023-11-15 17:04:25 -08:00
Teddy
71ee9ed9fd
fix: prevent PUT operation from ingestion bot to update domain (#13971) 2023-11-14 12:48:10 +01:00
Mohit Yadav
2ae0333551
Fix Email Issues (#13962)
* - Added Unauthenticated Server Emails
- Removed redundant OM_URI
- Add Test Email in SystemResources

* remove default port

* remove fernet
2023-11-14 09:04:53 +05:30
Suresh Srinivas
e367f557a6
Make restoring patch attributes consistent across entities (#13961)
* Make restoring patch attributes consistent across entities

* Fix test failures

* Fix test failures
2023-11-13 16:32:18 -08:00
Mohit Yadav
10d8ec84fe
Logs added for Search Indexing and Stats issue fixed (#13956)
* Logs added for Search Indexing and Stats issue fixed

* Fix uninstall error

* Add error handling

* fix lint

* Push Job Level Exception on top

* disable flaky tests

* Fix Logs not visible in Search

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-11-13 23:39:56 +05:30
Aniket Katkar
7bc4c7cb57
fix(ui): AUT cypress tests (#13952)
* fixed schemaSearch and dataModelVersion cypress

* fixed tags not updating after addition and deletion of tags

* fixed null value coming in the dashboard name field for search API

* fixed bug on service list page
2023-11-13 19:42:03 +05:30
Mayur Singal
b34111ea00
ElasticSearch: Fix ES connection (#13919) 2023-11-13 14:10:11 +05:30
07Himank
759bd84162
use displayName instead of name in service,database, databaseSchema and fixed owner and domain search issue. (#13937)
* use displayName instead of name in service,database, databaseSchema and fixed owner and domain search issue

* typo fix

* improve code reusabilty
2023-11-13 13:32:52 +05:30
Pere Miquel Brull
c742835766
Auto Tagger Application - Preparing the Ingestion Framework (#13862)
* Prepare the skeleton for generic app registration

* Prepare the skeleton for generic app registration

* Handle app runner

* Prepare the skeleton for generic app registration

* Prepare the skeleton for generic app registration

* Allow deployment

* Fix PII APP

* Fix lint

* Fix PII APP

* Fix PII APP

* Prepare config-based external apps

* Prepare config-based external apps

* Fix lint

* Prepare config-based external apps

* Fix DI errors

* Amend comments
2023-11-13 08:58:38 +01:00
07Himank
ece3f7385f
Enhancement in search in explore and internal (#13770) 2023-11-10 15:23:24 +05:30
mgorsk1
204cffdffa
Fixes 13896: fix fullyQualifiedName field mapping for database schema search (#13898)
* fix fqn field mapping for database schema search

* 👌 Updating code due to code review changes.

---------

Co-authored-by: 07Himank <112613760+07Himank@users.noreply.github.com>
2023-11-10 14:17:35 +05:30
Sriharsha Chintalapani
fe3e0b4b0a
Filter unnecessary jars and only look for openmetadata jars to register data json files (#13536) 2023-11-09 10:34:16 -08:00
Sriharsha Chintalapani
4ec585dca4
fix: openmetadata-service/pom.xml to reduce vulnerabilities (#13888)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-IONETTY-1042268

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-11-09 10:25:37 -08:00
Ashish Gupta
f6cd27e4a7
fix(ui): domain page and Asset modal issues (#13763)
* fix domain label issue in dropdown

* fix placeholder issue, alias issue on query, remove domain item form  filter in domain, alignment issue

* fix unwanted api calls in domains version page

* supported all in add asset modal and set it to default

* fix the loading issue in asset modal while search and on save button

* fix link issue for services in asset cards

* fix wrong entity name

* added data asset alias and a aggs to count on index

* fix: assets component refactor

* fix: use aggregation query for index count on explore

* removed all alias from metadata service

* fix: asset selection data product patch

* fix: add data products on missing pages

* fix: review comments

* fix: domain cypress

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
2023-11-09 20:19:02 +05:30
Mayur Singal
a8145a82fa
Fix #13603: Configurable Sample Data Rows for Profiler (#13807)
* Fix #13603: Configurable Sample Data Rows

* Fix #13603: Configurable Sample Data Rows for Profiler

* fix table config

* support configurable overwriting of sample data

* add support for schema and database profiler configuration

* chore(ui): put sampleDataStorageConfig under advanced config

* fix tests

* py format

* chore(ui): add sampleDataCount in table profiler config

* fix tests

* pylint & tests

* feat(ui): add profiler settings tab in database and database schema page

* chore(ui): show different inputs for profile sample type

* schema changes to make default storange config null

* add unit test

* schema changes to fix api

* update profiler setting schema

* move profiler settings to manage button

* sync locals

* fix(ui): unit tests

* fix tests

* py format

* fix lint

* minor improvements

* chore(ui): update profiler settings schema

* resolve review comments

* pytest

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-11-09 18:49:42 +05:30
07Himank
149be22dcd
remove wildcard search from source url search OS (#13910)
* remove wildcard search from os sourceurl

* checkstyle

* imorovement
2023-11-09 16:38:49 +05:30
Mohit Yadav
bd6e2962c0
Remove Migration Extension Path Env (#13908) 2023-11-09 14:04:28 +05:30
Mohit Yadav
2577490700
- Removed Logo Configuration from the openmetadata.yaml (#13873)
* - Removed Logi Configuration from the openmetadata.yaml
- Migrated Login Configuration to the UI

* Removed ApplicationConfig from tests

* Added Custom Header Logo Url

* Update field to favicon

* support login conifguration

* chore(ui): update logo and login config md files

* fix validation issue

* add cypress

* restructure folders and set default fallback for favicon

* autofocus to first field of edit form

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-11-08 20:05:00 +05:30
07Himank
1a14ac6e72
update respective index with the assets (#13843)
* update respective index with the assets

* checkstyle

* addressing comments

* add listorempty
2023-11-08 10:36:03 +05:30
Teddy
04f6bc7b62
fix: paginating test cases with testSuiteId filter (#13886) 2023-11-07 17:27:09 +00:00
Suresh Srinivas
a89e317a2b
Fixes #13863 - Show inherited relationships of an entity (#13864)
* Fixes #13863 - Show inherited relationships of an entity

* Test failure fixes

* Commenting out invalid python test
2023-11-07 09:11:06 -08:00
Mohit Yadav
8d411e2506
Prevent Rules with same name in a Policy (#13883) 2023-11-07 21:29:07 +05:30