8994 Commits

Author SHA1 Message Date
Suman Maharana
a8d288cc32
Fix #11351 Added Kafka Connect connector docs (#15747)
* Added Kafka Connect JSON Schemas

* Added Kafka Connect Documentation

* Revert "Added Kafka Connect JSON Schemas"

This reverts commit 89cf700e93f1391f24156a1235e5d5e70b067704.

* Added webp image formats for kafkaconnect docs

---------

Co-authored-by: Suman Maharana <suman@Reyna.local>
2024-04-01 11:34:38 +05:30
Imri Paran
5b963a5d9e
MINOR: remove metadata/__init__.py (#15750) 2024-03-29 15:15:52 +05:30
Pere Miquel Brull
fc2c909f6c
MINOR - MetaPilot updated conf (#15745) 2024-03-28 17:18:41 +01:00
Teddy
dafbcbd726
fix: update ingestion profiler config (#15753) 2024-03-28 16:06:08 +00:00
Karan Hotchandani
e22b8f7741
Suggestions feedback (#15723)
* use entity store for storing fqn

* fix feedbacks

* fix tests

* store cleanup

* cleanup

* review comments

* minor label change

* minor change

* fix flaky lineage cypress
2024-03-28 16:04:16 +00:00
harshsoni2024
884029f031
Fix #14089: Add QlikCloud connector support (#15610) 2024-03-28 20:15:22 +05:30
Ashish Gupta
a3689cad54
fix the ui around domain label, data filter and search index table entity stats (#15720)
* fix the ui around domain label, data filter and searchindex table entity stats

* remove unwanted file change

* changes as per comments

* changes as per comments

* fix the missing dependency
2024-03-28 16:32:31 +05:30
Aniket Katkar
eee26e18b0
Docs: Fix incorrect references in the documentation (#15738)
* remove the domains and versions from the reference urls of the openmetadata documentation

* remove unnecessary version mentions in the reference URLS
2024-03-28 15:16:29 +05:30
Onkar Ravgan
70f273f3cd
Updated alation docs (#15728) 2024-03-28 14:13:47 +05:30
Mayur Singal
b7633bddb0
MINOR: Bigquery yaml docs fix (#15718) 2024-03-28 14:12:05 +05:30
Chirag Madlani
84748e1fa1
fix(ui): data product wans't shown for few entities (#15730)
* fix(ui): data product wans't shown for few entities

* fix tests
2024-03-28 06:50:40 +00:00
Ashish Gupta
af47b856e7
#15561: supported copy button in query editor (#15731)
* supported copy button in query editor

* fix sonar issue
2024-03-28 11:43:32 +05:30
Pere Miquel Brull
890820ed92
MINOR - App routes & datamodel (#15722)
* MINOR - App routes & datamodel

* fix future annotations

* fix future annotations
2024-03-27 19:12:24 +01:00
Imri Paran
b0555fe7df
MINOR: added handling for new schedule when migrating quartz context (#15727)
* added handling for new schedule when migrating quartz context

* grab application schedule from the db

* removed unneeded throws

* removed json parsing

* removed unneeded throw
2024-03-27 18:18:42 +01:00
Shailesh Parmar
84941a7d32
#15650 UI: Not able to select all possible dates range from the custom date picker in the incident manager (#15711)
* #15650 UI: Not able to select all possible dates range from the custom date picker in the incident manager

* added unit test
2024-03-27 17:52:28 +05:30
Mayur Singal
bf0ec44f4b
Fix #15678: Accomodate Metabase API changes (#15692) 2024-03-27 15:19:20 +05:30
Mayur Singal
6acb47a87a
MINOR: Fix unity catalog test connection (#15712) 2024-03-27 15:14:26 +05:30
Imri Paran
ec4673587d
CRITICAL: fix AbstractOmAppJobListener (#15701)
* fix AbstractOmAppJobListener

* added appTrigger test

* format

* increased test timeout to 30

* added assertion for not failed

* add break for loop in case of CI
2024-03-27 08:59:10 +01:00
IceS2
ce3f124a33
MINOR: Add Multithread Documentation (#15706)
* Add Multithread Documentation

* Add general considerations
2024-03-27 08:30:16 +01:00
Chirag Madlani
d52bf7aacb
chore(ui): block loggedInUser api for auth/callback route (#15707) 2024-03-27 07:07:56 +00:00
Mayur Singal
0532bb1226
MINOR: Fix external table lineage processing (#15713) 2024-03-27 12:37:20 +05:30
Teddy
9b7f402a16
FIX #14941 - Implement test cases filters (#15616)
* feat: add list from search service logic

* fix: added test and enable ES testing

* style: ran java linting

* fix: ES container startup timeout

* style: ran java linting

* fix: removed array definition as attributes of filter class

* style: ran java linting

* fix: update list from search

* feat: added q param to list from search endpoint

* style: ran java linting

* fix: enable ES test for list from search

* fix: added include/exclude from source

* style: ran java linting

* fix: test case

* fix: exception type
2024-03-27 07:25:11 +01:00
Ashish Gupta
024e19f97b
fix reloading of user profile page on edit action perform (#15673)
* fix reloading of user profile page on data change

* supported unit test update handler in UserPage
2024-03-27 11:52:00 +05:30
Mayur Singal
8073a80989
Fix #14285: Add column lineage support for tableau datamodels (#15646) 2024-03-27 11:03:40 +05:30
Chirag Madlani
1347890540
fix(ui): Glossary term related term got vanish on update (#15697)
* fix(ui): Glossary term related term got vanish on update

* block api call for empty json patch
2024-03-27 10:51:15 +05:30
Chirag Madlani
5056e78e0c
feat(ui): OM status page to validate health (#15685)
* ui: display om health in settings page

(cherry picked from commit 70b47a66f551f36c7cd0de5242e03982bfc86655)

* add locale files

(cherry picked from commit 17743062d64cb625d8175d57cc0b6da2432832ca)

* fix locale

* Update UI for showing validation message and logs

* fix path

* update locale

* fix tests

* fix typo

* update icon for status

---------

Co-authored-by: Harsh Vador <harsh.vador@somaiya.edu>
2024-03-27 01:01:31 +05:30
dependabot[bot]
73b0234168
Bump express in /openmetadata-ui/src/main/resources/ui (#15684)
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-27 01:00:35 +05:30
Aniket Katkar
4ee088cabf
Fixed cypress tests for Services, ObservabilityAlerts and Glossary VersionPage specs (#15704) 2024-03-27 00:56:02 +05:30
Mohit Yadav
f5a459bce6
Fixes #15686 : Updated Data Insights Report Schema (#15705) 2024-03-26 11:23:30 -07:00
Pere Miquel Brull
9d7bfa363e
MINOR - Clean metadata CLI (#15631)
* Docs

* MINOR - Clean metadata CLI

* remove tests
2024-03-26 16:36:47 +01:00
Teddy
813a9ca451
doc: added OIDC menu item (#15703) 2024-03-26 14:56:56 +01:00
Chirag Madlani
9425e691e2
Update cypress-integration-tests-mysql-pr.yml (#15700) 2024-03-26 19:03:49 +05:30
Ayush Shah
6039fe9462
Fix TypeError Missing arg (#15698) 2024-03-26 18:32:32 +05:30
Imri Paran
86a1130e41
MINOR: use appName instead of id (#15693)
* use appName instead of id
2024-03-26 13:45:13 +01:00
Imri Paran
de38ab53c0
Fixes #15614: remove data from quartz (#15612)
* feat(apps): remove data from quartz

1. Remove data from quartz application. Store only app id.
2. Added exception handling when trying to trigger an app.
3. Save bot info in the app data in DB.
4. Added runtime properties in AbstractNativeApplication.execute.
2024-03-26 10:48:43 +01:00
Pere Miquel Brull
f28f196c34
MINOR - Move app migrations to 1.3.2 (#15690) 2024-03-26 08:43:15 +01:00
Mohit Yadav
17434429c4
- Remove Schema Changes from TestCase and TestSuite (#15687) 2024-03-26 12:30:19 +05:30
Sriharsha Chintalapani
7a3a271f26
Add entityReferences and entityReferenceList as custom properties (#15448)
* Add entityReferences and entityReferenceList as custom properties

* ui: allow to add custom properties for all available property types.

* make entity type as an array

* Fix label typo and import order in AddCustomProperty component

* Remove unnecessary property types with format

* Refactor CustomPropertyTable.tsx to handle array config and enum config

* Add entity reference options and update custom property form

* Add EntityReference and EntityReferenceList as a custom property

* add validation for date format

* Add date and dateTime input support to PropertyValue component

* Fix import order and add search functionality to type dropdown

* Fix custom property cypress tests

* add input for number, email, timestamp, timeInterval, duration, time, sqlQuery,

* add input support for entityReference and entityReferenceList

* Add placeholders for email, timestamp, start time, end time, and duration inputs

* Refactor PropertyValue component to use destructuring for timeInterval object

* Add minWidth style to PropertyValue component and include SQL query editor

* Add entityReference and entityReferenceList as a generic types and not reference to the existing types

* Remove services from entity reference types list

* handle property values for different property type

* Update ExtensionTable to handle object values in CustomPropertyTable

* Add entity reference list rendering and styling

* Fix file paths in complexTypes.json

* Add regex constant for UNIX timestamp in milliseconds and update language files

* Refactor custom property configuration and add new options

* Fix import order and update property value handling

* add unit tests for different input types for different property type

* add unit test for different property type values

* fix cypress tests

* add cypress test for CRUD for different types

* add cypress test for entity ref and entity ref list property type

* add cypress tests for all the 11 entities which support custom properties

* fix cypress test for createCustomPropertyForEntity

* Add new interfaces and types for CustomPropertyTable

* add cypress test for custom property to create via APIs for entities

* add cypress tests for string,integer, markdown, number, duration, email

* add cypress test for enum property for all entities

* add cypress test for sqlQuery, timestamp and timeInterval property

* fix cypress test for sqlQuery input

* fix flaky cypress test for sqlQuery input

* address comments

* Refactor import statements and update ENTITY_PATH enum

* Update import statement in CustomProperty.ts

* change TimeInterval to Time Interval

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-03-26 11:02:44 +05:30
Onkar Ravgan
891e0bf893
Updated alation json schemas (#15674) 2024-03-26 10:50:43 +05:30
Mayur Singal
6b90c245d4
MINOR: Add support for json schema parsing for datalake & s3 (#15615) 2024-03-26 10:03:21 +05:30
IceS2
e7c9d6aa7f
FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)
* Implement Initial MultiThread suggestion

* Update all the ingestion sources to use the new ContextManager

* Fix missing wraps on decorator

* Fix Unittests

* Fix linters

* Fix linters

* Fix BigQuery UnitTests

* Add UnitTests to the newly created code

* Fix unittest

* change the threads from table to schemas

* Update README.md

* Small change suggested by Sonar

* Slight change to test a different way to multithread over tables

* Debug changes

* More multithread tests

* Remove uneeded wait time

* Testing

* refactor code based on removal of time.sleep

* Fix wrong paste

* Improve ExecutionTimeContextManager

* Fix missing .get() and unit tests

* Fix conflicting changes

* Update Multithread logic with the incremental extraction

* Fix linters

* Fix unittest

* Remove commented code

* Fix Unittests

* Fix checkstyle

* Change default to threads = 1
2024-03-25 18:20:40 +01:00
Pere Miquel Brull
4db6dce2f9
MINOR - Add /status endpoint (#15394)
* MINOR - Add `/validate` endpoint

* rename endpoint

* fix test

* add new migration

* Status

* Simplify migration client

* Simplify migration client

* Simplify migration client
2024-03-25 07:05:13 +01:00
Teddy
b9bc8a1fa1
[MINOR] Enable ES Tests for Maven CI (#15657)
* fix: added ES test by default

* style: ran java linting

* fix: increase wait time + make es container not reusable

* fix: updated query search index + increase startup and wait time

* fix: Change order of attribute setting for ES container

* style: ran java linting

* fix: order test and increase wait time for ES in Report test

* fix: adjusted flaky es test
2024-03-24 19:35:48 +01:00
Pere Miquel Brull
9329b5a488
#12678 - Add SAP Hana Backend Converter (#15629)
* #12678 - Add SAP Hana Backend Converter

* Format

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-23 19:36:56 +01:00
Ayush Shah
00677a1e1b
Fix External Account Json Schema Issue (#15671) 2024-03-23 16:47:55 +05:30
Chirag Madlani
039d66390b
feat(ui): what's new details update for 1.3.2 (#15666)
* feat(ui): what's new details update for 1.3.2

* update content
2024-03-22 14:50:10 +00:00
Pere Miquel Brull
a79e79ef3d
#15662 - List All test cases from a table in DQ (#15665)
* #15662 - List All test cases from a table in DQ

* #15662 - List All test cases from a table in DQ

* #15662 - List All test cases from a table in DQ
2024-03-22 11:30:02 +01:00
Pere Miquel Brull
e01b4b1bd3
MINOR - Fix suggestion accept all (#15658) 2024-03-22 11:23:48 +01:00
Mohit Yadav
5be7bca5f8
Fix failed to parse field [followers] of type [keyword] in document with i (#15670) 2024-03-22 15:32:48 +05:30
dependabot[bot]
5f206111fe
Bump webpack-dev-middleware in /openmetadata-ui/src/main/resources/ui (#15669)
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases)
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4)

---
updated-dependencies:
- dependency-name: webpack-dev-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-22 09:59:00 +00:00