12410 Commits

Author SHA1 Message Date
Imri Paran
de38ab53c0
Fixes #15614: remove data from quartz (#15612)
* feat(apps): remove data from quartz

1. Remove data from quartz application. Store only app id.
2. Added exception handling when trying to trigger an app.
3. Save bot info in the app data in DB.
4. Added runtime properties in AbstractNativeApplication.execute.
2024-03-26 10:48:43 +01:00
Pere Miquel Brull
f28f196c34
MINOR - Move app migrations to 1.3.2 (#15690) 2024-03-26 08:43:15 +01:00
Mohit Yadav
17434429c4
- Remove Schema Changes from TestCase and TestSuite (#15687) 2024-03-26 12:30:19 +05:30
Sriharsha Chintalapani
7a3a271f26
Add entityReferences and entityReferenceList as custom properties (#15448)
* Add entityReferences and entityReferenceList as custom properties

* ui: allow to add custom properties for all available property types.

* make entity type as an array

* Fix label typo and import order in AddCustomProperty component

* Remove unnecessary property types with format

* Refactor CustomPropertyTable.tsx to handle array config and enum config

* Add entity reference options and update custom property form

* Add EntityReference and EntityReferenceList as a custom property

* add validation for date format

* Add date and dateTime input support to PropertyValue component

* Fix import order and add search functionality to type dropdown

* Fix custom property cypress tests

* add input for number, email, timestamp, timeInterval, duration, time, sqlQuery,

* add input support for entityReference and entityReferenceList

* Add placeholders for email, timestamp, start time, end time, and duration inputs

* Refactor PropertyValue component to use destructuring for timeInterval object

* Add minWidth style to PropertyValue component and include SQL query editor

* Add entityReference and entityReferenceList as a generic types and not reference to the existing types

* Remove services from entity reference types list

* handle property values for different property type

* Update ExtensionTable to handle object values in CustomPropertyTable

* Add entity reference list rendering and styling

* Fix file paths in complexTypes.json

* Add regex constant for UNIX timestamp in milliseconds and update language files

* Refactor custom property configuration and add new options

* Fix import order and update property value handling

* add unit tests for different input types for different property type

* add unit test for different property type values

* fix cypress tests

* add cypress test for CRUD for different types

* add cypress test for entity ref and entity ref list property type

* add cypress tests for all the 11 entities which support custom properties

* fix cypress test for createCustomPropertyForEntity

* Add new interfaces and types for CustomPropertyTable

* add cypress test for custom property to create via APIs for entities

* add cypress tests for string,integer, markdown, number, duration, email

* add cypress test for enum property for all entities

* add cypress test for sqlQuery, timestamp and timeInterval property

* fix cypress test for sqlQuery input

* fix flaky cypress test for sqlQuery input

* address comments

* Refactor import statements and update ENTITY_PATH enum

* Update import statement in CustomProperty.ts

* change TimeInterval to Time Interval

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-03-26 11:02:44 +05:30
Onkar Ravgan
891e0bf893
Updated alation json schemas (#15674) 2024-03-26 10:50:43 +05:30
Mayur Singal
6b90c245d4
MINOR: Add support for json schema parsing for datalake & s3 (#15615) 2024-03-26 10:03:21 +05:30
IceS2
e7c9d6aa7f
FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)
* Implement Initial MultiThread suggestion

* Update all the ingestion sources to use the new ContextManager

* Fix missing wraps on decorator

* Fix Unittests

* Fix linters

* Fix linters

* Fix BigQuery UnitTests

* Add UnitTests to the newly created code

* Fix unittest

* change the threads from table to schemas

* Update README.md

* Small change suggested by Sonar

* Slight change to test a different way to multithread over tables

* Debug changes

* More multithread tests

* Remove uneeded wait time

* Testing

* refactor code based on removal of time.sleep

* Fix wrong paste

* Improve ExecutionTimeContextManager

* Fix missing .get() and unit tests

* Fix conflicting changes

* Update Multithread logic with the incremental extraction

* Fix linters

* Fix unittest

* Remove commented code

* Fix Unittests

* Fix checkstyle

* Change default to threads = 1
2024-03-25 18:20:40 +01:00
Pere Miquel Brull
4db6dce2f9
MINOR - Add /status endpoint (#15394)
* MINOR - Add `/validate` endpoint

* rename endpoint

* fix test

* add new migration

* Status

* Simplify migration client

* Simplify migration client

* Simplify migration client
2024-03-25 07:05:13 +01:00
Teddy
b9bc8a1fa1
[MINOR] Enable ES Tests for Maven CI (#15657)
* fix: added ES test by default

* style: ran java linting

* fix: increase wait time + make es container not reusable

* fix: updated query search index + increase startup and wait time

* fix: Change order of attribute setting for ES container

* style: ran java linting

* fix: order test and increase wait time for ES in Report test

* fix: adjusted flaky es test
2024-03-24 19:35:48 +01:00
Pere Miquel Brull
9329b5a488
#12678 - Add SAP Hana Backend Converter (#15629)
* #12678 - Add SAP Hana Backend Converter

* Format

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-23 19:36:56 +01:00
Ayush Shah
00677a1e1b
Fix External Account Json Schema Issue (#15671) 2024-03-23 16:47:55 +05:30
Chirag Madlani
039d66390b
feat(ui): what's new details update for 1.3.2 (#15666)
* feat(ui): what's new details update for 1.3.2

* update content
2024-03-22 14:50:10 +00:00
Pere Miquel Brull
a79e79ef3d
#15662 - List All test cases from a table in DQ (#15665)
* #15662 - List All test cases from a table in DQ

* #15662 - List All test cases from a table in DQ

* #15662 - List All test cases from a table in DQ
2024-03-22 11:30:02 +01:00
Pere Miquel Brull
e01b4b1bd3
MINOR - Fix suggestion accept all (#15658) 2024-03-22 11:23:48 +01:00
Mohit Yadav
5be7bca5f8
Fix failed to parse field [followers] of type [keyword] in document with i (#15670) 2024-03-22 15:32:48 +05:30
dependabot[bot]
5f206111fe
Bump webpack-dev-middleware in /openmetadata-ui/src/main/resources/ui (#15669)
Bumps [webpack-dev-middleware](https://github.com/webpack/webpack-dev-middleware) from 5.3.3 to 5.3.4.
- [Release notes](https://github.com/webpack/webpack-dev-middleware/releases)
- [Changelog](https://github.com/webpack/webpack-dev-middleware/blob/v5.3.4/CHANGELOG.md)
- [Commits](https://github.com/webpack/webpack-dev-middleware/compare/v5.3.3...v5.3.4)

---
updated-dependencies:
- dependency-name: webpack-dev-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-22 09:59:00 +00:00
Shailesh Parmar
83a40f11af
Cypress: fixed s3 service and permission cypress (#15645)
* Cypress: fixed s3 service and permission cypress

* fixed api issue in postgresIngestion

* fixed big query cypress

* fixed big query failure in cypress

* miner fix for bigquery cypress test
2024-03-22 14:56:42 +05:30
mohitdeuex
e52156aa94 Fixes Glossary Term and Tag Redirection 2024-03-22 14:50:06 +05:30
Shailesh Parmar
39b645a0ea
#15651 UI: Duplicate API calls in the data quality tab on the table details page (#15663) 2024-03-22 14:40:01 +05:30
Ayush Shah
8b880bbf91
Fixes 14370: Add Azure Client, support Default Creds (#15554)
* Add Azure Client, support Default Creds
2024-03-22 14:28:42 +05:30
Mohit Yadav
cb411d0aa2
- Security Fix (#15664) 2024-03-22 14:14:39 +05:30
Mohit Yadav
fb8b8c46a2
- Oidc Documentation (#15668)
* - Oidc Documentation

* - Review Comments
2024-03-22 14:11:24 +05:30
Karan Hotchandani
94be958b68
Accept/Reject All Suggestions (#15656)
* allow accept all and reject all suggestions

* add tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-03-22 13:07:05 +05:30
Pere Miquel Brull
9309d55ac1
MINOR - Fix YAML docs (#15661) 2024-03-22 08:25:09 +01:00
Mayur Singal
ad28af4f4f
MINOR: Fix sample data upload - binary data error (#15659) 2024-03-22 12:13:26 +05:30
Mayur Singal
2208662886
MINOR: Move external table lineage to post processing (#15633) 2024-03-22 11:46:14 +05:30
Mohit Yadav
f03ae2d6ab
[Fix] Application Fixes, Updated AppRunType and Removed Server App Inits (#15649)
* - Fix App Run Type
- Remove Init on App Start
- Migrate stats setup for SearchIndexing to execution

* fix the AppLogsViewer unit test failing due to appRunType type changes

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-03-22 08:48:23 +05:30
Chirag Madlani
4ddcc0375c
fix(ui): auth refresh token for confidential client type (#15654) 2024-03-21 19:57:16 +00:00
Ashish Gupta
e22060668c
fix breaking issue in data insight report page after log button click (#15652)
* fix breaking issue in data insight report page after log button click

* changes as per comments

* check page url on page change by click logs
2024-03-22 00:12:58 +05:30
Dhruvin Maniar
8cfe720877
Minor: Fixing helm values doc (#15655) 2024-03-21 21:30:52 +05:30
Karan Hotchandani
acc08cbf98
Show profile pic for bots (#15648)
* add floating button for additional actions

* use local bot icon if available

* add tests
2024-03-21 19:47:09 +05:30
Ashish Gupta
c56a1533d8
remove retenion period and displayName edit button if table is deleted (#15653) 2024-03-21 19:22:58 +05:30
Ashish Gupta
834720c445
#15101 : supported project in dashboard right panel and explore filter (#15242)
* supported project in dashboard rightpanel and explore filter

* fix aggregation key and supported unit test for the dropdown items

* minor fix
2024-03-21 18:14:32 +05:30
Shailesh Parmar
0358ec848d
#15545 Data Insights filter counter (#15643) 2024-03-21 11:28:41 +00:00
Sriharsha Chintalapani
8fafb04518
Fix #15501: Explore - Showcase Dashboard project and filter by it (#15640) 2024-03-21 16:07:11 +05:30
Mohit Yadav
33c42b746c
- Add WebsocketNotificationHandler for sending updates for Task, Anno… (#15637)
* - Add WebsocketNotificationHandler for sending updates for Task, Announcement and Mentions on Websocket

* Fix Mentioned User on tasks

* Only notify the relvant user
2024-03-21 15:59:42 +05:30
Pere Miquel Brull
b778bc7968
#14943 - Check tags before PII processor (#15622) 2024-03-21 14:15:28 +05:30
Pere Miquel Brull
c641a57818
#367C - Suggestions Accept / Reject All (#15589)
* Update workflow

* #367 - Suggestions Accept / Reject All

* Amend comments

* Fix test

* Fix test
2024-03-21 07:56:34 +01:00
Pere Miquel Brull
3fb4dbb55a
MINOR - Application Preview (#15609) 2024-03-21 07:56:14 +01:00
Aniket Katkar
e6cdd6e9a6
improve SingleFiledSearch, GlossaryVersion and NotificationAlert cypress tests to avoid flakiness (#15603) 2024-03-21 11:13:08 +05:30
Sriharsha Chintalapani
a6deffdd7c
Fix failing tests in Task Resolution (#15634) 2024-03-20 13:49:03 -07:00
Mohit Yadav
b304cbf55f
- Fix slf4j coming from pac4j (#15636) 2024-03-21 00:27:33 +05:30
Shailesh Parmar
a8a0fdc4a0
#15080 Add a filter by time and tags on the query view page (#15591)
* #15080 Add a filter by time and tags on the query view page

* added Query date filter and sorting options

* added owner filter

* fixed failing unit test

* added cypress for query filter

* miner improvement

* fixed failing cypress and move necessary code utils

* fixed failing cypress
2024-03-20 20:58:36 +05:30
Ashish Gupta
7d24cb5164
#15466: supported entity stats table in searchindex application history logs (#15620)
* supported entity stats table in searchindex application history logs

* localization keys

* changes due to total records

* added test around appLogsViewer and fix sonar issue
2024-03-20 19:42:07 +05:30
Imri Paran
7eeb0e45d2
1. add profiler support for GEOMETRY type in redshift. (#15628)
2. Add GEOMETRY to values not to compute.
2024-03-20 13:42:46 +01:00
Ayush Shah
1bb7d893ac
Fix 15419: Improve fetching Oracle Queries for SP (#15621) 2024-03-20 15:58:06 +05:30
Chirag Madlani
8c419b48f8
fix(e2e): login spec fialure (#15624) 2024-03-20 15:46:49 +05:30
Karan Hotchandani
bd208371a9
Query extend (#15595)
* initial commit

* add profile pic for bot

* logo configurable for collate app

* add query extras

* fix tests

* add tests
2024-03-20 15:05:59 +05:30
mohitdeuex
d6c7465b19 Merge remote-tracking branch 'origin/main' 2024-03-20 13:52:46 +05:30
mohitdeuex
8a36de40a1 - Remove default {} from openemtadata.yaml 2024-03-20 13:52:25 +05:30