1565 Commits

Author SHA1 Message Date
sonika-shah
45bae608bd
Fixes #10724 : Search with hierarchy api for glossary terms (#15865)
* Fixes #10724 : New search with hierarchy api for glossary terms

* Added query param in existing search api - to search with hierarchy

* Created new json to manage hierarchy and other updates
2024-04-18 14:22:18 +05:30
IceS2
612bea46a6
FIXES #14772: Display Assets without Owner/Description (#15794)
* Update table_index_mapping to turn columns into a nested type

* test: added query null/empty description test

* style: ran java linting

* Add Table test for incomplete description search query

* Fix tests

* Fix linters

* Fix column search

* Increase waitForEsAsync to 500

* Defined the new calculated fields for the indexes

* Refactor search of assets with no description

* add descriptionStatus to the entities taht didn't have it

* Remove descriptionStatus where it's not needed

* Remove TestCase and TestSuite from search test

* Remove TestCase and TestSuite from search test

* Increase waitForEsAsync for checkDeleteentity 1000

* Update jp and zh mappings

* Fix syntax

* Increase waitForEsAsync for some tests to 1000

* Remove unused aggregations

* Refactor code to reduce repetition

* Fix checkstyle

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2024-04-18 10:41:58 +02:00
Teddy
8d377f5c99
Fix #11951 [backend] - Implement Profiler Global Config (#15889)
* feat: add global metric configuration for the profiler

* style: ran java linting

* fix: renamed disable to disabled

* style: ran java linting

* fix: json schema profiler config title
2024-04-16 18:56:21 +02:00
Mohit Yadav
c7e03471a1
Add Pipeline Status to Ingestion Pipeline Index (#15918) 2024-04-16 21:40:24 +05:30
Imri Paran
6349adb0ec
MINOR: added a DELETE method for failedRowsSample (#15878)
* added a DELETE method for failedRowsSample

* fixed tests

* changed required permission to EDIT_SAMPLE_DATA

* changed required permission to DELETE_SAMPLE_DATA

* changed required permission to DELETE_TEST_CASE_FAILED_ROWS_SAMPLE

* changed required permissions

addFailedRowsSample -> EDIT_TEST_CASE_FAILED_ROWS_SAMPLE
getFailedRowsSample -> VIEW_TEST_CASE_FAILED_ROWS_SAMPLE

* removed op EditTestCaseFailedRowsSample

* fixed tests

* format
2024-04-16 17:45:59 +02:00
Teddy
84469e643c
FIX #13475 - Add Parameter Validation for Min/Max tests (#15849)
* feat: add validation field to test case definition parameters

* feat: added parameter validation logic

* fix: set ES testcontainer startup attemp to 3

* style: ran java linting

* fix: added waitForEsAsyncOp in post_trigger_app_200 test
2024-04-15 07:52:43 -07:00
Karan Hotchandani
bd3838868c
disable install for preview apps (#15884)
* disable install for preview apps

* move screenshot path to base class

* MINOR - Add Marketplace preview

* format

* add unit tests

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-04-15 17:32:01 +05:30
sonika-shah
c010939072
Added payload size check logic for Elasticsearch (#15540)
* Added payload size check logic for Elasticsearch

* Added payload size check logic for Elasticsearch - made review changes

* Added payload size check logic for Elasticsearch - added env in docker files

* Optimize payload logic, fix search application error stats issue
2024-04-15 16:25:06 +05:30
Teddy
8fc4319f64
MINOR Add owner filter test case (#15853)
* feat: added owner filter to test case list from search

* refactor: deprecated `orderByLatestExecution` param

BREAKING CHANGE: `orderByLatestExecution` param from list endpoint `GET` has been removed in favor of `sortField` and `sortType` from the `search/list` endpoint

* style: ran java linting

* fix: increase es async time
2024-04-11 17:27:39 +02:00
Imri Paran
b2ce491ff1
MINOR: Add failed rows sample to test case (#15682)
* add failed sample data

* format

* fixed masking pii data in test failed rows sample

* format

* failedRowsSamples -> failedRowsSample

* failedRowsSamples -> failedRowsSample

* fixed tests

* format

* wip

* added computePassedFailedRowCount to python client

* comment for loggerLevel

* format

* fixed tests

* tests for putting / deleting failed samples

* format

* format

* added test case for pii test

* changed method name to deleteTestCaseFailedRowsSample

* added getComputePassedFailedRowCount
2024-04-10 17:00:00 +02:00
Imri Paran
d9a7ebe5e1
MINOR: fix application in corrupted state (#15830)
* fix application in corrupted state

* format

* remove old versions of the app

* format

* use name instead of fqn
2024-04-09 07:58:34 +02:00
mohitdeuex
a41dc54667 - Create Dummy Columns on empty import of table columns 2024-04-09 11:08:04 +05:30
Teddy
7bc48ffd0d
MINOR: exclude change description from testSuite key in table entity indexing (#15836)
* fix: exclude change description from testSuite key in table entity reindexing

* style: removed unecessary comment
2024-04-08 22:00:00 +00:00
Teddy
dc4c4e41b8
Fix #10354 - Implement Test Suite filter from Search (#15814) 2024-04-08 18:40:39 +02:00
Mohit Yadav
1a7314193f
Validate against PersonalAccess (#15832) 2024-04-08 17:13:19 +05:30
Mohit Yadav
5a88d15228
[Feature] Import/Export For Table, DatabaseSchema, Databases, Service (#15816)
* - Add Import Export Separation for GlossaryTerms

* - Fixed Table Resrouce Test

* - Review Comment #2

* - GlossaryTestFix, Glossary does not allow Tier Tags

* - Database Schema Tests Fix

* - Create Database, DatabaseSchema, DatabaseService import entity if not exists

* - Fix Test for Database DatabaseSchema, Table
2024-04-07 02:21:56 +05:30
IceS2
12a4c578a2
MINOR: Fix jsonpatch operation order (#15680)
* Mantain the OperationType Order when considering the dividing groups

* Remove reordering the jsonpatch operations from the backend

* Fix checkstyle

* Fix UnitTests to comply with no reordering

* Initial idea on how to fix our current jsonpatch builder from python

* fix(JsonUtils): Change JSONPatch library used

When creating a JSONPatch by using the 'createDiff' method, the library
we are using is not returning a correct JSONPatch when removing multiple
items from an array.

Since the library doesn't provide good ways to override this behavior
and fix it, we decided to move away from it and use the json-patch
library only for this specific operation.

* Fix linters

* Add docstrings

* Refactor patch updated on ingestion framework

* Add UnitTests

* Fix linters
2024-04-05 15:52:01 +02:00
Mohit Yadav
5f9a565f3a
[AlertNotication] Fix formatting (#15800)
* - Remove sourceHash from the Activity Feed
- Update Test Case Page Uri Link

* - Remove lifeCycle

* - Add To Field Change List

* - Add asset Url to conversations and Task Updates

* - Make Redirect to Activity Feed Task Page
2024-04-04 18:28:30 +05:30
Mohit Yadav
daae3c48e3
- Do not validate bot domain (#15796) 2024-04-03 16:12:42 +05:30
Teddy
dd53f45cc6
MINOR fix test case search filtering (#15785)
* fix: test case filtering from search endpoint

* style: ran java linting

* fix: updated test case EL in list test
2024-04-03 11:01:54 +02:00
Mohit Yadav
6e8d14fad4
- Change Prompt to consent on every login (#15792) 2024-04-03 13:13:33 +05:30
Mohit Yadav
72bd411fe5
[Vulnerabilities] Update Dependencies to fix Vulnerabilities (#15775)
* [VBY] Fix POm version for affected dependency

* - add cp3 dependency

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-04-03 12:04:01 +05:30
Mohit Yadav
77bb725d5b
- add Step logs for Auth (#15786) 2024-04-03 11:15:13 +05:30
sonika-shah
4948ab3766
Fix backend bug that prevented associated tags from being removed when a glossary term is deleted. (#15676)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-04-03 10:18:57 +05:30
Teddy
4b13403931
Fix #15594 - Implement domain support for test cases (#15736)
* feat: add list from search service logic

* fix: added test and enable ES testing

* style: ran java linting

* fix: ES container startup timeout

* style: ran java linting

* fix: removed array definition as attributes of filter class

* style: ran java linting

* fix: update list from search

* feat: added q param to list from search endpoint

* style: ran java linting

* fix: enable ES test for list from search

* fix: added include/exclude from source

* style: ran java linting

* feat: add domain support for test case

* fix: added search service check for domain inheritence

* feat: added domain query param to list from search

* style: ran java linting
2024-04-02 22:45:48 +02:00
Mohit Yadav
b38b7e3231
- added log (#15777) 2024-04-02 18:39:48 +05:30
Imri Paran
740480fe28
MINOR: change systemApp to system (#15757) 2024-04-01 18:50:43 +05:30
Suman Maharana
bb2684dd62
Fix #11351 Added Kafka Connect connector JSON schemas (#15699) 2024-04-01 18:45:39 +05:30
Mohit Yadav
c061522bbc
Fixes #15483 : Change Generic to Webhook (#15744)
* Fixes #15483 : Change Generic to Webhook

* Typo
2024-04-01 12:36:09 +05:30
harshsoni2024
884029f031
Fix #14089: Add QlikCloud connector support (#15610) 2024-03-28 20:15:22 +05:30
Imri Paran
b0555fe7df
MINOR: added handling for new schedule when migrating quartz context (#15727)
* added handling for new schedule when migrating quartz context

* grab application schedule from the db

* removed unneeded throws

* removed json parsing

* removed unneeded throw
2024-03-27 18:18:42 +01:00
Imri Paran
ec4673587d
CRITICAL: fix AbstractOmAppJobListener (#15701)
* fix AbstractOmAppJobListener

* added appTrigger test

* format

* increased test timeout to 30

* added assertion for not failed

* add break for loop in case of CI
2024-03-27 08:59:10 +01:00
Teddy
9b7f402a16
FIX #14941 - Implement test cases filters (#15616)
* feat: add list from search service logic

* fix: added test and enable ES testing

* style: ran java linting

* fix: ES container startup timeout

* style: ran java linting

* fix: removed array definition as attributes of filter class

* style: ran java linting

* fix: update list from search

* feat: added q param to list from search endpoint

* style: ran java linting

* fix: enable ES test for list from search

* fix: added include/exclude from source

* style: ran java linting

* fix: test case

* fix: exception type
2024-03-27 07:25:11 +01:00
Mohit Yadav
f5a459bce6
Fixes #15686 : Updated Data Insights Report Schema (#15705) 2024-03-26 11:23:30 -07:00
Imri Paran
86a1130e41
MINOR: use appName instead of id (#15693)
* use appName instead of id
2024-03-26 13:45:13 +01:00
Imri Paran
de38ab53c0
Fixes #15614: remove data from quartz (#15612)
* feat(apps): remove data from quartz

1. Remove data from quartz application. Store only app id.
2. Added exception handling when trying to trigger an app.
3. Save bot info in the app data in DB.
4. Added runtime properties in AbstractNativeApplication.execute.
2024-03-26 10:48:43 +01:00
Mohit Yadav
17434429c4
- Remove Schema Changes from TestCase and TestSuite (#15687) 2024-03-26 12:30:19 +05:30
Sriharsha Chintalapani
7a3a271f26
Add entityReferences and entityReferenceList as custom properties (#15448)
* Add entityReferences and entityReferenceList as custom properties

* ui: allow to add custom properties for all available property types.

* make entity type as an array

* Fix label typo and import order in AddCustomProperty component

* Remove unnecessary property types with format

* Refactor CustomPropertyTable.tsx to handle array config and enum config

* Add entity reference options and update custom property form

* Add EntityReference and EntityReferenceList as a custom property

* add validation for date format

* Add date and dateTime input support to PropertyValue component

* Fix import order and add search functionality to type dropdown

* Fix custom property cypress tests

* add input for number, email, timestamp, timeInterval, duration, time, sqlQuery,

* add input support for entityReference and entityReferenceList

* Add placeholders for email, timestamp, start time, end time, and duration inputs

* Refactor PropertyValue component to use destructuring for timeInterval object

* Add minWidth style to PropertyValue component and include SQL query editor

* Add entityReference and entityReferenceList as a generic types and not reference to the existing types

* Remove services from entity reference types list

* handle property values for different property type

* Update ExtensionTable to handle object values in CustomPropertyTable

* Add entity reference list rendering and styling

* Fix file paths in complexTypes.json

* Add regex constant for UNIX timestamp in milliseconds and update language files

* Refactor custom property configuration and add new options

* Fix import order and update property value handling

* add unit tests for different input types for different property type

* add unit test for different property type values

* fix cypress tests

* add cypress test for CRUD for different types

* add cypress test for entity ref and entity ref list property type

* add cypress tests for all the 11 entities which support custom properties

* fix cypress test for createCustomPropertyForEntity

* Add new interfaces and types for CustomPropertyTable

* add cypress test for custom property to create via APIs for entities

* add cypress tests for string,integer, markdown, number, duration, email

* add cypress test for enum property for all entities

* add cypress test for sqlQuery, timestamp and timeInterval property

* fix cypress test for sqlQuery input

* fix flaky cypress test for sqlQuery input

* address comments

* Refactor import statements and update ENTITY_PATH enum

* Update import statement in CustomProperty.ts

* change TimeInterval to Time Interval

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-03-26 11:02:44 +05:30
Onkar Ravgan
891e0bf893
Updated alation json schemas (#15674) 2024-03-26 10:50:43 +05:30
Pere Miquel Brull
4db6dce2f9
MINOR - Add /status endpoint (#15394)
* MINOR - Add `/validate` endpoint

* rename endpoint

* fix test

* add new migration

* Status

* Simplify migration client

* Simplify migration client

* Simplify migration client
2024-03-25 07:05:13 +01:00
Teddy
b9bc8a1fa1
[MINOR] Enable ES Tests for Maven CI (#15657)
* fix: added ES test by default

* style: ran java linting

* fix: increase wait time + make es container not reusable

* fix: updated query search index + increase startup and wait time

* fix: Change order of attribute setting for ES container

* style: ran java linting

* fix: order test and increase wait time for ES in Report test

* fix: adjusted flaky es test
2024-03-24 19:35:48 +01:00
Pere Miquel Brull
9329b5a488
#12678 - Add SAP Hana Backend Converter (#15629)
* #12678 - Add SAP Hana Backend Converter

* Format

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-23 19:36:56 +01:00
Pere Miquel Brull
e01b4b1bd3
MINOR - Fix suggestion accept all (#15658) 2024-03-22 11:23:48 +01:00
Mohit Yadav
5be7bca5f8
Fix failed to parse field [followers] of type [keyword] in document with i (#15670) 2024-03-22 15:32:48 +05:30
mohitdeuex
e52156aa94 Fixes Glossary Term and Tag Redirection 2024-03-22 14:50:06 +05:30
Mohit Yadav
cb411d0aa2
- Security Fix (#15664) 2024-03-22 14:14:39 +05:30
Mohit Yadav
f03ae2d6ab
[Fix] Application Fixes, Updated AppRunType and Removed Server App Inits (#15649)
* - Fix App Run Type
- Remove Init on App Start
- Migrate stats setup for SearchIndexing to execution

* fix the AppLogsViewer unit test failing due to appRunType type changes

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-03-22 08:48:23 +05:30
Sriharsha Chintalapani
8fafb04518
Fix #15501: Explore - Showcase Dashboard project and filter by it (#15640) 2024-03-21 16:07:11 +05:30
Mohit Yadav
33c42b746c
- Add WebsocketNotificationHandler for sending updates for Task, Anno… (#15637)
* - Add WebsocketNotificationHandler for sending updates for Task, Announcement and Mentions on Websocket

* Fix Mentioned User on tasks

* Only notify the relvant user
2024-03-21 15:59:42 +05:30
Pere Miquel Brull
c641a57818
#367C - Suggestions Accept / Reject All (#15589)
* Update workflow

* #367 - Suggestions Accept / Reject All

* Amend comments

* Fix test

* Fix test
2024-03-21 07:56:34 +01:00