2200 Commits

Author SHA1 Message Date
Mohit Yadav
5a88d15228
[Feature] Import/Export For Table, DatabaseSchema, Databases, Service (#15816)
* - Add Import Export Separation for GlossaryTerms

* - Fixed Table Resrouce Test

* - Review Comment #2

* - GlossaryTestFix, Glossary does not allow Tier Tags

* - Database Schema Tests Fix

* - Create Database, DatabaseSchema, DatabaseService import entity if not exists

* - Fix Test for Database DatabaseSchema, Table
2024-04-07 02:21:56 +05:30
IceS2
12a4c578a2
MINOR: Fix jsonpatch operation order (#15680)
* Mantain the OperationType Order when considering the dividing groups

* Remove reordering the jsonpatch operations from the backend

* Fix checkstyle

* Fix UnitTests to comply with no reordering

* Initial idea on how to fix our current jsonpatch builder from python

* fix(JsonUtils): Change JSONPatch library used

When creating a JSONPatch by using the 'createDiff' method, the library
we are using is not returning a correct JSONPatch when removing multiple
items from an array.

Since the library doesn't provide good ways to override this behavior
and fix it, we decided to move away from it and use the json-patch
library only for this specific operation.

* Fix linters

* Add docstrings

* Refactor patch updated on ingestion framework

* Add UnitTests

* Fix linters
2024-04-05 15:52:01 +02:00
Mohit Yadav
5f9a565f3a
[AlertNotication] Fix formatting (#15800)
* - Remove sourceHash from the Activity Feed
- Update Test Case Page Uri Link

* - Remove lifeCycle

* - Add To Field Change List

* - Add asset Url to conversations and Task Updates

* - Make Redirect to Activity Feed Task Page
2024-04-04 18:28:30 +05:30
Mohit Yadav
daae3c48e3
- Do not validate bot domain (#15796) 2024-04-03 16:12:42 +05:30
Teddy
dd53f45cc6
MINOR fix test case search filtering (#15785)
* fix: test case filtering from search endpoint

* style: ran java linting

* fix: updated test case EL in list test
2024-04-03 11:01:54 +02:00
Mohit Yadav
6e8d14fad4
- Change Prompt to consent on every login (#15792) 2024-04-03 13:13:33 +05:30
Mohit Yadav
72bd411fe5
[Vulnerabilities] Update Dependencies to fix Vulnerabilities (#15775)
* [VBY] Fix POm version for affected dependency

* - add cp3 dependency

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-04-03 12:04:01 +05:30
Mohit Yadav
77bb725d5b
- add Step logs for Auth (#15786) 2024-04-03 11:15:13 +05:30
sonika-shah
4948ab3766
Fix backend bug that prevented associated tags from being removed when a glossary term is deleted. (#15676)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-04-03 10:18:57 +05:30
Teddy
4b13403931
Fix #15594 - Implement domain support for test cases (#15736)
* feat: add list from search service logic

* fix: added test and enable ES testing

* style: ran java linting

* fix: ES container startup timeout

* style: ran java linting

* fix: removed array definition as attributes of filter class

* style: ran java linting

* fix: update list from search

* feat: added q param to list from search endpoint

* style: ran java linting

* fix: enable ES test for list from search

* fix: added include/exclude from source

* style: ran java linting

* feat: add domain support for test case

* fix: added search service check for domain inheritence

* feat: added domain query param to list from search

* style: ran java linting
2024-04-02 22:45:48 +02:00
Mohit Yadav
b38b7e3231
- added log (#15777) 2024-04-02 18:39:48 +05:30
Imri Paran
740480fe28
MINOR: change systemApp to system (#15757) 2024-04-01 18:50:43 +05:30
Suman Maharana
bb2684dd62
Fix #11351 Added Kafka Connect connector JSON schemas (#15699) 2024-04-01 18:45:39 +05:30
Mohit Yadav
c061522bbc
Fixes #15483 : Change Generic to Webhook (#15744)
* Fixes #15483 : Change Generic to Webhook

* Typo
2024-04-01 12:36:09 +05:30
harshsoni2024
884029f031
Fix #14089: Add QlikCloud connector support (#15610) 2024-03-28 20:15:22 +05:30
Imri Paran
b0555fe7df
MINOR: added handling for new schedule when migrating quartz context (#15727)
* added handling for new schedule when migrating quartz context

* grab application schedule from the db

* removed unneeded throws

* removed json parsing

* removed unneeded throw
2024-03-27 18:18:42 +01:00
Imri Paran
ec4673587d
CRITICAL: fix AbstractOmAppJobListener (#15701)
* fix AbstractOmAppJobListener

* added appTrigger test

* format

* increased test timeout to 30

* added assertion for not failed

* add break for loop in case of CI
2024-03-27 08:59:10 +01:00
Teddy
9b7f402a16
FIX #14941 - Implement test cases filters (#15616)
* feat: add list from search service logic

* fix: added test and enable ES testing

* style: ran java linting

* fix: ES container startup timeout

* style: ran java linting

* fix: removed array definition as attributes of filter class

* style: ran java linting

* fix: update list from search

* feat: added q param to list from search endpoint

* style: ran java linting

* fix: enable ES test for list from search

* fix: added include/exclude from source

* style: ran java linting

* fix: test case

* fix: exception type
2024-03-27 07:25:11 +01:00
Mohit Yadav
f5a459bce6
Fixes #15686 : Updated Data Insights Report Schema (#15705) 2024-03-26 11:23:30 -07:00
Imri Paran
86a1130e41
MINOR: use appName instead of id (#15693)
* use appName instead of id
2024-03-26 13:45:13 +01:00
Imri Paran
de38ab53c0
Fixes #15614: remove data from quartz (#15612)
* feat(apps): remove data from quartz

1. Remove data from quartz application. Store only app id.
2. Added exception handling when trying to trigger an app.
3. Save bot info in the app data in DB.
4. Added runtime properties in AbstractNativeApplication.execute.
2024-03-26 10:48:43 +01:00
Mohit Yadav
17434429c4
- Remove Schema Changes from TestCase and TestSuite (#15687) 2024-03-26 12:30:19 +05:30
Sriharsha Chintalapani
7a3a271f26
Add entityReferences and entityReferenceList as custom properties (#15448)
* Add entityReferences and entityReferenceList as custom properties

* ui: allow to add custom properties for all available property types.

* make entity type as an array

* Fix label typo and import order in AddCustomProperty component

* Remove unnecessary property types with format

* Refactor CustomPropertyTable.tsx to handle array config and enum config

* Add entity reference options and update custom property form

* Add EntityReference and EntityReferenceList as a custom property

* add validation for date format

* Add date and dateTime input support to PropertyValue component

* Fix import order and add search functionality to type dropdown

* Fix custom property cypress tests

* add input for number, email, timestamp, timeInterval, duration, time, sqlQuery,

* add input support for entityReference and entityReferenceList

* Add placeholders for email, timestamp, start time, end time, and duration inputs

* Refactor PropertyValue component to use destructuring for timeInterval object

* Add minWidth style to PropertyValue component and include SQL query editor

* Add entityReference and entityReferenceList as a generic types and not reference to the existing types

* Remove services from entity reference types list

* handle property values for different property type

* Update ExtensionTable to handle object values in CustomPropertyTable

* Add entity reference list rendering and styling

* Fix file paths in complexTypes.json

* Add regex constant for UNIX timestamp in milliseconds and update language files

* Refactor custom property configuration and add new options

* Fix import order and update property value handling

* add unit tests for different input types for different property type

* add unit test for different property type values

* fix cypress tests

* add cypress test for CRUD for different types

* add cypress test for entity ref and entity ref list property type

* add cypress tests for all the 11 entities which support custom properties

* fix cypress test for createCustomPropertyForEntity

* Add new interfaces and types for CustomPropertyTable

* add cypress test for custom property to create via APIs for entities

* add cypress tests for string,integer, markdown, number, duration, email

* add cypress test for enum property for all entities

* add cypress test for sqlQuery, timestamp and timeInterval property

* fix cypress test for sqlQuery input

* fix flaky cypress test for sqlQuery input

* address comments

* Refactor import statements and update ENTITY_PATH enum

* Update import statement in CustomProperty.ts

* change TimeInterval to Time Interval

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-03-26 11:02:44 +05:30
Onkar Ravgan
891e0bf893
Updated alation json schemas (#15674) 2024-03-26 10:50:43 +05:30
Pere Miquel Brull
4db6dce2f9
MINOR - Add /status endpoint (#15394)
* MINOR - Add `/validate` endpoint

* rename endpoint

* fix test

* add new migration

* Status

* Simplify migration client

* Simplify migration client

* Simplify migration client
2024-03-25 07:05:13 +01:00
Teddy
b9bc8a1fa1
[MINOR] Enable ES Tests for Maven CI (#15657)
* fix: added ES test by default

* style: ran java linting

* fix: increase wait time + make es container not reusable

* fix: updated query search index + increase startup and wait time

* fix: Change order of attribute setting for ES container

* style: ran java linting

* fix: order test and increase wait time for ES in Report test

* fix: adjusted flaky es test
2024-03-24 19:35:48 +01:00
Pere Miquel Brull
9329b5a488
#12678 - Add SAP Hana Backend Converter (#15629)
* #12678 - Add SAP Hana Backend Converter

* Format

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-23 19:36:56 +01:00
Pere Miquel Brull
e01b4b1bd3
MINOR - Fix suggestion accept all (#15658) 2024-03-22 11:23:48 +01:00
Mohit Yadav
5be7bca5f8
Fix failed to parse field [followers] of type [keyword] in document with i (#15670) 2024-03-22 15:32:48 +05:30
mohitdeuex
e52156aa94 Fixes Glossary Term and Tag Redirection 2024-03-22 14:50:06 +05:30
Mohit Yadav
cb411d0aa2
- Security Fix (#15664) 2024-03-22 14:14:39 +05:30
Mohit Yadav
f03ae2d6ab
[Fix] Application Fixes, Updated AppRunType and Removed Server App Inits (#15649)
* - Fix App Run Type
- Remove Init on App Start
- Migrate stats setup for SearchIndexing to execution

* fix the AppLogsViewer unit test failing due to appRunType type changes

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-03-22 08:48:23 +05:30
Sriharsha Chintalapani
8fafb04518
Fix #15501: Explore - Showcase Dashboard project and filter by it (#15640) 2024-03-21 16:07:11 +05:30
Mohit Yadav
33c42b746c
- Add WebsocketNotificationHandler for sending updates for Task, Anno… (#15637)
* - Add WebsocketNotificationHandler for sending updates for Task, Announcement and Mentions on Websocket

* Fix Mentioned User on tasks

* Only notify the relvant user
2024-03-21 15:59:42 +05:30
Pere Miquel Brull
c641a57818
#367C - Suggestions Accept / Reject All (#15589)
* Update workflow

* #367 - Suggestions Accept / Reject All

* Amend comments

* Fix test

* Fix test
2024-03-21 07:56:34 +01:00
Pere Miquel Brull
3fb4dbb55a
MINOR - Application Preview (#15609) 2024-03-21 07:56:14 +01:00
Sriharsha Chintalapani
a6deffdd7c
Fix failing tests in Task Resolution (#15634) 2024-03-20 13:49:03 -07:00
Mohit Yadav
b304cbf55f
- Fix slf4j coming from pac4j (#15636) 2024-03-21 00:27:33 +05:30
Sriharsha Chintalapani
6ac95f2335
Check assignee permissions before updating the entity description/tags (#15582)
* Check assignee permissions before updating the entity description/tags

* make assignee field enabled even if entity already has owner

* minor fix

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-03-20 12:13:20 +05:30
Mohit Yadav
e8f8271b77
- Add docker vars (#15619)
- Modified Azure refresh token logic
2024-03-20 11:47:25 +05:30
Teddy
ad6c823675
[MINOR] validate domain on PATCH request (#15556)
* fix: add domain validation on PATCH update

* style: apply java linting

* fix: added validation for DP, Experts and Reviewers

* style: ran java linting

* fix: skip domain patch test for data products

* style: ran java linting
2024-03-19 23:11:29 -07:00
Chirag Madlani
731813c0e1
chore(ui): fix callback component not loading for okta issue (#15606)
* chore(ui): fix callback component not loading for okta issue

* Vulnerabilities fixes

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-03-19 19:33:46 +05:30
Sriharsha Chintalapani
8377128c93
Application cannot be installed with None as schedule type (#15524)
* Application cannot be installed with None as schedule type

* MINOR: Add / Fix GCS and ADLS - docs, bugs (#15502)

Add GCS and ADLS docs

* Add stack trace while throwing an error to debug (#15522)

* Fix #15533: Fix name & display name for kafka json schema parser (#15534)

* MINOR: postgres add ssl options in yaml (#15538)

* Small change to fix the Glossary TErm Tasks not fetching Owner automatically (#15535)

* remove the DataInsightAlert spec as the alerts test are covered in ObservabilityAlerts spec (#15531)

* MINOR: fix help dropdown item font and icon sizes (#15511)

* fix help dropdown item font and icon sizes

* added unit test for navbarUtils

* fix sonar failure

* changes as per comments

* minor fixes

* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue (#15528)

* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue

* fixed failing unit test

* fixed unit test for Data quality test

* reverting e2eLabeler changes

* chore(ui): separate routes as per categories (#15512)

* chore(ui): seprate routes as per categories

* add tests

* fix test

* domain path fix

* [MINOR] GX logging hierarchy (#15542)

* fix: GX module logging hierarchy

* style: ran python linting

* - Use Entity Type (#15546)

* removed docs 1.4.x (#15550)

* Suggestions Alert new design (#15532)

* update ux of suggestions alert

* locales

* minor changes

* fix descriptions

* minor css fixes

* Fix #11868: Duplicated queries cannot be created (#15519)

* Fix #11868: Duplicate query should throw an error of entityExists

* Fix #11868: Duplicate query should throw an error of entityExists

* fix test

* fix test

* Fix uniquee constraint for checksum in Postgres

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* added OpenMetadataApplication.getDao (#15549)

* Add the entityUrl to the header for ThreadMessages (#15552)

* feat: AppResource (#15555)

forbid modification of system app

* MINOR: Skip source hash generation for service (#15516)

* sync the documentation roadmap page with the getcollate roadmap (#15551)

* Application cannot be installed with None as schedule type

* None type should not register in scheduler

* scheduleTimeline fix

* fix payload of schedule type none and change it to scheduleTimeline

* fix unit test

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-03-19 18:23:25 +05:30
Mohit Yadav
b52fdaf05e
Fix Search Indexing Empty Stats (#15608) 2024-03-19 18:09:03 +05:30
Mohit Yadav
91184ecf5d
Using Backend for Oidc Flow (#15557)
* - Initial Draft of Using Backend for Oidc Flow

* - Review Comments

* - Add Session Handler

* - Add Nonce Validation

* Typo

* support backend auth flow from client side

* Add Refresh Logic

* Remove oidc Config from /auth

* Auth Logout Handling

* Add Refresh as separate endpoint

* return empty on no refresh token

* support refresh token and logout

* fix route issues

* fix path issues

* Redirect to Logout on know session

* fix store issues

* exclude logout api from domain filter

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-03-19 17:15:30 +05:30
sonika-shah
95907f9f49
Fixes #14252 : Check tasks cannot be created by,assigned to,reassigned to bot users (#15587)
* Check tasks cannot be created by,assigned to,reassigned to bot users

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes
2024-03-18 18:38:55 +05:30
Karan Hotchandani
f9f7cde43e
Show fields for other lineage entities (#15513)
* show fields for other entities

* fix minor delete issue

* add support for topics and dashboards

* minor fixes

* Remove constraints of connecting column level lineae

* Enable Column Level lineage for all the entities

* Add delete edge by name apis

* fix fields display on drop

* Fix finding a nested column while adding column level lineage

* Fix finding a nested column while adding column level lineage

* add support for collapsible record and struct fields

* add column level lineage cypress

* minor fixes

* Fix dashboard chart lineage

* Fix dashboard chart lineage

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-03-18 15:54:20 +05:30
Pere Miquel Brull
060a9d7f68
MINOR - Prepare AI chat feed (#15510)
* MINOR - Prepare AI chat feed

* Rename ai to chatbot

* Rename ai to chatbot
2024-03-18 10:29:52 +01:00
Teddy
9097eaf182
fix: index in CSV export for table entities (#15575) 2024-03-18 08:36:30 +01:00
Mayur Singal
b643206bba
Fix #11905: Automated lineage between external table and container snowflake (#15537) 2024-03-15 00:52:41 +05:30