1565 Commits

Author SHA1 Message Date
Mayur Singal
ef67474310
Data Insights Refactor (#16532)
---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Pablo Takara <pjt1991@gmail.com>
Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-07-30 17:38:43 +05:30
sonika-shah
84ad2062b8
fix test (#17229) 2024-07-30 10:07:55 +02:00
sonika-shah
2f1037a10b
Fixes #16232 - fix pagination issues due to similar name (#17187)
* Fix pagination issues due to same name

* Fix postgres migration

* Implement pagination based on (name, id) cursor, storing them in JSON object form

* update comment

* Add tests

* Add tests

* fix tests
2024-07-30 09:22:39 +02:00
Sriharsha Chintalapani
fe107aa3cb
Issue #17012: Multi User/Team Ownership (#17013)
* Add multiple owners

* Multi Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 1

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 2

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 3

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 4

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 5

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 6

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 7

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 8

* Add Migrations for Owner Thread

* update ingestion for multi owner

* fix pytests

* fixed checkstyle

* Add Alert Name to Publishers (#17108)

* Add Alert Name to Publishers

* Fix Test

* Add Bound to Setuptools (#17105)

* Minor: fixed testSummaryGraph issue (#17115)

* feat: updated multi pipeline ui as per new mock (#17106)

* feat: updated multi pipeline ui as per new mock

* translation sync

* fixed failing unit test

* fixed playwright test

* fixed viewService click issue

* sorted pipeline based on test case length

* Added domo federated dataset support (#17061)

* fix usernames (#17122)

* Doc: Updated Doris & Redshift Docs (#17123)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Fix #12677: Added Synapse Connector - docs and side docs (#17041)

* Fix #17098: Fixed case sensitive partition column name in Bigquery (#17104)

* Fixed case sensitive partiion col name bigquery

* update test

* #13876: change placement of comment and close button in task approval workflow (#17044)

* change placment of comment and close button in task approval workflow

* minor change

* playwright test for the close and comment function

* supported ref in activityFeedEditor

* fix playwright test

* added playwright test for data steward

* fix the test for the data streward user

* fix the close button not showing if task has no suggestions and icon fixes

* fix sonar issue

* change glossary and add suggestion button to dropdown button

* fix the glossary failure due to button change

* icon change for add tag and description

* fix glossary cypress failure due to button chnages

* changes as per comments

* MINOR: docs links fix (#17125)

* alation link fix

* dbt yaml config source link fix

* bigquery doc fix

* Explore tree feedbacks (#17078)

* fix explore design

* update switcher icon

* show menu when search query exists

* fix selection of active service

* fix type error

* fix tests

* fix tests

* fix tests

* MINOR: Databricks view TableType fix (#17124)

* Minor: fixed AUT test (#17128)

* Fix #16692: Override Lineage Support for View & Dashboard Lineage (#17064)

* #17065: fix the tags not rendering in selector after selection in edit tags task (#17107)

* fix the tags not rendering in selector after selection in edit tags taks

* added playwright test

* minor changes

* minor fix

* fix the tags not updating in edit and accept tag

* fix explore type changes for collate (#17131)

* MINOR: changed log level to debug (#17126)

* changed log level to debug

* fixed type

* changed type to optional

* Get feed and count data of soft deleted user (#17135)

* Doc: Adding OIDC Docs (#17139)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Doc: Updating Profiler Workflow Docs URL (#17140)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* fix playwright and cypress (#17138)

* Minor: fixed edit modal issue for sql test case (#17132)

* Minor: fixed edit modal issue for sql test case

* fixed test

* Minor: Added whats new content for 1.4.6 release (#17148)

* MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)

* fix: raise for triggering system app

* added scheduleType ScheduledOrManual

* minor: remove "service" field from required properties in createAPIEndpoint schema (#17147)

* initial commit multi ownership

* update glossary and other entities

* update owners

* fix version pages

* fix tests

* Update entity_extension to move owner to array (#17200)

* fix tests

* fix api page errors

* fix owner label design

* locales

* fix owners in elastic search source

* fix types

* fix tests

* fix tests

* Updated CustomMetric owner to entityReferenceList. (#17211)

* Fix owners field in search mappings

* fix search aggregates

* fix inherited label

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 9

* Fix QUeries

* Fix Mysql Queries

* Typo

* fix tests

* fix tests

* fix tests

* fix advanced search constants

* fix service ingestion tests

* fix tests

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: k.nakagaki <141020064+nakaken-churadata@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: harshsoni2024 <64592571+harshsoni2024@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
2024-07-30 08:06:39 +02:00
Siddhant
f1c1615c0d
[Initial draft] Alert Destination Test Functionality (#17207)
* Implemented TemplateProvider.

* validating templatePlaceholders.

* Refactor: Update query to fetch documents for EmailTemplate type. Implemented a function that retrieves documents from doc_store for documents of type "EmailTemplate". This function returns the email template content.

* revert commit.

* revert commit.

* revert commit.

* initial draft test alert functionality.
2024-07-29 19:55:17 +05:30
Mohit Yadav
c6e7938e47
[Issue-16343]Activity Feed Improvements (#17086)
* Add entityRef in Thread_entity

* fix testCase breadcrumb, profile pic and supported entity reference

* fix sonar

* fix feed reseting on deleting comments

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-07-28 05:25:06 -07:00
sonika-shah
e93bf7024f
Fix isParent method to correctly identify FQN parent-child relationships (#17208) 2024-07-27 08:22:06 -07:00
Karan Hotchandani
3bcd481453
allow dropping off pipeline as node (#17020)
* allow dropping off pipeline as node

* Return Pipeline Nodes in Response

* Fix pipeline as a node

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-07-26 15:54:38 +05:30
Imri Paran
9e67d12ab5
fix: change deploy failure message (#17164) 2024-07-26 11:56:56 +02:00
Teddy
ab7b1a444c
[GEN-976] Generic Aggregation Endpoint for Data Quality Reports (#17181)
* fix: added parser for aggregation queryParams

* feat: added generic aggregation logic

* feat: added DQ generic aggregation endpoint

* fix: typo in resources description
2024-07-26 15:23:10 +05:30
Imri Paran
012aa9b804
MINOR: fix: scheduled apps (#17167)
* fix: scheduled apps

run scheduling procedures for apps with Scheduled or ScheduledOrManual schedule type

* format
2024-07-25 15:46:01 +02:00
Siddhant
d17d13cee8
Email template provider (#17015)
* Implemented TemplateProvider.

* validating templatePlaceholders.

* Refactor: Update query to fetch documents for EmailTemplate type. Implemented a function that retrieves documents from doc_store for documents of type "EmailTemplate". This function returns the email template content.

* revert commit.

* revert commit.

* revert commit.

* implemented templateProvider.

* Added placeholders definition (emailTemplatePlaceholder.json) for each emailTemplates.

* implemented resetSeedApi.
implemented schema for emailTemplate and emailTemplatePlaceholder.
implemented util functions for fetching placeHolders.

* Fix Issue in Template Provider

* Updated EmailUtil to use getTemplate from DocStore.
Updated ResetEmailTemplate API to only reset EmailTemplate type documents.
Cleaned up the previous method for retrieving the template from the path.

* fixes.

* added email validation test.

* Remove ftls

* Update code to better structure

* Fix Failing Tests

* Add Custom Exception and error on null entity

* Update Default Template Provier

* Fix Condition

* Correct Message

* added dataInsightReport.json

* fix dataInsightReport.json

* Fix Failing Test

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-07-25 12:03:34 +05:30
Mayur Singal
533d88905a
MINOR: Fix Trino Azure config sceret not hidden (#17158) 2024-07-24 15:17:26 +02:00
Onkar Ravgan
79348a2259
MINOR: Added Alation Sink connector (#16982) 2024-07-24 12:08:07 +05:30
Imri Paran
b41a505795
MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)
* fix: raise for triggering system app

* added scheduleType ScheduledOrManual
2024-07-23 17:42:26 +02:00
sonika-shah
8f5ca552e3
Get feed and count data of soft deleted user (#17135) 2024-07-23 10:19:02 +05:30
Mayur Singal
5140203311
Fix #16692: Override Lineage Support for View & Dashboard Lineage (#17064) 2024-07-22 20:42:38 +05:30
Suman Maharana
d3ea1ead01
Fix #12677: Added Synapse Connector - docs and side docs (#17041) 2024-07-22 12:35:46 +05:30
Mohit Yadav
ca6661b742
Add Alert Name to Publishers (#17108)
* Add Alert Name to Publishers

* Fix Test
2024-07-20 18:51:58 +05:30
Teddy
b568444d5e
fix: handle potential null pointer in test case reindex (#17100) 2024-07-19 13:07:48 +02:00
Mohit Yadav
75fcb03041
Fix Condition for deleted App (#17096) 2024-07-19 12:38:54 +05:30
Teddy
13daa3668a
Fix: test case indexing -- remove changeDescription from testSuites list (#17083)
* fix: test case indexing -- remove changeDescription from testSuites list

* fix: change type to interface

* style: ran java linting
2024-07-19 08:19:45 +02:00
Mohit Yadav
b1620e682a
Fix Users Issue due to capital names (#16828)
* Fix Users Issue due to capital names

* Fixed Tests

* No lowercasing name

* Revert

* toLowerCase

* fix email casing from UI side on basic auth

* compare lowercase email only from the loggedInUser

* address comments

* Updated LowerCase UserName on updates

* revert ui changes

* Migrate Name and Email

* cypress failure

* fix glossary test

* fix activity feed test

* Compare by Lowercasing Email and username

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-07-19 11:39:09 +05:30
Mohit Yadav
8561022c70
Add Sync Option in OpenmetadataOperations (#17089) 2024-07-19 01:17:12 +05:30
Mohit Yadav
c7710481b5
Fix App Issue (#17088) 2024-07-19 01:17:03 +05:30
Mohit Yadav
28218ec612
Ignore Entity No Change Events (#17087) 2024-07-19 01:16:50 +05:30
Mohit Yadav
ebdd7f7fd9
Centralize OIDC Flow to handler, and refresh logic (#17082)
* Centralize OIDC Flow to handler, and refresh logic

* Remove forced condition

* Return on success
2024-07-18 23:53:50 +05:30
Teddy
e4b31f9d65
fix: supportedDataType PSQL query (#17069) 2024-07-18 16:47:05 +02:00
Sachin Chaurasiya
552983446a
minor: add apiService, apiEndpoint and apiCollection entity SearchIndexingApplication-collate.json (#17067) 2024-07-18 17:20:48 +05:30
Teddy
cbfdd54057
fix: test case summary update on test result PUT (#17053) 2024-07-17 18:47:33 +02:00
Mohit Yadav
5a959836a8
Fix Issue in Import Table (#16974) 2024-07-16 18:47:19 +05:30
sonika-shah
692c21f2f3
Fix #15735: Glossary,Term, Classification,Tag rename operation fixes (#16874)
* Fix #15735: Glossary,Term, Classification,Tag rename operation fixes

* add playwright for rename

* make description fields mandatory even if it contains whitespaces

* fix review comments

* hide edit button for system apps

* fix glossary owner reviewer spacing

* fix glossary term permission issue

* rename function to entityRelationshipReindex

* fix merge errors

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2024-07-16 17:20:36 +05:30
sonika-shah
0853e4b5b9
Fix exact FQN matching for alert filter -filterByTableNameTestCaseBelongsTo (#17034) 2024-07-16 08:26:19 +02:00
Teddy
924a100ab4
[GEN-876] Implement DQ dimension filter for test cases (#17032)
* fix: typo in key for data dimension

* fix: table test key typo in data dimension

* fix: typo in migration util

* fix: add filter test cases by dimensions in search API

* style: ran java linting
2024-07-16 08:12:39 +02:00
Siddhant
d10c129ed3
Fixes 16622 - tests for EventSubscription for different resources with filters (#17014)
* Implemented TemplateProvider.

* validating templatePlaceholders.

* Refactor: Update query to fetch documents for EmailTemplate type. Implemented a function that retrieves documents from doc_store for documents of type "EmailTemplate". This function returns the email template content.

* revert commit.

* revert commit.

* revert commit.

* added tests for EventSubscription for different resources with filters.
2024-07-16 11:08:38 +05:30
Sriharsha Chintalapani
cd85fe4530
Minor: fix API Service Index entity type (#17028) 2024-07-15 07:26:53 -07:00
Sachin Chaurasiya
6e99fe7bda
fix(#15683): backend validation error for the following property types (#16881)
* fix(#15683): backend validation error for the following property types

* feat: Update supported date and datetime formats

* test: add e2e playwright test for custom properties

* chore: remove cypress test for custom properties

* Add date, dateTime, time backend support for custom property

* fix: update custom property display names in AddCustomProperty component

* feat: Update supported date and time formats

* chore: Update supported date and time formats

* feat: Update date and time formats in CustomProperty

* test: add playwright test

* Update supported date and time formats

* feat: Add tests for custom properties in Playwright in 2 parts

* Update supported date and time formats

* Update supported date and time formats

* chore: Update date format to uppercase in PropertyValue component

* feat: Add support for custom date format in PropertyValue component

* Update supported date and time formats

* test: add playwright test for time, dateTime, timeInterval and date properties

* Update supported time formats

* chore: Add focus to time and date pickers before filling values

* chore: Add focus to time and date pickers before filling values

* Remove date, dateTime, time from type_entity

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-07-15 11:37:38 +05:30
Sriharsha Chintalapani
d27f518f26
Minor: Fix API docs (#17011)
* Fix API docs

* Fix Linting issues

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-07-13 06:38:20 -07:00
Sriharsha Chintalapani
4dca66d739
Minor: Fix API Endpoint listings via apiCollection param (#16994)
* Minor: Fix API Endpoint listings via apiCollection param

* Minor: Fix API Endpoint listings via apiCollection param

* Fix build failures

* Fix build failures
2024-07-11 22:35:48 -07:00
sonika-shah
0bf7577175
Fixes #16788 : Fix feed and count api query performance (#16993)
* Fixes #16788 : Fix feed and count api query performance

* Fixes #16788 : Fix feed and count api query performance

* Fixes #16788 : Fix feed and count api query performance

* postgres fixes

* rename thread_entity indexes
2024-07-11 14:18:33 +05:30
Pere Miquel Brull
8d739563f2
FIX CL-548 - Encrypt JWT Token w/ Secrets Manager (#16861)
* encrypt jwt

* encrypt jwt

* Handle token revokes with SM

* #10192 - Validate both include and excludes filters

* #10192 - Validate both include and excludes filters

* docs
2024-07-11 09:16:48 +02:00
Matt Chamberlin
d757aa9d77
Fixes 16652: add GCS storage service (#16917)
* FEAT-16652: add GCS storage service

* reformat

* update connection tests

* fix tests

* relax google-cloud-storage version constraint

* fix GCP config in tests

---------

Co-authored-by: Matthew Chamberlin <mchamberlin@ginkgobioworks.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-07-10 14:03:28 +02:00
harshsoni2024
0caa8a8018
API service sample data (#16971)
* add sample data for api service

* pylint fix

* correct service connection json

* fix sample data

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-07-09 22:06:47 -07:00
Mohit Yadav
b353226d97
Fix Ingestion Pipeline Url (#16953) 2024-07-09 20:03:43 +05:30
Aniket Katkar
b4dc4df811
Minor: Automation improvement OSS requirements (#16832)
* Backend changes to introduce applicationType and airflowConfig fields in ingestion pipeline ES data

* Add on demand status fetch logic fo IngestionRecentRuns component

* Fix the IngestionRecentRuns test failure

* Update the test for IngestionRecentRun

* Include only 'scheduleInterval' in 'airflowConfig' field for ingestion_pipeline_search_index

* add new localization message

* Add common playwright functions to use in automator tests

* Remove the double license

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-07-09 16:18:02 +05:30
Ashish Gupta
15ae2d3cc3
MINOR: supported all_index in search index configuration form (#16571)
* supported all_index in search index configuration form

* allow clear in select widget

* supported tree select for the entities

* playwright test

* added env for the run application status test

* fix beta badge color, color of checkbox and changes as per comments

* minor fix

* fix sonar issue
2024-07-09 14:57:12 +05:30
Pere Miquel Brull
27f4d9799e
REL #460-CL - Metadata Actions Create Permissions (#16955)
* REL #460-CL - Metadata Actions Create Permissions

* format
2024-07-09 11:13:57 +02:00
Pere Miquel Brull
97a733b704
FIX #16231 - Ingestion Pipeline w/ Bot Assignment (#16941)
* FIX #16231 - Ingestion Pipeline w/ Bot Assignment

* format
2024-07-08 11:19:16 +02:00
Sriharsha Chintalapani
74573ee4fa
Issue #10933: New Entity: API Services (#16878)
* API Service Schemas

* Create API Service Schemas

* Create API Service Schemas

* Add API Collection APIs

* Add API Endpoint APIs

* Fix #10933: New Entity: API Services

* Fix Postgres schema creation for API entities

* domain ref

* fix RESTConnection.json

* Fix openAPI reserved keyword

* fix ref

* Fix for Java Heap Space Issue

* fix APISchema spec

* fix APISchema spec

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-07-05 06:35:32 -07:00
Pere Miquel Brull
7e98ece3e5
MINOR - Pydantic V2 warnings and better exception msg (#16916) 2024-07-04 14:54:41 +02:00