840 Commits

Author SHA1 Message Date
Mayur Singal
01c77d28a2 MINOR: Add support for cluster key information - bigquery (#19727)
(cherry picked from commit 155571f50a9b313a32be5c76ed1975f10341b519)
2025-02-12 06:34:44 +00:00
Pere Miquel Brull
9931a22ec2 MINOR - Automator - Remove tags by label type (#19681)
* MINOR - Automator - Remove tags by label type

* MINOR - Automator - Remove tags by label type

* MINOR - Automator - Remove tags by label type

* MINOR - Automator - Remove tags by label type

* MINOR - Automator - Remove tags by label type

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
(cherry picked from commit 92c9f0754b132adff32266c2ed65f9d16b83a651)
2025-02-11 14:53:04 +00:00
Aniket Katkar
2cf07200cd Chore: Add the missing generated types and fix json schemas (#19480)
* Add the missing generated types

* Fix the type errors

* fix the JSONs and add respective generated type files
2025-02-10 21:31:05 +05:30
sushi30
43025b5c10 fix: cherry picked map type from main 2025-02-10 09:24:13 +01:00
Imri Paran
9a6480ba74 Fix 19499: feat(apps): add app config in run record (#19544)
* feat(apps): add app config in run record

- changed returned schema type of "status" to "AppRunRecord"!
- added a "config" field in the app record
- added a "pending" stage so that "external" app status can be mapped ti internal app status

* added note about schema compatiblity

* added app config for external apps

* show config for every app run

* add tests

* revert open change for now

* Revert "revert open change for now"

This reverts commit e1492a5c92d1967b3d47230a25df4c2c3d399de2.

* update dependency

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
(cherry picked from commit 5f73dd717b6fae20d95ccbae0857612a352ee816)
2025-02-07 15:24:00 +01:00
Mayur Singal
a5735ae6ed Fix #12094: Add support for temp table lineage (#19654) 2025-02-04 11:55:00 +05:30
github-actions
01165f9a37 chore(release): Prepare Branch for 1.6.4 2025-01-31 06:40:16 +00:00
Ayush Shah
408c393767 Feat: Enhance Kafka SSL configuration support with consumerConfigSSL (#19433) 2025-01-28 15:53:20 +05:30
Mohit Yadav
5337840aa6 Fix EntityHierarchy Schema (#19104)
* Fix Entity Schema

* fix additionalProperties in entityHierarchy json

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
2025-01-27 16:41:35 +05:30
Sriharsha Chintalapani
c194631488 Fix #issue-16041: The persona JSON schema is named Team (#19035) 2025-01-21 07:42:07 -08:00
Siddhant
eef769fb47 #15600: Retention Application : Delete change_events, activity threads, versions based on admin retention policies (#18913)
* feat(retention-policy): initial setup of the Retention Policy app

* refactor: Update logic to make RetentionPolicyApp a ScheduledOrManual app

* refactor: Update retention policy JSON schema and logic to support event subscription, versions, and activity thread with individual retention periods

* refactor: Rename eventSubscriptionRetentionPeriod to changeEventRetentionPeriod

* fix: Implement activity thread retention policy cleanup

* chore: Remove activity thread and versions retention code; add banner and icon

(cherry picked from commit 486230827dfa955a4dc77d3624aa7efb8d557137)
2025-01-21 12:44:36 +00:00
Suman Maharana
6224b54900 Fix #19313 - dbt ingestion picks up wrong service to patch metadata (#19337)
* Fix #19313 - dbt ingestion picks up wrong service to patch metadata

* py format and linting

* Added a flag for searching across databases and docs

* py format
2025-01-15 13:19:57 +05:30
github-actions
32db93ca28 chore(release): Prepare Branch for 1.6.3 2025-01-13 07:19:41 +00:00
Pere Miquel Brull
fef6376d1f MINOR - Add Gov entities for entity ref & Automator Actions (#19090)
* MINOR - Add Gov entities for entity ref

* MINOR - Add Gov entities for entity ref

* add automator configs

* add automator configs
2025-01-10 14:23:25 +05:30
Imri Paran
bfcbdd3b38 fix: reverted deprecated fields on testSuite (#19284)
Added deprecated fields with a notice. This is to ensure migrations that use them do not break.

(cherry picked from commit 7d059029458833ff4d6569c029fb57e2a188a34c)
2025-01-09 02:35:24 +00:00
Matt Chamberlin
64a1be9e57 fix: Add docStore endpoints to Ometa API routes (#19172)
(cherry picked from commit bf8a9e4f46cf62472c810d02392df6bcf826759b)
2025-01-08 10:18:36 +00:00
Mohit Yadav
26829f73d9 [Code Improv] Added Mappers (#19111) - Cherry pick 2025-01-08 12:45:13 +05:30
Suman Maharana
f763575cfe Fixes #17747: dbt update owners (#19144)
* Fixes 17747: dbt update owners

* update messages

* addressed comments

* py_format

* py_format

* Added tests
2025-01-08 11:49:48 +05:30
Suman Maharana
ab16ee659b Fixes #18816 - Airbyte api endpoint (#19207)
* Fix Airbyte api endpoint

* Fix Airbyte api endpoint
2025-01-08 11:46:13 +05:30
sonika-shah
6529e8cf6c Improvement #19065 : Support removing existing enumKeys (for enum type custom property) (#19054)
* Improvement : Support removing existing enumKeys (for enum type custom property)

* initial implementation of background job job runner for enum cleanup

* fix postgres query

* ui: allow existing enum value updates in EditCustomPropertyModal

* create BackgroundJob to use jsonSchema

* feat: add socket event handling for background job part1

* fix(i18n): remove trailing spaces in Galician language JSON file

* refactor to use jsonSchema

* feat(ui): show browser notification for custom property update

* feat(utils): add getCustomPropertyEntityPathname function and tests

* change enumCleanup trigger condition

* feat(i18n): add enum property update message to multiple language JSON files

* enhancement : improve execution flow and better exception handling with test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
(cherry picked from commit 5ccc0c5a2af7c4a074b6e90150bfb06f4abdcbe6)
2025-01-08 11:38:06 +05:30
Mayur Singal
9a63d776b5 Fix #19160: Add Depth Support Part-1 (#19275)
(cherry picked from commit e32ad88c813c0077c26f90ca24b34ebc0f62f9f2)
2025-01-08 05:49:30 +00:00
Karan Hotchandani
49b2030ea8 remove extra assignees from workflow (#19030)
(cherry picked from commit 497b477be3d2064f29825891c1a6436dce83362e)
2025-01-08 10:21:45 +05:30
Pere Miquel Brull
8fc6e8f52b Fix #19147 - Executable Test Suites (#19221)
* backend

* format & tests

* rename backend

* migrations and ingestion

* format & tests

* format & tests

* tests

* format & tests

* tests

* updated ui side of changes

* addressing comment

* fixed failing unit test

* fix test list

* added e2e test, and fixed existing test

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2025-01-07 21:35:23 +01:00
Mohit Yadav
564d33d69b Add Algorithm option for validation in yaml (#19049)
* Add algorithm option in authentication

* ENtity Repository code remove

* Keep Default Value

* Fix Test

---------

Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
(cherry picked from commit 50ae01e2ceeae8180178d24ddc66065e4b96cef0)
2024-12-20 12:45:55 +05:30
IceS2
eca21b3845
Parametrizing Flowable configurations and adding a way to handle history cleaning (#18990) 2024-12-12 10:03:26 +01:00
github-actions
e6d975add2 chore(release): Prepare Branch for 1.6.2 2024-12-12 05:51:36 +00:00
github-actions
f22442054a chore(release): Prepare Branch for 1.6.1 2024-12-10 16:13:05 +00:00
Chirag Madlani
15e519e8b5 Revert persona (#18681)
* Revert "feat: persona based customisation for glossary and glossary term pages (#18454)"

This reverts commit 6fa76ecde915ce027d3ef036206e1a84b360f1f6.

* Revert "chore(ui): move persona as top level settings (#18171)"

This reverts commit 737c076999ebe76167a7c0307e87770a7d8da9f9.

* fix tests

* fix playwright
2024-12-10 09:56:45 +05:30
github-actions
6c080a3174 chore(release): Prepare Branch for 1.6.0 2024-12-10 09:56:45 +05:30
Mayur Singal
6326ae3cb2
MINOR: DB2 Support License (#18928) 2024-12-05 09:54:58 +05:30
Sriharsha Chintalapani
0629750e0a
Minor: fix indexType definition in searchIndex spec (#18912)
* Minor: fix indexType definition in searchIndex spec

* Minor: fix indexType definition in searchIndex spec
2024-12-04 08:50:01 -08:00
Pere Miquel Brull
613fd331e0
MINOR - Clean up configs & add auto classification docs (#18907)
* MINOR - Clean up configs & add auto classification docs

* deprecation notice
2024-12-04 09:32:25 +01:00
Sriharsha Chintalapani
bf00c9c12e
Create a relationship to manage ER based on tableConstraints (#18892)
* Create a relationship to manage ER based on tableConstraints

* Add relationship/remove relationship from entity_relationship table whenever table constriants are updated/added , validate table constraints

* remove findRelatedTables queries

* Add Migrations to add constrait relationship

* remove findRelatedTables code

* Fix postgres migration query

* fix pg migration

* fix test

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-12-03 20:47:34 -08:00
Mayur Singal
9b9509f4b9
MINOR: Mysql Lineage Support Main (#18780)
* MINOR: Mysql Lineage Support Main

* fix test

* fix test

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-29 20:48:42 +05:30
Siddhant
3453c799f7
FIX: Mask Slack App User & Bot Tokens (#18814)
* fix: mask slack user and bot token.

* refactor: Move the code in SlackApp
2024-11-28 23:59:46 +05:30
mgorsk1
da176767a8
feat: add dbt freshness check test (#18730)
* add dbt freshness check

* docs

* run linting

* add test case param definition

* fix test case param definition

* add config for dbt http, fix linting

* refactor (only create freshness test definition when user executed one)

* fix dbt files class

* fix dbt files class 2

* fix dbt objects class

* fix linting

* fix pylint

* fix linting once and for all

---------

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-28 18:30:11 +01:00
harshsoni2024
cb33f274fc
Connector: rename microstrategy connector (#18604) 2024-11-28 18:50:42 +05:30
Suman Maharana
9a21e77e15
Added dbt cloud multi projects and jobs filter (#18801)
* Added dbt cloud multi project and jobs filter

* added tests

* change to array type

* updated yaml config

* added migrations
2024-11-28 16:10:34 +05:30
Aniket Katkar
c101c7cf30
Minor: Auto classification UI (#18785)
* Add the auto classification pipeline option in the service ingestion

* Localization changes for other languages

* Improve the logic for getSupportedPipelineTypes function and add unit tests for newly added logic

* Add playwright tests for the auto classification feature

* Improve the getSupportedPipelineTypes function logic to reduce the cognitive complexity

* update md docs

* Add classificationFilterPattern in the UI schema form order

* fix logs from backend for auto classification

* Changes to view the auto classification logs

* Fix the sonar errors

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-11-27 14:51:59 +05:30
IceS2
8cade39bad
MINOR: Increase visibility on flowable process (#18792)
* Add annotation to turn delete_recursive test into the last one to be executed

* Improve Fetching Entities by only fetching the FQN

* Cut back default batchsize to 500

* implement logging for flowable process

* Implement Error Handling Flow

* Remove testing code

* Checking if User is Reviewer when resolving glossary task
2024-11-26 17:04:59 +01:00
Keshav Mohta
10a7f4ea6c
Fixes #15543: Implemented ElasticSearch Index Template Ingestion (#18686) 2024-11-26 14:42:43 +05:30
Kenil Shah
09db201a57
UI: Add option to stop the running application (#18759)
* Add Stop functionality for Applications

* show kill button by default

* Add option to stop the running application

* fix: show stop button for ruuning & activeerror status

* add localisation files

* added unit tests

* update localisation files

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-11-26 11:55:47 +05:30
Mayur Singal
40a70357e8
MINOR: Add UDF support for SP - backend (#18767) 2024-11-25 15:27:53 +05:30
IceS2
b3d765dce1
MINOR: Governance Workflows fixes (#18744)
* Add annotation to turn delete_recursive test into the last one to be executed

* Improve Fetching Entities by only fetching the FQN

* Cut back default batchsize to 500
2024-11-24 11:30:56 -08:00
Imri Paran
ee7d043035
[GEN-2109] feat(mongo): added ssl support (#18731)
* feat(mongo): added ssl support

Added SSL support for MongoDB using the SSL manager.

Attached a video demo.

- [Example repository for setting up mongodb with SSL](https://github.com/sushi30/mongodb-docker-ssl-example)
- [MongoDB TLS documentation](https://www.mongodb.com/docs/manual/tutorial/configure-ssl/)

* fixed test_doris.py
2024-11-22 08:54:13 -08:00
Siddhant
702c34c0af
NoSchedule as ScheduleType for Slack App (#18715)
* fix: NoSchedule as scheduleType for Slack App

* fix: remove callback url from the config.

* no render of schedule for noSchedule type

* fix: Migrations and add ScheduleType.NoSchedule

* fix: Migrations

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
2024-11-21 22:29:09 -08:00
Ayush Shah
17ffdf9850
fix: modify fqn to allow quotes with dots (#18719) 2024-11-22 09:33:50 +05:30
Imri Paran
d089ffa2d0
doc(mongodb): mongodb+srv connection scheme (#18712)
- added information about the mongodb+srv connection scheme
- added link to atlas guide for getting the connection string
2024-11-21 18:42:35 +00:00
Siddhant
dad3c9d7f2
refactor: Slack app improvements (#18684) 2024-11-19 19:08:47 +05:30
Pere Miquel Brull
c68a45e7d8
Create new Auto Classification Workflow (#18610) 2024-11-19 08:10:45 +01:00