1565 Commits

Author SHA1 Message Date
Pere Miquel Brull
3fb4dbb55a
MINOR - Application Preview (#15609) 2024-03-21 07:56:14 +01:00
Sriharsha Chintalapani
a6deffdd7c
Fix failing tests in Task Resolution (#15634) 2024-03-20 13:49:03 -07:00
Mohit Yadav
b304cbf55f
- Fix slf4j coming from pac4j (#15636) 2024-03-21 00:27:33 +05:30
Sriharsha Chintalapani
6ac95f2335
Check assignee permissions before updating the entity description/tags (#15582)
* Check assignee permissions before updating the entity description/tags

* make assignee field enabled even if entity already has owner

* minor fix

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-03-20 12:13:20 +05:30
Mohit Yadav
e8f8271b77
- Add docker vars (#15619)
- Modified Azure refresh token logic
2024-03-20 11:47:25 +05:30
Teddy
ad6c823675
[MINOR] validate domain on PATCH request (#15556)
* fix: add domain validation on PATCH update

* style: apply java linting

* fix: added validation for DP, Experts and Reviewers

* style: ran java linting

* fix: skip domain patch test for data products

* style: ran java linting
2024-03-19 23:11:29 -07:00
Chirag Madlani
731813c0e1
chore(ui): fix callback component not loading for okta issue (#15606)
* chore(ui): fix callback component not loading for okta issue

* Vulnerabilities fixes

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-03-19 19:33:46 +05:30
Sriharsha Chintalapani
8377128c93
Application cannot be installed with None as schedule type (#15524)
* Application cannot be installed with None as schedule type

* MINOR: Add / Fix GCS and ADLS - docs, bugs (#15502)

Add GCS and ADLS docs

* Add stack trace while throwing an error to debug (#15522)

* Fix #15533: Fix name & display name for kafka json schema parser (#15534)

* MINOR: postgres add ssl options in yaml (#15538)

* Small change to fix the Glossary TErm Tasks not fetching Owner automatically (#15535)

* remove the DataInsightAlert spec as the alerts test are covered in ObservabilityAlerts spec (#15531)

* MINOR: fix help dropdown item font and icon sizes (#15511)

* fix help dropdown item font and icon sizes

* added unit test for navbarUtils

* fix sonar failure

* changes as per comments

* minor fixes

* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue (#15528)

* Minor: fixed DQ edit test case issue and searchIndexDetails typescript issue

* fixed failing unit test

* fixed unit test for Data quality test

* reverting e2eLabeler changes

* chore(ui): separate routes as per categories (#15512)

* chore(ui): seprate routes as per categories

* add tests

* fix test

* domain path fix

* [MINOR] GX logging hierarchy (#15542)

* fix: GX module logging hierarchy

* style: ran python linting

* - Use Entity Type (#15546)

* removed docs 1.4.x (#15550)

* Suggestions Alert new design (#15532)

* update ux of suggestions alert

* locales

* minor changes

* fix descriptions

* minor css fixes

* Fix #11868: Duplicated queries cannot be created (#15519)

* Fix #11868: Duplicate query should throw an error of entityExists

* Fix #11868: Duplicate query should throw an error of entityExists

* fix test

* fix test

* Fix uniquee constraint for checksum in Postgres

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* added OpenMetadataApplication.getDao (#15549)

* Add the entityUrl to the header for ThreadMessages (#15552)

* feat: AppResource (#15555)

forbid modification of system app

* MINOR: Skip source hash generation for service (#15516)

* sync the documentation roadmap page with the getcollate roadmap (#15551)

* Application cannot be installed with None as schedule type

* None type should not register in scheduler

* scheduleTimeline fix

* fix payload of schedule type none and change it to scheduleTimeline

* fix unit test

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: IceS2 <pjt1991@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-03-19 18:23:25 +05:30
Mohit Yadav
b52fdaf05e
Fix Search Indexing Empty Stats (#15608) 2024-03-19 18:09:03 +05:30
Mohit Yadav
91184ecf5d
Using Backend for Oidc Flow (#15557)
* - Initial Draft of Using Backend for Oidc Flow

* - Review Comments

* - Add Session Handler

* - Add Nonce Validation

* Typo

* support backend auth flow from client side

* Add Refresh Logic

* Remove oidc Config from /auth

* Auth Logout Handling

* Add Refresh as separate endpoint

* return empty on no refresh token

* support refresh token and logout

* fix route issues

* fix path issues

* Redirect to Logout on know session

* fix store issues

* exclude logout api from domain filter

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-03-19 17:15:30 +05:30
sonika-shah
95907f9f49
Fixes #14252 : Check tasks cannot be created by,assigned to,reassigned to bot users (#15587)
* Check tasks cannot be created by,assigned to,reassigned to bot users

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes

* Check tasks cannot be created by,assigned to,reassigned to bot users - updated changes
2024-03-18 18:38:55 +05:30
Karan Hotchandani
f9f7cde43e
Show fields for other lineage entities (#15513)
* show fields for other entities

* fix minor delete issue

* add support for topics and dashboards

* minor fixes

* Remove constraints of connecting column level lineae

* Enable Column Level lineage for all the entities

* Add delete edge by name apis

* fix fields display on drop

* Fix finding a nested column while adding column level lineage

* Fix finding a nested column while adding column level lineage

* add support for collapsible record and struct fields

* add column level lineage cypress

* minor fixes

* Fix dashboard chart lineage

* Fix dashboard chart lineage

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-03-18 15:54:20 +05:30
Pere Miquel Brull
060a9d7f68
MINOR - Prepare AI chat feed (#15510)
* MINOR - Prepare AI chat feed

* Rename ai to chatbot

* Rename ai to chatbot
2024-03-18 10:29:52 +01:00
Teddy
9097eaf182
fix: index in CSV export for table entities (#15575) 2024-03-18 08:36:30 +01:00
Mayur Singal
b643206bba
Fix #11905: Automated lineage between external table and container snowflake (#15537) 2024-03-15 00:52:41 +05:30
Teddy
271acc4347
FIX: partitionColumn Migration (#15497)
* fix: added try/catch + null fallback for getString() method of JsonObject instances

* style: ran java linting

* style: ran java linting

* fix: inverted conditional statement

* style: ran java linting

* fix: removed return and added else

---------

Co-authored-by: Ubuntu <ubuntu@ip-10-80-73-174.eu-west-3.compute.internal>
2024-03-14 11:58:52 +05:30
Pere Miquel Brull
fd403bae9a
MINOR - Review query performance (#15553)
* MINOR - Review query performance

* MINOR - Review query performance

* MINOR - Review query performance

* MINOR - Review query performance
2024-03-14 06:37:38 +01:00
Imri Paran
2582ec60f2
feat: AppResource (#15555)
forbid modification of system app
2024-03-13 15:41:02 +00:00
IceS2
be4863a320
Add the entityUrl to the header for ThreadMessages (#15552) 2024-03-13 16:33:24 +01:00
Imri Paran
d3fe165347
added OpenMetadataApplication.getDao (#15549) 2024-03-13 15:25:21 +01:00
Sriharsha Chintalapani
d0efaac877
Fix #11868: Duplicated queries cannot be created (#15519)
* Fix #11868: Duplicate query should throw an error of entityExists

* Fix #11868: Duplicate query should throw an error of entityExists

* fix test

* fix test

* Fix uniquee constraint for checksum in Postgres

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-03-13 13:02:26 +01:00
Mohit Yadav
9216130cd2
- Use Entity Type (#15546) 2024-03-13 15:13:07 +05:30
mgorsk1
98850ab5cc
feat: OpenLineage integration (#15317)
* 🎉 Init OpenLineage connector

Co-authored-by: dechoma <dominik.choma@gmail.com>

* MLH - make linter happy

* review fixes

* 🐛 Fix path for ol event in tests

* 🐛 Fix path for ol event in tests

* Update ingestion/setup.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/metadata.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/models.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* review fixes 2

* linter

* review

* review

* make linter happy

* fix test_yield_pipeline_lineage_details test

* make linter happy

* fix tests

* fix tests 2

---------

Co-authored-by: dechoma <dominik.choma@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-03-12 08:39:25 +01:00
Sriharsha Chintalapani
9a69daf35e
Limit SPeL getValue to SimpleEvaluationContext (#15521)
* Limit SPeL getValue to SimpleEvaluationContext

* Fix pytests
2024-03-12 07:14:11 +05:30
Imri Paran
4bb5550a46
MINOR: add the systemApp property (#15473)
* feat: add "systemApp" property

* use BAD_REQUEST for System Apps uninstall

* use IllegalArgumentException
2024-03-11 15:39:20 +01:00
Sriharsha Chintalapani
7d4f1270ab
Fix #15503: Cache MultiJWKsProvider response (#15504) 2024-03-10 23:08:03 -07:00
Teddy
c7afe29441
ISSUE #15336 - Added type and status for test case list (#15457)
* chore: clean up TestCaseResource tests

* fix: added status and type query params for test cases

* style: ran java linting

* fix: refactor addCondition method in ListFilter

* style: ran java linting
2024-03-08 09:01:07 +01:00
Pere Miquel Brull
5b2427743c
MINOR - Reconfigure app metrics (#15460)
* MINOR - Reconfigure app metrics

* Format
2024-03-07 15:19:21 +01:00
Pere Miquel Brull
1a3ba7fb3f
MINOR - Application Handler instance (#15482)
* Clean docs

* MINOR - AppHandler instance

* MINOR - AppHandler instance

* MINOR - AppHandler instance
2024-03-07 12:24:11 +01:00
Teddy
ec5c3fc395
fix: entity reference look up for domain (#15439) 2024-03-07 08:12:36 +01:00
Imri Paran
182f3a39f5
MINOR: make test setup non-static so it can be overriden (#15451)
- made test hooks non-static
- added getApp
---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-06 14:14:48 +00:00
mohitdeuex
7d4d7aca7b _ Fix Data Issue 2024-03-06 16:37:10 +05:30
mohitdeuex
97289bafce - Fix Search Index App Json Processing Exception 2024-03-06 13:40:25 +05:30
Mohit Yadav
9491e04088
- Fix Poll Interval (#15453)
* - Fix Poll Interval

* make poll interval as 1

* - Add random tests
- Disable Tests for Subscription for Query

* - Checkstyle Fix

* - Remove ondemand jobs as well
- On update remove already init instance

* - use alias

* - typo

* - Search Index Fix
2024-03-06 02:21:28 +05:30
Mohit Yadav
e9281cdccb
- Fixes for Mentions on Teams (#15452) 2024-03-05 13:42:51 +05:30
Pere Miquel Brull
88c3c42b3f
#15425 - Move SecretsManagerUpdateService to migrate command (#15444)
* #15425 - Move SecretsManagerUpdateService to migrate command

* #15425 - Move SecretsManagerUpdateService to migrate command
2024-03-05 06:47:16 +01:00
Mohit Yadav
7e66756821
[Perf Fix] Use Where clause on change event listing (#15430)
* - Use Where clause on change event listing

* - Poll in a minute

* - Fix Entity Url
- Ignore Query Entity for Change Event Update
2024-03-04 22:48:24 +05:30
Mohit Yadav
f2b1622c0f
Add Dao Get Call based on type (#15429)
* Add Dao Get Call based on type

* Keep Jdbi as Attr
2024-03-02 23:43:28 +05:30
Teddy
7424b2f430
ISSUE #15381 - Fix execution summary timeout (#15378)
* feat: added dynamic method to build search aggregation from string

* fix: moved summary computation to ES

* fix: added+updated tests

* style: ran java linting
2024-03-01 16:57:34 +01:00
Mohit Yadav
500e407c8d
Make Recreate Index Default as true (#15413) 2024-03-01 11:56:19 +05:30
Mohit Yadav
ce8a58c126
- Fix User Instance not found (#15412)
- Fix Not Authorized Token Non Present
2024-02-29 22:32:58 +05:30
Sriharsha Chintalapani
cecbf80a2d
Add Custom Propety Config to store format, enum values, entity types (#15302)
* Add Custom Propety Config to store format, enum values, entity types

* Fix import statements and remove unused code

* Add Custom Propety Config to store format, enum values, entity types

* Add support for enum field type in custom properties

* update name in customPropertyConfigTypeValueField

* add custom property config column in custom property table

* Update padding-left in block-editor.less

* Add enum value translation for multiple languages

* update placeholder of config

* fixed python sdk

* add enum type in property value

* add unit tests

* Add Custom Propety Config to store format, enum values, entity types

* update ui to handle the enum config and validation

* Fix enum value handling in EditCustomPropertyModal and PropertyValue

* Update CustomProperty.md with enum values and multi-select option

* add cypress test

* add cypress for multiselect enum value

* Add tests for enum props

* add cypress for editing the enum property

* Add validations to enum

* Fix dependency issue

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2024-02-29 14:36:24 +05:30
Mohit Yadav
d26cb9605f
- Remove Instance on delete of the Application (#15400) 2024-02-29 13:38:47 +05:30
Onkar Ravgan
1fc2c7f974
MINOR: Part 1 of #15090: dbt JSON Schema & Parsing Improvements (#15297) 2024-02-29 10:41:21 +05:30
Teddy
056e6368d0
Issue #14765 - Preparatory Work (#15312)
* refactor!: change partition metadata structure for table entities

* refactor!: updated json schema for TypeScript code gen

* chore: migration of partition for table entities

* style: python & java linting

* updated ui side change for table partitioned key

* miner fix

* addressing comments

* fixed ci error

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-02-28 07:11:00 +01:00
Mayur Singal
f00c679f51
MINOR: Fix Hive Metastore Password Encryption (#15329) 2024-02-27 16:56:17 +05:30
Pere Miquel Brull
b13a50ac68
#15074 - Force AWS Secrets Manager deletion (#15327) 2024-02-27 09:30:39 +01:00
Pere Miquel Brull
10f9fe82a6
#15251 - Fix overwriting of airflow path segments (#15326) 2024-02-27 09:30:28 +01:00
Sriharsha Chintalapani
abfdf0e529
Fix #15205: Container's Datamodel FQN construction (#15354) 2024-02-27 07:23:59 +01:00
Mohit Yadav
da5c6c5f37
Task and Mention Notification (#15338)
* - Properly formatted username in mention
- Added Notification in case of Mention or Task

* - Add Conversation Updates for Task
2024-02-26 12:50:08 +05:30