2200 Commits

Author SHA1 Message Date
Teddy
271acc4347
FIX: partitionColumn Migration (#15497)
* fix: added try/catch + null fallback for getString() method of JsonObject instances

* style: ran java linting

* style: ran java linting

* fix: inverted conditional statement

* style: ran java linting

* fix: removed return and added else

---------

Co-authored-by: Ubuntu <ubuntu@ip-10-80-73-174.eu-west-3.compute.internal>
2024-03-14 11:58:52 +05:30
Pere Miquel Brull
fd403bae9a
MINOR - Review query performance (#15553)
* MINOR - Review query performance

* MINOR - Review query performance

* MINOR - Review query performance

* MINOR - Review query performance
2024-03-14 06:37:38 +01:00
Imri Paran
2582ec60f2
feat: AppResource (#15555)
forbid modification of system app
2024-03-13 15:41:02 +00:00
IceS2
be4863a320
Add the entityUrl to the header for ThreadMessages (#15552) 2024-03-13 16:33:24 +01:00
Imri Paran
d3fe165347
added OpenMetadataApplication.getDao (#15549) 2024-03-13 15:25:21 +01:00
Sriharsha Chintalapani
d0efaac877
Fix #11868: Duplicated queries cannot be created (#15519)
* Fix #11868: Duplicate query should throw an error of entityExists

* Fix #11868: Duplicate query should throw an error of entityExists

* fix test

* fix test

* Fix uniquee constraint for checksum in Postgres

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-03-13 13:02:26 +01:00
Mohit Yadav
9216130cd2
- Use Entity Type (#15546) 2024-03-13 15:13:07 +05:30
mgorsk1
98850ab5cc
feat: OpenLineage integration (#15317)
* 🎉 Init OpenLineage connector

Co-authored-by: dechoma <dominik.choma@gmail.com>

* MLH - make linter happy

* review fixes

* 🐛 Fix path for ol event in tests

* 🐛 Fix path for ol event in tests

* Update ingestion/setup.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/metadata.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/models.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* review fixes 2

* linter

* review

* review

* make linter happy

* fix test_yield_pipeline_lineage_details test

* make linter happy

* fix tests

* fix tests 2

---------

Co-authored-by: dechoma <dominik.choma@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-03-12 08:39:25 +01:00
Sriharsha Chintalapani
9a69daf35e
Limit SPeL getValue to SimpleEvaluationContext (#15521)
* Limit SPeL getValue to SimpleEvaluationContext

* Fix pytests
2024-03-12 07:14:11 +05:30
Imri Paran
4bb5550a46
MINOR: add the systemApp property (#15473)
* feat: add "systemApp" property

* use BAD_REQUEST for System Apps uninstall

* use IllegalArgumentException
2024-03-11 15:39:20 +01:00
Sriharsha Chintalapani
7d4f1270ab
Fix #15503: Cache MultiJWKsProvider response (#15504) 2024-03-10 23:08:03 -07:00
Teddy
c7afe29441
ISSUE #15336 - Added type and status for test case list (#15457)
* chore: clean up TestCaseResource tests

* fix: added status and type query params for test cases

* style: ran java linting

* fix: refactor addCondition method in ListFilter

* style: ran java linting
2024-03-08 09:01:07 +01:00
Pere Miquel Brull
5b2427743c
MINOR - Reconfigure app metrics (#15460)
* MINOR - Reconfigure app metrics

* Format
2024-03-07 15:19:21 +01:00
Pere Miquel Brull
1a3ba7fb3f
MINOR - Application Handler instance (#15482)
* Clean docs

* MINOR - AppHandler instance

* MINOR - AppHandler instance

* MINOR - AppHandler instance
2024-03-07 12:24:11 +01:00
Teddy
ec5c3fc395
fix: entity reference look up for domain (#15439) 2024-03-07 08:12:36 +01:00
Imri Paran
182f3a39f5
MINOR: make test setup non-static so it can be overriden (#15451)
- made test hooks non-static
- added getApp
---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-06 14:14:48 +00:00
mohitdeuex
7d4d7aca7b _ Fix Data Issue 2024-03-06 16:37:10 +05:30
mohitdeuex
97289bafce - Fix Search Index App Json Processing Exception 2024-03-06 13:40:25 +05:30
Mohit Yadav
9491e04088
- Fix Poll Interval (#15453)
* - Fix Poll Interval

* make poll interval as 1

* - Add random tests
- Disable Tests for Subscription for Query

* - Checkstyle Fix

* - Remove ondemand jobs as well
- On update remove already init instance

* - use alias

* - typo

* - Search Index Fix
2024-03-06 02:21:28 +05:30
Mohit Yadav
e9281cdccb
- Fixes for Mentions on Teams (#15452) 2024-03-05 13:42:51 +05:30
Pere Miquel Brull
88c3c42b3f
#15425 - Move SecretsManagerUpdateService to migrate command (#15444)
* #15425 - Move SecretsManagerUpdateService to migrate command

* #15425 - Move SecretsManagerUpdateService to migrate command
2024-03-05 06:47:16 +01:00
Mohit Yadav
7e66756821
[Perf Fix] Use Where clause on change event listing (#15430)
* - Use Where clause on change event listing

* - Poll in a minute

* - Fix Entity Url
- Ignore Query Entity for Change Event Update
2024-03-04 22:48:24 +05:30
Mohit Yadav
f2b1622c0f
Add Dao Get Call based on type (#15429)
* Add Dao Get Call based on type

* Keep Jdbi as Attr
2024-03-02 23:43:28 +05:30
Teddy
7424b2f430
ISSUE #15381 - Fix execution summary timeout (#15378)
* feat: added dynamic method to build search aggregation from string

* fix: moved summary computation to ES

* fix: added+updated tests

* style: ran java linting
2024-03-01 16:57:34 +01:00
Mohit Yadav
500e407c8d
Make Recreate Index Default as true (#15413) 2024-03-01 11:56:19 +05:30
Mohit Yadav
ce8a58c126
- Fix User Instance not found (#15412)
- Fix Not Authorized Token Non Present
2024-02-29 22:32:58 +05:30
Sriharsha Chintalapani
cecbf80a2d
Add Custom Propety Config to store format, enum values, entity types (#15302)
* Add Custom Propety Config to store format, enum values, entity types

* Fix import statements and remove unused code

* Add Custom Propety Config to store format, enum values, entity types

* Add support for enum field type in custom properties

* update name in customPropertyConfigTypeValueField

* add custom property config column in custom property table

* Update padding-left in block-editor.less

* Add enum value translation for multiple languages

* update placeholder of config

* fixed python sdk

* add enum type in property value

* add unit tests

* Add Custom Propety Config to store format, enum values, entity types

* update ui to handle the enum config and validation

* Fix enum value handling in EditCustomPropertyModal and PropertyValue

* Update CustomProperty.md with enum values and multi-select option

* add cypress test

* add cypress for multiselect enum value

* Add tests for enum props

* add cypress for editing the enum property

* Add validations to enum

* Fix dependency issue

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2024-02-29 14:36:24 +05:30
Mohit Yadav
d26cb9605f
- Remove Instance on delete of the Application (#15400) 2024-02-29 13:38:47 +05:30
Onkar Ravgan
1fc2c7f974
MINOR: Part 1 of #15090: dbt JSON Schema & Parsing Improvements (#15297) 2024-02-29 10:41:21 +05:30
Teddy
056e6368d0
Issue #14765 - Preparatory Work (#15312)
* refactor!: change partition metadata structure for table entities

* refactor!: updated json schema for TypeScript code gen

* chore: migration of partition for table entities

* style: python & java linting

* updated ui side change for table partitioned key

* miner fix

* addressing comments

* fixed ci error

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-02-28 07:11:00 +01:00
Mayur Singal
f00c679f51
MINOR: Fix Hive Metastore Password Encryption (#15329) 2024-02-27 16:56:17 +05:30
Pere Miquel Brull
b13a50ac68
#15074 - Force AWS Secrets Manager deletion (#15327) 2024-02-27 09:30:39 +01:00
Pere Miquel Brull
10f9fe82a6
#15251 - Fix overwriting of airflow path segments (#15326) 2024-02-27 09:30:28 +01:00
Sriharsha Chintalapani
abfdf0e529
Fix #15205: Container's Datamodel FQN construction (#15354) 2024-02-27 07:23:59 +01:00
Mohit Yadav
da5c6c5f37
Task and Mention Notification (#15338)
* - Properly formatted username in mention
- Added Notification in case of Mention or Task

* - Add Conversation Updates for Task
2024-02-26 12:50:08 +05:30
Sriharsha Chintalapani
cd251ea387
Fix #15231: Glossary tasks is not showing on landing page to reviewer (#15340) 2024-02-25 23:13:11 -08:00
Pere Miquel Brull
cc878bf94e
MINOR - Prepare App Instances & fix bigtable json (#15292)
* MINOR - Prepare App Exception & fix bigtable json

* Do not init the app all the time and allow to fetch initialized resources

* init installed apps

* Add runtime props

* Add runtime props

* Format
2024-02-23 08:14:12 +01:00
Ashish Gupta
3adc1e5d9e
throw error message on test email config failure (#15311) 2024-02-22 18:17:31 +05:30
Mohit Yadav
0892da51b6
Clustering jobs across servers (#15277)
* - Added Jdbc Store for Quartz Job
- Added tables schema for Mysql and Postgresql

* Catch Object Already Exists

* Drop tables extra statements

* Use Proper Dialects
2024-02-21 21:46:30 +05:30
Pere Miquel Brull
62c0cc7563
#13985 - Azure KV Secrets Manager (#15192)
* #13985 - Azure KV Secrets Manager

* Format

* #13985 - Azure KV Secrets Manager

* #13985 - Azure KV Secrets Manager

* Simplify credentials loading

* Simplify credentials loading

* Simplify credentials loading
2024-02-20 07:18:35 +01:00
Mayur Singal
64e3cedeea
MINOR: Improve Kafka Test Connection (#15207) 2024-02-19 10:11:52 +05:30
Teddy
e72c80f264
MINOR - fix test definition deletion (#15203)
* fix: added provider for testDefinition entities

* fix: changed testDefinition <-> testCase relationship + allow recursive deletion of testDefinition

* fix: added migration steps

* style: ran java linting
2024-02-15 18:22:26 +00:00
Mohit Yadav
92fd428380
Fix Cache Init (#15196) 2024-02-15 19:19:03 +05:30
Mohit Yadav
3e3c067c07
Create Admin Password for Admin User (#15191) 2024-02-15 17:18:56 +05:30
mohitdeuex
84d2aaaf30 Check if Smtp is Enabled to set random password 2024-02-15 16:28:10 +05:30
mohitdeuex
8c6b9025c1 Check if Smtp is Enabled to set random password 2024-02-15 16:25:56 +05:30
Mohit Yadav
0b7a4f8839
Add new Template and Graph building logic for Insights reporting (#15184) 2024-02-15 13:45:45 +05:30
Mohit Yadav
20876fa1ad
Fix Email Test Issues (#15183) 2024-02-14 21:22:32 +05:30
Mohit Yadav
9fae19dd7a
format cron from unix to quartz for internal apps , for others use unix (#15070)
* format cron from unix to quartz for internal apps , for others use unix

* Add Migration Files for 131

* Add Migrations

* Fix Json Issue and Add Exception Handling for force

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-02-14 19:59:14 +05:30
Imri Paran
aeb5fbe303
fixes #12591: add BigTable (#15122)
* feat(connector): add BigTable

* bigtable work

1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter

* docs moved to separate PR

* format files

* minor cosmetic

- removed TODO
- changed headers' year to 2024 for new files
- fixed typos

* format

* formatting and comments

1. added missing docstrings.
2. abstracted the _find_instance method.
3. aliased the IDs used in the BigTable connection

* added comment regarding private key

* added comments regarding column families

* enclose get_schema_name_list in `try/except/else`

* format

* streamlined get_schema_name_list to include all logic in the try block
2024-02-13 08:28:01 +01:00