8994 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
8af194193a
Add stack trace while throwing an error to debug (#15522) 2024-03-12 10:07:46 -07:00
Ayush Shah
1c2fbdd9f4
MINOR: Add / Fix GCS and ADLS - docs, bugs (#15502)
Add GCS and ADLS docs
2024-03-12 21:13:24 +05:30
Shailesh Parmar
189e0b82d0
#15507 Date filtering not working for Incident manager and ui feedbacks (#15515) 2024-03-12 19:08:25 +05:30
Karan Hotchandani
9135b8faaf
Remove data product from glossary assets (#15527)
* filter data products from glossary assets

* fix glossary path

* revert
2024-03-12 18:57:14 +05:30
Sachin Chaurasiya
6344782ac5
Fix(#15421): Azure SSO Issue due to MSAL version (#15509)
* Fix(#15421): Azure SSO Issue due to MSAL version

* Update Jest configuration
2024-03-12 18:46:24 +05:30
Kent Chenery
34b727f6c9
Fixes ISSUE-13473: Ensure MSSQL columns query filters to tables and views (#15530)
* Update queries.py and utils.py to ingest table and view descriptions

* Ensure MSSQL columns query filters to tables and views

* Fix linters

---------

Co-authored-by: Pablo Takara <pjt1991@gmail.com>
2024-03-12 13:56:30 +01:00
Chirag Madlani
a87161a9ed
fix(ui): glossary details path with tabs (#15493) 2024-03-12 16:28:35 +05:30
Mayur Singal
8a2ee00fe3
Fix #15432: make sample data external storage path configurable (#15478) 2024-03-12 15:02:28 +05:30
mgorsk1
98850ab5cc
feat: OpenLineage integration (#15317)
* 🎉 Init OpenLineage connector

Co-authored-by: dechoma <dominik.choma@gmail.com>

* MLH - make linter happy

* review fixes

* 🐛 Fix path for ol event in tests

* 🐛 Fix path for ol event in tests

* Update ingestion/setup.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/metadata.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* Update ingestion/src/metadata/ingestion/source/pipeline/openlineage/models.py

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

* review fixes 2

* linter

* review

* review

* make linter happy

* fix test_yield_pipeline_lineage_details test

* make linter happy

* fix tests

* fix tests 2

---------

Co-authored-by: dechoma <dominik.choma@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-03-12 08:39:25 +01:00
Teddy
36327c2ee9
FIX #15436 - Add disconnect method for databricks client (#15514)
* fix: implement is_disconnect for databricks client

* style: ran python linting
2024-03-12 07:42:04 +01:00
Imri Paran
aade838020
Fixes #15388: Use native backup tools (#15393)
* feat: use native backup tools

1. added mysqldump 8.3 to the ingestion container.
2. documented how to use native tools to back up and restore.
3. added deprecated message on the cli backup and restore.

* added deprecation notice for 1.3 backup

* removed 1.3.x deprecation notice

* added another backup page in 1.3 introducing SQL dump tools

* added --set-gtid-purged=OFF to the mysql dump process
2024-03-12 06:23:05 +01:00
Sriharsha Chintalapani
9a69daf35e
Limit SPeL getValue to SimpleEvaluationContext (#15521)
* Limit SPeL getValue to SimpleEvaluationContext

* Fix pytests
2024-03-12 07:14:11 +05:30
Akash Jain
a36cd24472
fix: pom.xml to reduce vulnerabilities (#15304)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-ORGPOSTGRESQL-6252740

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2024-03-11 08:29:37 -07:00
Imri Paran
4bb5550a46
MINOR: add the systemApp property (#15473)
* feat: add "systemApp" property

* use BAD_REQUEST for System Apps uninstall

* use IllegalArgumentException
2024-03-11 15:39:20 +01:00
Imri Paran
67c57ec4f0
docs: 1.4.x-SNAPSHOT (#15506)
* docs: 1.4.x-SNAPSHOT
added partials
added images
updated paths
2024-03-11 09:42:26 +00:00
Sriharsha Chintalapani
7d4f1270ab
Fix #15503: Cache MultiJWKsProvider response (#15504) 2024-03-10 23:08:03 -07:00
Onkar Ravgan
1f8e232487
Added alation conn arg docs (#15495) 2024-03-08 18:40:04 +05:30
Shailesh Parmar
226db58818
#15336 UI: Add Pagination to Data Quality Tab on Entity pages (#15475)
* #15336 UI: Add Pagination to Data Quality Tab on Entity pages

* fixed failing unit test

* removed test case count and test case status column from column profiler table and added fetch call in column details page

* added unit test for pagination

* removed loading test as it was written for dataQualityTab component.
2024-03-08 17:31:43 +05:30
Karan Hotchandani
14f280bd06
User and applications suggestions for entities (#15345)
* add metapilot app oss side config

* add metapilot app oss side config

* suggestions changes

* locales

* pushing progress

* localisation

* add suggestions count button

* locales

* fix tests

* add tests

* fix sonar issues

* fix tests and cleanup

* fix unit tests
2024-03-08 15:14:37 +05:30
IceS2
7805a0b609
MINOR: Fix athena e2e tests (#15486)
* Comment side effects

* Update assert to match clauses better

* Improve input

* Improve input

* Update assert to match clauses better

* Fix Athena E2E Values

* Uncomment needed steps

* Fix linters
2024-03-08 09:31:06 +01:00
Teddy
c7afe29441
ISSUE #15336 - Added type and status for test case list (#15457)
* chore: clean up TestCaseResource tests

* fix: added status and type query params for test cases

* style: ran java linting

* fix: refactor addCondition method in ListFilter

* style: ran java linting
2024-03-08 09:01:07 +01:00
Akash Jain
0896be2513
fix(docs): Unify Prerequisites of Kubernetes Deployment Docs (#15480)
* fix(docs): Unify Prerequisites for kubernetes deployments

* fix(docs): specify version as `higher` instead of `greater`
2024-03-08 12:54:01 +05:30
Imri Paran
f4932ee420
added log levels to all example ingestion configs config (#15488)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-03-07 16:54:10 +00:00
Ashish Gupta
c03cfe9588
revamp data asset icon to colour one (#15485)
* revamp data asset icon to colored one

* icon and where it is used dimension changes

* minor changes
2024-03-07 21:19:32 +05:30
Pere Miquel Brull
5b2427743c
MINOR - Reconfigure app metrics (#15460)
* MINOR - Reconfigure app metrics

* Format
2024-03-07 15:19:21 +01:00
Chirag Madlani
78d6b72e48
chore(ui): typescript support for cypress tests (#15239)
* chore(ui): typescript support for cypress tests

* convert all js to ts

* fix more types

* fix more types

* updated config for ts file

* fixed failing cypress test

* fixed DQ cypress

* fixed dq flaky test

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-03-07 17:06:33 +05:30
Pere Miquel Brull
1a3ba7fb3f
MINOR - Application Handler instance (#15482)
* Clean docs

* MINOR - AppHandler instance

* MINOR - AppHandler instance

* MINOR - AppHandler instance
2024-03-07 12:24:11 +01:00
Shilpa Vernekar
49d2378eec
1.3.1 Release Doc (#15484) 2024-03-07 16:37:05 +05:30
Pere Miquel Brull
68e6bcf82e
MINOR - Note on airflow docs (#15472) 2024-03-07 08:59:26 +01:00
Shailesh Parmar
26f55b31fb
Minor: fixed ui layout issue of role page (#15481) 2024-03-07 07:26:48 +00:00
Teddy
ec5c3fc395
fix: entity reference look up for domain (#15439) 2024-03-07 08:12:36 +01:00
Teddy
ceaf205f59
Fix #15299 - Handle Table metrics & test cases for Empty Tables (#15469)
* fix: add cli support for computePassedFailedRowCount

* fix: div zero error and improve empty table message

* doc: updated test case page

* style: ran python linting
2024-03-07 07:15:22 +01:00
Italo Batista
647287951d
Update test suite workflow example in ingestion folder (#15476) 2024-03-07 07:13:53 +01:00
Ashish Gupta
d7c21ae440
support unit test for addDomainForm and minor cleanup (#15470) 2024-03-07 05:45:50 +00:00
Imri Paran
182f3a39f5
MINOR: make test setup non-static so it can be overriden (#15451)
- made test hooks non-static
- added getApp
---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-03-06 14:14:48 +00:00
Chirag Madlani
7490663bc8
Cleanup entity details (#15461)
* chore(ui): move entitydetails loading to

* improve version page

* minor improvement for version

* fix tests

* chore(ui): reduce routes from specific to generic to reduce the code (#15404)

* chore(ui): reduce routes from specific to generic to reduce the code

* cleanup on authenticated app router

* fix tests

* fix path for table then other type

* fix cypress

* address comments

* fix routes issue

* fix path issue for versino pages

(cherry picked from commit bb03e594a4113ffd3266ab9220d1b7efc14a50f5)

* fix paths

* fix tests

* fix mock issue

* fix java lint

* fix task path
2024-03-06 17:33:13 +05:30
mohitdeuex
7d4d7aca7b _ Fix Data Issue 2024-03-06 16:37:10 +05:30
mohitdeuex
97289bafce - Fix Search Index App Json Processing Exception 2024-03-06 13:40:25 +05:30
Ashish Gupta
39eb9299e4
supported unit test for email configuration, incident header page and fix some cypress (#15420)
* supported unit test for email conifugration form

* fix cypress for roles and policies

* supported unit test for incident manager header component

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-03-06 13:27:36 +05:30
Mohit Yadav
9491e04088
- Fix Poll Interval (#15453)
* - Fix Poll Interval

* make poll interval as 1

* - Add random tests
- Disable Tests for Subscription for Query

* - Checkstyle Fix

* - Remove ondemand jobs as well
- On update remove already init instance

* - use alias

* - typo

* - Search Index Fix
2024-03-06 02:21:28 +05:30
Chirag Madlani
dd05b67449
Revert "chore(ui): reduce routes from specific to generic to reduce the code …" (#15465)
This reverts commit bb03e594a4113ffd3266ab9220d1b7efc14a50f5.
2024-03-05 23:08:19 +05:30
IceS2
86a2930cfa
Minor: Fix E2E Ingestion Tests (#15462)
* Fix E2E Tests

* Fix E2E Tests

* Update mysql count, schema changes

* Addition to vertica e2e

* Temporary Github Action modification to test

* Fix Redshift round issue post 10 digits

* modify e2e gh file

* fix gh error

* fix matrix syntax

* Fix Redash counts

* Update py-cli-e2e-tests.yml

* Fix Redshift referenced before assignment error

* Revert Py tests e2e

* Modify Elasticsearch configuration

* Modify Elasticsearch configuration

* Update docker-compose.yml

* Test only running the python tests as e2e

* Comment side effects

* Test

* Test

* Fix name

* Add missing shell property

* Add bigquery to e2e

* Uncomment needed step

* test

* test

* test

* test

* Add control ci pipeline

* Add new e2e tests

* test

* fix

* fix

* fix

* Uncomment needed steps

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2024-03-05 16:00:22 +01:00
Teddy
6536ce7c94
fix: move migration to 1.3.1 (#15463) 2024-03-05 15:30:43 +01:00
Teddy
70e1643bd8
doc: added threshold details (#15458) 2024-03-05 18:16:48 +05:30
Teddy
b9e732c5cd
DOC - Updated custom sql documentation (#15440) 2024-03-05 17:30:25 +05:30
Sachin Chaurasiya
491aeb1b7f
Minor: filter out the filterPatterns if excludes and includes are empty (#15449)
* Minor: filter out the filterPatterns if excludes and includes are empty

* Update limit to 20 in getTypeListByCategory
2024-03-05 15:02:17 +05:30
Chirag Madlani
bb03e594a4
chore(ui): reduce routes from specific to generic to reduce the code (#15404)
* chore(ui): reduce routes from specific to generic to reduce the code

* cleanup on authenticated app router

* fix tests

* fix path for table then other type

* fix cypress

* address comments

* fix routes issue

* fix path issue for versino pages
2024-03-05 14:34:01 +05:30
Mohit Yadav
e9281cdccb
- Fixes for Mentions on Teams (#15452) 2024-03-05 13:42:51 +05:30
Harsh Vador
219b6cdc17
fix description related cypress tests (#15434)
* fix description related cypress tests

* fix edit description cypress
2024-03-05 12:01:56 +05:30
Pere Miquel Brull
88c3c42b3f
#15425 - Move SecretsManagerUpdateService to migrate command (#15444)
* #15425 - Move SecretsManagerUpdateService to migrate command

* #15425 - Move SecretsManagerUpdateService to migrate command
2024-03-05 06:47:16 +01:00