11104 Commits

Author SHA1 Message Date
Imri Paran
59854de58d
[GEN-1406]: import plugin and clear plugin message for failed source import (#17788)
* support side effects on source classes by always importing source class

* streamlined error message

* fixed service type extraction for test suite pipeline

* - replaced "custom" with constant
- added quotes for the plugin exception for copy/paste ergonomics
2024-09-12 16:13:03 +02:00
dependabot[bot]
5d972789ea
Bump express in /openmetadata-ui/src/main/resources/ui (#17813)
Bumps [express](https://github.com/expressjs/express) from 4.19.2 to 4.21.0.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/4.21.0/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.21.0)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-12 17:55:33 +05:30
Teddy
e066929ff7
GEN-1380 - Implement support for date_histogram aggregation (#17738)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* feat: add support for date_histogram aggregation

* style: ran java linting

* chore: clean up conflicts

* fix: move from iterator loop to forEach

* fix: removed comment

* style: ran java linting
2024-09-12 13:11:30 +02:00
Imri Paran
3282b057d8
ci: pin spacy version (#17814)
spacy 3.8 requires numpy 2.0 which is not compatible with openmetadata-ingestion requirements:
184e508d9c
2024-09-12 15:12:53 +05:30
Imri Paran
b70b3ce913
added config logging with secrets redacted (#17770) 2024-09-12 10:19:53 +02:00
Teddy
aa399dfd68
MINOR: move constraint update from schemaChanges to postDataMigration (#17801)
* fix: move constraint update from schemaChanges to postDataMigration

* fix: move index after column is created
2024-09-12 08:13:41 +02:00
Pere Miquel Brull
f4d0eba08f
MINOR - Add ES pagination with error handling (#17776)
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
2024-09-12 07:14:56 +02:00
Imri Paran
a3d6c1dd20
MINOR: tests(datalake): use minio (#17805)
* tests(datalake): use minio

1. use minio instead of moto for mimicking s3 behavior.
2. removed moto dependency as it is not compatible with aiobotocore (https://github.com/getmoto/moto/issues/7070#issuecomment-1828484982)

* - moved test_datalake_profiler_e2e.py to datalake/test_profiler
- use minio instead of moto

* fixed tests

* fixed tests

* removed default name for minio container
2024-09-12 07:13:01 +02:00
Ayush Shah
1c6695b8d7
Fixes #17804: Classification API returns Table class for restore (#17806)
* fix: Classification API returns Table class for restore
2024-09-12 10:11:41 +05:30
Siddhant
052430ee07
fix announcement notification. (#17793) 2024-09-11 22:08:54 +05:30
harshsoni2024
e7cfa4889c
MINOR: profiler e2e fix (#17809) 2024-09-11 22:04:22 +05:30
Mayur Singal
454467620c
MINOR: Fix Redshift View Def regex_replace Error (#17810) 2024-09-11 21:02:14 +05:30
Imri Paran
0e43aeb1b6
Fix 17304: make ingestion pipeline APIs public (#17700)
* chore(api): make ingestion pipeline APIs public

* format

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-09-11 19:58:20 +05:30
Ashish Gupta
fd2b080ed6
migrated myData spec to playwright (#17808)
* migrated myData spec to playwright

* remove unwanted test block
2024-09-11 18:58:11 +05:30
Siddhant
25175089fc
[REFACTOR] Improved Structure For Email Module (#17755)
* [fix] code structure

* fix test
2024-09-11 18:23:39 +05:30
Shailesh Parmar
504b84138b
playwright: fixed failing aut of 1.5.4 (#17798)
* playwright: fixed failing aut of 1.5.4

* fixed failing AUT test

* minor fix
2024-09-11 18:22:35 +05:30
Shailesh Parmar
25ff2d7b9c
#1654 Add a search field in Profiler & Data Quality (#17785)
* #16547 Add a search field in Profiler & Data Quality

* fixed failing playwright test

* fixed unit test
2024-09-11 16:35:28 +05:30
harshsoni2024
4f57f4e710
GEN-309: OpenAPI Connector (#17754)
* configure api service metadata

* add rest api service

* fix test con. pyformat changes

* add models, fix test con.

* improve test con.

* add docs, side doc

* fix model data parse, url error fix

* add tests

* fix pytest errors

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-09-11 13:36:53 +05:30
Ashish Gupta
8ad79ad54e
supported left panel resizable panel in some entities (#17772) 2024-09-11 07:27:59 +00:00
Ashish Gupta
5cb897fc28
migrated team-drag-drop spec in playwright (#17780)
* migrated team-drag-drop spec in playwright

* remove the cypress file since the migration is done
2024-09-11 07:27:33 +00:00
harshsoni2024
3922f45a3e
fix typo in profiler metric (#17784) 2024-09-10 22:31:23 +05:30
Pere Miquel Brull
37d35e8dda
Docs - Fix menu (#17787) 2024-09-10 17:25:53 +02:00
Pere Miquel Brull
588e6185b1
DOCS - Getting Started Collate (#17783) 2024-09-10 16:13:20 +02:00
Suman Maharana
094bae7097
Fixes #15565 : Advanced Avro schema recursion depth issue (#17683)
* Fix: Avro schema recursion depth issue

* py_format

* Addressed comments
2024-09-10 18:26:42 +05:30
Ayush Shah
8decd2338f
MINOR: Add Matillion test connection and schema for pipeline service (#17710) 2024-09-10 17:41:28 +05:30
Mayur Singal
b142882848
MINOR: Fix redshift ingestion warnings in case of ext table (#17767) 2024-09-10 15:32:35 +05:30
Shailesh Parmar
b08836efa0
Migrate: All the version page test to playwright (#17765)
* Migrate: classification version page to playwright

* removed migrated test

* add manual wait before run

* migrate all the version page test to playwright

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-10 14:13:21 +05:30
Chirag Madlani
7f3a9f32bb
fix playwright skip workflow to have metrix stratagy to comply with workflow (#17774) 2024-09-10 12:32:58 +05:30
Sriharsha Chintalapani
ea21bb0e2c
fix upgrade docs version (#17773) 2024-09-09 21:59:35 -07:00
Imri Paran
4561655fbd
docs(dq): collate rca (#17763)
added `collate: true` to rca header
2024-09-09 16:59:48 +02:00
Teddy
e4c01c5702
fix: region typo in test (#17766) 2024-09-09 17:54:07 +05:30
Mayur Singal
9107c41a23
GEN-1251: Fix Expected ColumnLineage but got dict (#17708) 2024-09-09 17:52:51 +05:30
Mohit Yadav
0c510e443a
Add Listpage Method (#17761) 2024-09-09 16:21:20 +05:30
Sachin Chaurasiya
2b24c91e2a
feat: add support for running application in subpath (#17434)
* chore: add support for running application in subpath

* refactor code

* chore: Fix isTourRoute function to handle APP_SUB_PATH

* chore: Update RouterUtils and useCustomLocation for better pathname handling

* test: fix unit tests

* chore: Update useLocationSearch test to use useCustomLocation

* test: add unit test for useCustomLocation Hook

* chore: Update UnAuthenticatedAppRouter and WebAnalyticsUtils for useCustomLocation hook

* minor improvement
2024-09-09 14:39:01 +05:30
Chirag Madlani
3a665f5fa5
minor(ui): what's new updated for 1.5.3 (#17762) 2024-09-09 14:35:46 +05:30
Ashish Gupta
d904fe2b10
migrated TeamHierarchy cypress to playwright (#17759) 2024-09-09 13:16:43 +05:30
Shailesh Parmar
ae9de3057d
Migrate: tags spec to playwright (#17758) 2024-09-09 11:48:27 +05:30
Prajwal214
1c90eaaf3d
Docs: Updated Domain in Docker Compose & Docs (#17603)
* Minor: Updating Domain in Docker Compose & Docs

* replace openmetadata to open-metadata

---------

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-09-09 11:47:09 +05:30
Teddy
1f72a3c9c6
GEN-1213 - logic to index test case result (#17706)
* feat: indexed test case results

* feat: added indexation logic for test case results

* style: ran java linting

* fix: IDE warnigns

* chore: added test case results migration

* style: ran java linting

* fix: postgres migration column json ref

* empty commit to trigger queued

* fix: added index on id field
2024-09-09 07:58:45 +02:00
Shailesh Parmar
2dd7892183
Migrate: Data quality and profiler test to playwright (#17705)
* Migrate: Data quality and profiler test to playwright

* migrate profiler ingestion

* migrated test cases to playwright

* migrate filter test from data quality

* migrate domain filter test
2024-09-07 16:18:10 +00:00
Shailesh Parmar
7a065aedc7
playwright: fixed failing AUT test incidentManager and queryEntity (#17749)
* playwright: fixed failing AUT test incidentManager and queryEntity

* remove flakiness by adding manual wait in service ingetion
2024-09-07 14:28:04 +00:00
Sachin Chaurasiya
8568eaf653
test: migrate recently viewed spec to playwright (#17741) 2024-09-06 21:20:36 +05:30
Ashish Gupta
3164bc4803
fix userdetails and personflow flaky test (#17753) 2024-09-06 19:53:26 +05:30
Pere Miquel Brull
c309906a1b
MINOR - Bump Presidio Analyzer and validate support for legal entities (#17750) 2024-09-06 16:07:08 +02:00
Ashish Gupta
3d52258b65
#16644: support resizable column to customProperty (#17735)
* support resizable column to customProperty

* fix sonar by mocking react-ant-column-resize globally

* remove duplicate table less and added css loader fix in webpack config file
2024-09-06 19:23:13 +05:30
Pere Miquel Brull
8526199391
MINOR - Fix Collate docs sync for partials (#17752) 2024-09-06 14:57:29 +02:00
Chirag Madlani
b9ef8cae30
fix playwright redshift delete entity failure (#17743)
* fix playwright redshift delete entity failure

* fix landing page kpi failure

* fix delete service issue

* fix flaky for AddRoleAndAssignToUSer
2024-09-06 17:32:53 +05:30
Ashish Gupta
dcad829a80
fix cypress for the Customzie Landing and EntityVersion page (#17744) 2024-09-06 16:53:00 +05:30
Pere Miquel Brull
1a276450fa
MINOR - Fix lineage GET for names with / and standardize quote calls (#17748)
* MINOR - Fix lineage GET for names with `/` and standardize quote calls

* format

* fix import
2024-09-06 12:12:44 +02:00
IceS2
a5dc937bbe
Remove CostAnalysisWorkflow dependency on Service Connection (#17732)
Connection is not a required attribute for a DatabaseService.
In order to avoid errors we are removing the dependency on this
attribute and checking that the DatabaseServiceType belongs to either
Snowflake, Redshift or BigQuery, which are the supported databases for
this feature.
2024-09-06 10:18:07 +02:00