yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-11-01 19:18:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,371 Commits 873 Branches 177 Tags
Commit Graph

2849 Commits

Author SHA1 Message Date
IceS2
cb2ef3f559 Fix missing cast to str (#18016) 2024-09-30 07:55:49 +05:30
Suman Maharana
2348614695 Added DBT tests with versionless and fixed v7 parsing (#18028) 2024-09-27 19:57:13 +05:30
Suman Maharana
25bda0f756 Minor: fix lineage & queries in dbt (#17999) 2024-09-27 19:48:56 +05:30
Suman Maharana
5f234cdbc4 Fix Manifest is not parsed correctly on dbt versionless (#17975) 2024-09-27 19:47:46 +05:30
harshsoni2024
27816cb964 allow powerbi datamodel children in col.lineage (#18030) 2024-09-27 19:30:08 +05:30
Mayur Singal
3e5cc923bf MINOR: MSTR connector import fix (#18025) 2024-09-27 16:57:35 +05:30
github-actions
95bfb5b912 chore(release): Prepare Branch for 1.5.6 2024-09-25 08:11:38 +00:00
Pere Miquel Brull
fe2681f022 FIX #17896 - Python lineage SDK to work with Uuid & FQN models (#17928) 2024-09-23 11:21:31 +05:30
Pere Miquel Brull
c75378f8e8 Merge branch '1.5.5' of github.com:open-metadata/OpenMetadata into 1.5.5 2024-09-20 16:07:16 +02:00
Pere Miquel Brull
ad03f9e237 GEN-996 - Allow PII Processor without storing Sample Data (#17927) 
* GEN-996 - Allow PII Processor without storing Sample Data

* fix import

* fix import
 2024-09-20 16:07:11 +02:00
Ayush Shah
c90b7b0be5 Fixes #17869: Add validations in place for salesforce connection (#17870) 2024-09-20 18:00:07 +05:30
Imri Paran
6b3f4646c6 ci: pin spacy version (#17814) 
spacy 3.8 requires numpy 2.0 which is not compatible with openmetadata-ingestion requirements:
184e508d9c

(cherry picked from commit 3282b057d84630dc04f9967678446db420d95bac)
 2024-09-20 12:19:27 +02:00
Pere Miquel Brull
01e4b04573 MINOR - Bump Presidio Analyzer and validate support for legal entities (#17750) 2024-09-20 10:36:44 +02:00
Imri Paran
e22a66fe45 Fix 17903: fix(data-quality): snowflake data diff (#17907) 
* fix(data-quality): snowflake data diff

- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality

* reverted unintended change

(cherry picked from commit 21af02d8d5d65ce73645b5396b3cd2eaee1fac19)
 2024-09-20 08:17:29 +02:00
Mayur Singal
eda9ecc83f MINOR: Apply multi threading in View Lineage Processing (#17922) 2024-09-19 18:57:31 +05:30
Pere Miquel Brull
9f78b09c79 GEN-1493 - Fix paginate_es in opensearch (#17858) 
* GEN-1493 - Fix opensearch pagination

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
 2024-09-19 10:27:51 +02:00
Pere Miquel Brull
4e7b1381b1 GEN-1410 - Improve PII Logging information (#17835) 2024-09-19 10:27:20 +02:00
github-actions
c55b8efe36 chore(release): Prepare Branch for 1.5.5 2024-09-16 03:19:15 +00:00
Imri Paran
6cd5a43fc4 [GEN-1406]: import plugin and clear plugin message for failed source import (#17788) 
* support side effects on source classes by always importing source class

* streamlined error message

* fixed service type extraction for test suite pipeline

* - replaced "custom" with constant
- added quotes for the plugin exception for copy/paste ergonomics

(cherry picked from commit 59854de58d000aae01bcc29c7194f7388614bdda)
 2024-09-13 11:12:58 +02:00
Mayur Singal
05cb36f8db MINOR: make type optional in ES Response (#17832) 
* MINOR: make type optional in ES Mixin

* make none as default

* pyformat
 2024-09-13 10:25:35 +02:00
Pere Miquel Brull
69fcd6a572 MINOR - Add ES pagination with error handling (#17776) 
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
 2024-09-12 09:42:23 +02:00
Mayur Singal
e23a18b88c MINOR: Fix Redshift View Def regex_replace Error (#17810) 2024-09-11 21:32:10 +05:30
github-actions
53cc84aef1 chore(release): Prepare Branch for 1.5.4 2024-09-10 05:59:03 +00:00
Pere Miquel Brull
f9dd7b53cb MINOR - Fix lineage GET for names with / and standardize quote calls (#17748) 
* MINOR - Fix lineage GET for names with `/` and standardize quote calls

* format

* fix import
 2024-09-06 14:53:17 +02:00
Pere Miquel Brull
fa198f2942 MINOR - Better PII classification for JSON data (#17734) 
* MINOR - Better PII classification for JSON data

* linting
 2024-09-06 14:52:14 +02:00
Onkar Ravgan
f829c506c1 Fixed dbt cloud run_res name (#17694) 2024-09-05 10:40:36 +05:30
Pere Miquel Brull
75be6b69dd MINOR - PII Scanner tests and log levels (#17686) 
* MINOR - PII Scanner tests and log levels

* MINOR - PII Scanner tests and log levels
 2024-09-04 14:27:30 +02:00
nicor88
d068a59aa8 fixes 17648: add tags and description for tableau published data source (#17678) 
* tableau data-source tags and description

* tweaks

* PR review

* change test description

* black formatting
 2024-09-03 15:20:11 +05:30
Sriharsha Chintalapani
a477e23854 create 1.5.3 release branch 2024-09-02 10:49:43 -07:00
Mayur Singal
feacabb2f3 MINOR: Fix athena lineage models (#17662) 2024-09-02 14:19:45 +05:30
Pere Miquel Brull
72afde0aca MINOR - Implement SAP Hana Lineage (#17615) 
* MINOR - SAP Hana Lineage

* skeleton

* parser

* lineage

* manage formulas

* add cvs

* add cvs

* better typing

* enum

* handle cvs

* saphana docs
 2024-09-02 07:42:35 +02:00
github-actions
aff2adbb98 chore(release): Prepare Branch for 1.5.2 2024-08-28 20:25:55 +00:00
nicor88
092ce3df34 fix ingestion of owner in dbt, via email (#17613) 2024-08-28 18:25:45 +05:30
github-actions
8ec2cdc638 chore(release): Prepare Branch for 1.5.1 2024-08-27 23:14:48 +00:00
Pere Miquel Brull
2180a6c7f1
FIX - profiler interface system metrics validation & e2e YAML includeDDL (#17562) 2024-08-23 09:00:18 +02:00
Imri Paran
b48c6a0485
feat(postgres): add money profile (#17558) 
add support for profiling of money type
 2024-08-22 14:53:34 -07:00
Pere Miquel Brull
519b3c32e3
MINOR - Speek up redshift test connection (#17553) 2024-08-22 11:12:09 -07:00
Onkar Ravgan
bbe92e2af3
MINOR: Fix none password issue for mysql and postgresql databases (#17548) 
* fix none password issue

* added warning
 2024-08-22 17:34:34 +05:30
kwgdaig
43a244fbf1
ISSUE-17045: Modified to create column linage even when upstream columns and data source columns are one-to-many (#17112) 
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2024-08-22 09:07:05 +02:00
Imri Paran
2dd613b2a7
tests: lineage (#17436) 
add test for cell with 100k characters
 2024-08-21 20:28:08 -07:00
Mayur Singal
dd17ee739a
MINOR: Fix output handler time ingestion (#17429) 
* MINOR: Fix output handler time ingestion

* chore: fixes Lint error

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2024-08-21 21:07:26 +05:30
Ayush Shah
7ada44a315
Minor: Remove trailing slash from FivetranClient base URL (#17528) 
* fix: Remove trailing slash from FivetranClient base URL

* chore: use a method created for removing trailing slash
 2024-08-21 13:02:16 +00:00
Ayush Shah
c08b83f41d
MINOR: Fixes AttributeError: 'DatalakeGcsClient' object has no attribute 'project' (#17526) 2024-08-21 17:51:35 +05:30
Imri Paran
5133c31d31
MINOR: kafka integration tests (#17457) 
* tests: kafka integration

kafka integration tests with schema registry

* added ignore kafka for python 3.8

* fixed tests
 2024-08-21 16:05:09 +05:30
IceS2
ac6b192fb3
MINOR: Fix pydantic v2 issues with domo (#17507) 
* Fix pydantic v2 issues with domo

* Fix sourceURL for domo charts
 2024-08-21 11:10:12 +02:00
Imri Paran
c055620ff4
tests: lineage (#17509) 
added test cases for lineage with and without includeDDL
 2024-08-21 07:47:30 +00:00
Do Manh Ha
a868596db7
Fixes #17461: Unquote and interpret escaped characters in BigQuery dataset description (#17462) 
* fix(bigquery): unquote and convert any escaped characters to their actual representations

* test: bigquery description with multiple line

---------

Co-authored-by: Imri Paran <imri.paran@gmail.com>
 2024-08-20 17:56:19 +02:00
Teddy
354f879866
fix: db_service not passed to metric instantiating (#17504) 2024-08-20 07:57:03 -07:00
Teddy
4ed2035a50
fix: remove root when accessing fqn of entity reference (#17491) 2024-08-20 15:17:16 +02:00
Ayush Shah
9880f06b2c
Fixes #17489: Allow non numeric numbers to be sent via Json, Replace NaN value… (#17490) 
* fix: Allow non numeric numbers to be sent via Json, Replace NaN values with None in SQAProfilerInterface

Replace NaN values with None in the SQAProfilerInterface class to maintain database parity. NaN values will be cast to null in OpenMetadata. This change ensures that data handling processes account for this conversion.

* fix: histogram overflow error

* test: Add Unit Test for Null and Null Ratio Metric

* chore: Address comments

* chore: Address comments

* fix: checkstyle and message

* fix: failing tests as null count works as expected
 2024-08-20 16:33:55 +05:30