yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-11-02 11:39:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,377 Commits 873 Branches 177 Tags
Commit Graph

2851 Commits

Author SHA1 Message Date
Aldwyn Cabarrubias
312b584836 Change time format for the created_at of the DBT cloud pipeline status (#17916) 
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
 2024-09-30 17:02:38 +05:30
Teddy
d3325cda93 MINOR - Fix General Profiler Bugs (#17995) 
* fix import issue

* fix: better handle None values in profiler processing

* fix: profiler errors

* chore: fix comment

* style: fix python linting failure

* fix: null byte error with the database client

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
(cherry picked from commit 8dc6b7d282a700c2a3d4659f904a3966e16843a2)
 2024-09-30 08:13:08 +02:00
IceS2
cb2ef3f559 Fix missing cast to str (#18016) 2024-09-30 07:55:49 +05:30
Suman Maharana
2348614695 Added DBT tests with versionless and fixed v7 parsing (#18028) 2024-09-27 19:57:13 +05:30
Suman Maharana
25bda0f756 Minor: fix lineage & queries in dbt (#17999) 2024-09-27 19:48:56 +05:30
Suman Maharana
5f234cdbc4 Fix Manifest is not parsed correctly on dbt versionless (#17975) 2024-09-27 19:47:46 +05:30
harshsoni2024
27816cb964 allow powerbi datamodel children in col.lineage (#18030) 2024-09-27 19:30:08 +05:30
Mayur Singal
3e5cc923bf MINOR: MSTR connector import fix (#18025) 2024-09-27 16:57:35 +05:30
github-actions
95bfb5b912 chore(release): Prepare Branch for 1.5.6 2024-09-25 08:11:38 +00:00
Pere Miquel Brull
fe2681f022 FIX #17896 - Python lineage SDK to work with Uuid & FQN models (#17928) 2024-09-23 11:21:31 +05:30
Pere Miquel Brull
c75378f8e8 Merge branch '1.5.5' of github.com:open-metadata/OpenMetadata into 1.5.5 2024-09-20 16:07:16 +02:00
Pere Miquel Brull
ad03f9e237 GEN-996 - Allow PII Processor without storing Sample Data (#17927) 
* GEN-996 - Allow PII Processor without storing Sample Data

* fix import

* fix import
 2024-09-20 16:07:11 +02:00
Ayush Shah
c90b7b0be5 Fixes #17869: Add validations in place for salesforce connection (#17870) 2024-09-20 18:00:07 +05:30
Imri Paran
6b3f4646c6 ci: pin spacy version (#17814) 
spacy 3.8 requires numpy 2.0 which is not compatible with openmetadata-ingestion requirements:
184e508d9c

(cherry picked from commit 3282b057d84630dc04f9967678446db420d95bac)
 2024-09-20 12:19:27 +02:00
Pere Miquel Brull
01e4b04573 MINOR - Bump Presidio Analyzer and validate support for legal entities (#17750) 2024-09-20 10:36:44 +02:00
Imri Paran
e22a66fe45 Fix 17903: fix(data-quality): snowflake data diff (#17907) 
* fix(data-quality): snowflake data diff

- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality

* reverted unintended change

(cherry picked from commit 21af02d8d5d65ce73645b5396b3cd2eaee1fac19)
 2024-09-20 08:17:29 +02:00
Mayur Singal
eda9ecc83f MINOR: Apply multi threading in View Lineage Processing (#17922) 2024-09-19 18:57:31 +05:30
Pere Miquel Brull
9f78b09c79 GEN-1493 - Fix paginate_es in opensearch (#17858) 
* GEN-1493 - Fix opensearch pagination

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch

* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
 2024-09-19 10:27:51 +02:00
Pere Miquel Brull
4e7b1381b1 GEN-1410 - Improve PII Logging information (#17835) 2024-09-19 10:27:20 +02:00
github-actions
c55b8efe36 chore(release): Prepare Branch for 1.5.5 2024-09-16 03:19:15 +00:00
Imri Paran
6cd5a43fc4 [GEN-1406]: import plugin and clear plugin message for failed source import (#17788) 
* support side effects on source classes by always importing source class

* streamlined error message

* fixed service type extraction for test suite pipeline

* - replaced "custom" with constant
- added quotes for the plugin exception for copy/paste ergonomics

(cherry picked from commit 59854de58d000aae01bcc29c7194f7388614bdda)
 2024-09-13 11:12:58 +02:00
Mayur Singal
05cb36f8db MINOR: make type optional in ES Response (#17832) 
* MINOR: make type optional in ES Mixin

* make none as default

* pyformat
 2024-09-13 10:25:35 +02:00
Pere Miquel Brull
69fcd6a572 MINOR - Add ES pagination with error handling (#17776) 
* MINOR - Add ES pagination with error handling

* format

* format

* add nullable

* prepare API

* fix pagination

* format
 2024-09-12 09:42:23 +02:00
Mayur Singal
e23a18b88c MINOR: Fix Redshift View Def regex_replace Error (#17810) 2024-09-11 21:32:10 +05:30
github-actions
53cc84aef1 chore(release): Prepare Branch for 1.5.4 2024-09-10 05:59:03 +00:00
Pere Miquel Brull
f9dd7b53cb MINOR - Fix lineage GET for names with / and standardize quote calls (#17748) 
* MINOR - Fix lineage GET for names with `/` and standardize quote calls

* format

* fix import
 2024-09-06 14:53:17 +02:00
Pere Miquel Brull
fa198f2942 MINOR - Better PII classification for JSON data (#17734) 
* MINOR - Better PII classification for JSON data

* linting
 2024-09-06 14:52:14 +02:00
Onkar Ravgan
f829c506c1 Fixed dbt cloud run_res name (#17694) 2024-09-05 10:40:36 +05:30
Pere Miquel Brull
75be6b69dd MINOR - PII Scanner tests and log levels (#17686) 
* MINOR - PII Scanner tests and log levels

* MINOR - PII Scanner tests and log levels
 2024-09-04 14:27:30 +02:00
nicor88
d068a59aa8 fixes 17648: add tags and description for tableau published data source (#17678) 
* tableau data-source tags and description

* tweaks

* PR review

* change test description

* black formatting
 2024-09-03 15:20:11 +05:30
Sriharsha Chintalapani
a477e23854 create 1.5.3 release branch 2024-09-02 10:49:43 -07:00
Mayur Singal
feacabb2f3 MINOR: Fix athena lineage models (#17662) 2024-09-02 14:19:45 +05:30
Pere Miquel Brull
72afde0aca MINOR - Implement SAP Hana Lineage (#17615) 
* MINOR - SAP Hana Lineage

* skeleton

* parser

* lineage

* manage formulas

* add cvs

* add cvs

* better typing

* enum

* handle cvs

* saphana docs
 2024-09-02 07:42:35 +02:00
github-actions
aff2adbb98 chore(release): Prepare Branch for 1.5.2 2024-08-28 20:25:55 +00:00
nicor88
092ce3df34 fix ingestion of owner in dbt, via email (#17613) 2024-08-28 18:25:45 +05:30
github-actions
8ec2cdc638 chore(release): Prepare Branch for 1.5.1 2024-08-27 23:14:48 +00:00
Pere Miquel Brull
2180a6c7f1
FIX - profiler interface system metrics validation & e2e YAML includeDDL (#17562) 2024-08-23 09:00:18 +02:00
Imri Paran
b48c6a0485
feat(postgres): add money profile (#17558) 
add support for profiling of money type
 2024-08-22 14:53:34 -07:00
Pere Miquel Brull
519b3c32e3
MINOR - Speek up redshift test connection (#17553) 2024-08-22 11:12:09 -07:00
Onkar Ravgan
bbe92e2af3
MINOR: Fix none password issue for mysql and postgresql databases (#17548) 
* fix none password issue

* added warning
 2024-08-22 17:34:34 +05:30
kwgdaig
43a244fbf1
ISSUE-17045: Modified to create column linage even when upstream columns and data source columns are one-to-many (#17112) 
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2024-08-22 09:07:05 +02:00
Imri Paran
2dd613b2a7
tests: lineage (#17436) 
add test for cell with 100k characters
 2024-08-21 20:28:08 -07:00
Mayur Singal
dd17ee739a
MINOR: Fix output handler time ingestion (#17429) 
* MINOR: Fix output handler time ingestion

* chore: fixes Lint error

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2024-08-21 21:07:26 +05:30
Ayush Shah
7ada44a315
Minor: Remove trailing slash from FivetranClient base URL (#17528) 
* fix: Remove trailing slash from FivetranClient base URL

* chore: use a method created for removing trailing slash
 2024-08-21 13:02:16 +00:00
Ayush Shah
c08b83f41d
MINOR: Fixes AttributeError: 'DatalakeGcsClient' object has no attribute 'project' (#17526) 2024-08-21 17:51:35 +05:30
Imri Paran
5133c31d31
MINOR: kafka integration tests (#17457) 
* tests: kafka integration

kafka integration tests with schema registry

* added ignore kafka for python 3.8

* fixed tests
 2024-08-21 16:05:09 +05:30
IceS2
ac6b192fb3
MINOR: Fix pydantic v2 issues with domo (#17507) 
* Fix pydantic v2 issues with domo

* Fix sourceURL for domo charts
 2024-08-21 11:10:12 +02:00
Imri Paran
c055620ff4
tests: lineage (#17509) 
added test cases for lineage with and without includeDDL
 2024-08-21 07:47:30 +00:00
Do Manh Ha
a868596db7
Fixes #17461: Unquote and interpret escaped characters in BigQuery dataset description (#17462) 
* fix(bigquery): unquote and convert any escaped characters to their actual representations

* test: bigquery description with multiple line

---------

Co-authored-by: Imri Paran <imri.paran@gmail.com>
 2024-08-20 17:56:19 +02:00
Teddy
354f879866
fix: db_service not passed to metric instantiating (#17504) 2024-08-20 07:57:03 -07:00