yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-16 04:57:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 725 Branches 153 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Alberto Miorin
5309dae08d
Fix #3507: Trino connector, support optional database field (#3551) 
* Fix #3507: Trino connector, support optional database field

* override prepare and next_record

* fix formatting

* fix return type
 2022-03-22 16:03:00 +01:00
Pere Miquel Brull
eb906589fd
Fix #3525 - Profiler breaks on Postgres data (#3583) 
Fix #3525 - Profiler breaks on Postgres data (#3583)
 2022-03-22 15:55:44 +01:00
Onkar Ravgan
32b80ef329
ISSUE-3542: Added fields in config file (#3549) 
* ISSUE-3542: Added fields in congig file

* Removed callback_url key from config

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-22 19:35:09 +05:30
Mayur Singal
a38b08882a
Fix #3566: ingesting sample data with space in name (#3586) 2022-03-22 18:29:03 +05:30
Ayush Shah
9a620c380d
Fixing Metadata indexing issue (#3580) 2022-03-22 14:37:41 +05:30
Ayush Shah
5cacd33e2e
Standardized Metabase db_service_name across dashboards (#3458) 
* Standardized Metabase db_service_name across dashboards

* Resolved Code Smell

* Update metabase.py
 2022-03-22 12:21:54 +05:30
Mayur Singal
d6d9afa8be
Fix #3118: Allowing multiple databases for snowflake (#3464) 2022-03-21 10:31:17 -07:00
Pere Miquel Brull
548a0ab722
Fix #3437 & #3186 - Airflow lineage Task Group & Tests (#3460) 2022-03-21 10:29:49 -07:00
Ayush Shah
b865d85d85
Docker Calculation fix + Reset DB command added (#3459) 2022-03-21 10:28:58 -07:00
Ayush Shah
538ee87acc
Fix tests - added recursion delete and error handling (#3560) 2022-03-21 10:00:39 -07:00
Mayur Singal
2631dbbe7e
Fix #3487: fixed MySQL multiple database ingestion issue (#3489) 
* Fix #3487: fixed MySQL multiple database ingestion issue

* moved schma names to prepare

* fixed comment
 2022-03-21 17:09:46 +05:30
Mayur Singal
98421f2d56
fix #3423: excluded unwanted query types (#3484) 2022-03-17 09:40:44 -07:00
Sriharsha Chintalapani
3f91ae33c5
feat(ingestion): make ingestion image runtime configurable (#3087) 
Co-authored-by: Jorgen Evens <jorgen@evens.eu>
 2022-03-16 22:54:14 -07:00
Ayush Shah
83de95c3f2
Bigquery Custom query for partitioned table and policy tag fix (#3472) 
* Bigquery Custom query for partitioned table and policy tag fix

* Added source to tag label

* Modified default partition query as per partition key
 2022-03-16 21:05:25 -07:00
Mayur Singal
3aa8755a7f
Fix #3465: Added trino version (#3466) 2022-03-16 09:00:08 -07:00
Mayur Singal
6254fd8468
Fix #3419: large complex datatype issue fixed (#3449) 
* large complex datatype issue fixed

* removed unused variable
 2022-03-16 12:21:44 +05:30
Ayush Shah
28a1918ed8
Fixed Looker - Dashboard and Dashboard Elements (#3441) 
* Looker fix

* Update looker.py
 2022-03-16 11:52:29 +05:30
Pere Miquel Brull
16e82d45de
Fix #3371 - Run Profiler and Tests on a % of the data (#3424) 
Fix #3371 - Run Profiler and Tests on a % of the data (#3424)
 2022-03-16 06:05:59 +01:00
Mayur Singal
7eaea054c1
Fix #3332: fixed varbyte & time issue (#3401) 
* Fix #3332: fixed varbyte & time issue

* added time without timezone

* optimized code

* code_smell_fixed

* removed unused var

* reduced cognitive complexity
 2022-03-15 19:48:16 +05:30
codingwithabhi
55c65b5c53
issue-3420: debug-logger-added (#3434) 2022-03-15 19:13:31 +05:30
Mayur Singal
3e92693d34
Fix #3419: Databricks struct, array & map supported (#3426) 
* Fix #3419: Databricks struct, array & map supported

* optimized code

* added comments
 2022-03-15 19:13:05 +05:30
Onkar Ravgan
ad04136847
Fix #3095: Added support for private key (#3408) 
* ISSUE-3095: Add support for private key in snowflake

rebase main branch

* Fix #3095: Added support for private key

* Fix #3095: Added support for private key and review changes

* Fix #3095: Added support for private key and review changes

* changed direct assignment of dictionary

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-15 18:19:02 +05:30
Ayush Shah
a6e2ee78c4
Update docker.py (#3430) 2022-03-15 17:18:00 +05:30
codingwithabhi
e043e89dff
ISSUE-3293: optimized-metadata-extraction (#3409) 
* ISSUE-3293: optimized-metadata-extraction

* tuple-removed-for-_get_table_comment
 2022-03-15 09:22:51 +05:30
Pere Miquel Brull
130bbb0c5c
Fix #3104 - Remove unused imports with pycln (#3370) 
Fix #3104 - Remove unused imports with pycln (#3370)
 2022-03-14 06:59:15 +01:00
Ayush Shah
7c84f063e6
Minor Fixes - Ingestion - Datetime format, Looker fix (#3365) 
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix

* Modified core version

* Snowflake Usage Result limit and Makefile ignore env fix
 2022-03-11 13:31:42 +05:30
Pere Miquel Brull
f0dd85b9f7
Fix #3356 - Vertica concat and len (#3358) 2022-03-10 08:01:47 -08:00
Ayush Shah
4f1ef18c2b
Fix Usage from Bulk Sink (#3354) 
* Fix Usage from Bulk Sink

* Closing stage in worklow once bulk sink starts
 2022-03-10 17:12:42 +05:30
Mayur Singal
40e7d37244
Snowflake optional config (#3319) 
* Update AirflowUtils.java

* Update databaseServiceMetadataPipeline.json

* Updated Account and schema description

* snowfliks ui support (#3318)

* added lineage for snowflake

* Formatted file

* initialized metadata_config

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-03-09 17:55:37 +05:30
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297) 
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
 2022-03-09 12:08:42 +05:30
Ayush Shah
116f8d333d
Airflow Auth fix + Version Downgrade + Increased Docker Min Memory Limit (#3233) 2022-03-08 13:51:07 -08:00
Vivek Ratnavel Subramanian
f0927ecebb
Fix #3236: Add support for secure docker compose with an env file (#3241) 
* Fix #3236: Add support for secure docker compose with an env file
 2022-03-08 07:05:31 -08:00
Pere Miquel Brull
94d7500216
Fix #3248 & #3251 - Update metrics and column profile (#3262) 
Fix #3248 & #3251 - Update metrics and column profile (#3262)
 2022-03-08 11:44:39 +01:00
Pere Miquel Brull
434aa30a92
Fix #3221 - columnValuesToBeUnique vs. columnValuesToBeNotNull JSONs (#3255) 
Fix #3221 - columnValuesToBeUnique vs. columnValuesToBeNotNull JSONs (#3255)
 2022-03-08 09:15:20 +01:00
Teddy
6ee31eb21f
Issue-2538: Add Iceberg type for Glue Table + Location Entity (#3210) 2022-03-07 08:27:14 -08:00
Pere Miquel Brull
954908efec
Fix #3217 - Test case props should be unique (#3220) 
Fix #3217 - Test case props should be unique (#3220)
 2022-03-07 14:43:42 +01:00
Ayush Shah
ce99d52cd7
Fixing Snowflake Query and arrayDataType issue (#3174) 2022-03-07 12:25:01 +05:30
Ayush Shah
23b97f5fe1
Datetime concat issue fixed - Auth Client - Ingestion (#3195) 
* Added check for datetime issue concat with float

* Added utc time as google sends expiry in utc datetime
 2022-03-07 12:24:48 +05:30
Pere Miquel Brull
2444b884bf
Fix #3150 - Missing count & value length tests (#3193) 
Fix #3150 - Missing count & value length tests (#3193)
 2022-03-07 07:19:13 +01:00
darth-coder00
4d09c165d7
Feat #2857 - Adding UI support for glossary (#3092) 2022-03-06 21:34:02 -08:00
Pere Miquel Brull
4a752e3ab2
Fix #3151 - Ingestion profiler should use ORM Profiler (#3192) 2022-03-06 15:43:43 -08:00
Francisco J. Jurado Moreno
a6e98b3fdb
Fix2113 - Database Service API Integration tests (#3185) 2022-03-06 14:59:32 +01:00
Pere Miquel Brull
a9290bf1a0
Fix #3181 - Align ingestion requirements 
Fix ES and bump down redash (#3182)
 2022-03-06 09:00:58 +01:00
Mayur Singal
cd6b28df1a
Fix #3066: Superset Auth Fixed (#3156) 2022-03-04 12:02:51 -08:00
codingwithabhi
ad341e8259
fix ISSUE-3137: updated-redash-library-and-function (#3157) 2022-03-04 12:02:08 -08:00
Ayush Shah
0d1fa67116
Added fix for strptime expecting string (#3154) 2022-03-04 23:36:52 +05:30
Pere Miquel Brull
4116233697
Fix #3105 - ColumnValuesToMatchRegex & other fixes (#3149) 
Fix #3105 - ColumnValuesToMatchRegex & other fixes (#3149)
 2022-03-04 18:11:49 +01:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data (#3142) 
Fix #3112 - col profile safety & sample data (#3142)
 2022-03-04 13:14:11 +01:00
codingwithabhi
40d3f5e239
column-issue-fixed (#3138) 
* column-issue-fixed

* column-type-lookup-optimized
 2022-03-04 17:01:10 +05:30
Snyk bot
834bb8e483
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities (#3134) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1290331
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1298721
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1300249
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396444
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396445
 2022-03-04 08:34:24 +01:00