yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-05 23:58:18 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,395 Commits 703 Branches 151 Tags
Commit Graph

1489 Commits

Author SHA1 Message Date
Ayush Shah
4f1ef18c2b
Fix Usage from Bulk Sink (#3354) 
* Fix Usage from Bulk Sink

* Closing stage in worklow once bulk sink starts
 2022-03-10 17:12:42 +05:30
Mayur Singal
40e7d37244
Snowflake optional config (#3319) 
* Update AirflowUtils.java

* Update databaseServiceMetadataPipeline.json

* Updated Account and schema description

* snowfliks ui support (#3318)

* added lineage for snowflake

* Formatted file

* initialized metadata_config

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-03-09 17:55:37 +05:30
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297) 
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
 2022-03-09 12:08:42 +05:30
Ayush Shah
116f8d333d
Airflow Auth fix + Version Downgrade + Increased Docker Min Memory Limit (#3233) 2022-03-08 13:51:07 -08:00
Vivek Ratnavel Subramanian
f0927ecebb
Fix #3236: Add support for secure docker compose with an env file (#3241) 
* Fix #3236: Add support for secure docker compose with an env file
 2022-03-08 07:05:31 -08:00
Pere Miquel Brull
94d7500216
Fix #3248 & #3251 - Update metrics and column profile (#3262) 
Fix #3248 & #3251 - Update metrics and column profile (#3262)
 2022-03-08 11:44:39 +01:00
Pere Miquel Brull
434aa30a92
Fix #3221 - columnValuesToBeUnique vs. columnValuesToBeNotNull JSONs (#3255) 
Fix #3221 - columnValuesToBeUnique vs. columnValuesToBeNotNull JSONs (#3255)
 2022-03-08 09:15:20 +01:00
Teddy
6ee31eb21f
Issue-2538: Add Iceberg type for Glue Table + Location Entity (#3210) 2022-03-07 08:27:14 -08:00
Pere Miquel Brull
954908efec
Fix #3217 - Test case props should be unique (#3220) 
Fix #3217 - Test case props should be unique (#3220)
 2022-03-07 14:43:42 +01:00
Ayush Shah
ce99d52cd7
Fixing Snowflake Query and arrayDataType issue (#3174) 2022-03-07 12:25:01 +05:30
Ayush Shah
23b97f5fe1
Datetime concat issue fixed - Auth Client - Ingestion (#3195) 
* Added check for datetime issue concat with float

* Added utc time as google sends expiry in utc datetime
 2022-03-07 12:24:48 +05:30
Pere Miquel Brull
2444b884bf
Fix #3150 - Missing count & value length tests (#3193) 
Fix #3150 - Missing count & value length tests (#3193)
 2022-03-07 07:19:13 +01:00
darth-coder00
4d09c165d7
Feat #2857 - Adding UI support for glossary (#3092) 2022-03-06 21:34:02 -08:00
Pere Miquel Brull
4a752e3ab2
Fix #3151 - Ingestion profiler should use ORM Profiler (#3192) 2022-03-06 15:43:43 -08:00
Francisco J. Jurado Moreno
a6e98b3fdb
Fix2113 - Database Service API Integration tests (#3185) 2022-03-06 14:59:32 +01:00
Pere Miquel Brull
a9290bf1a0
Fix #3181 - Align ingestion requirements 
Fix ES and bump down redash (#3182)
 2022-03-06 09:00:58 +01:00
Mayur Singal
cd6b28df1a
Fix #3066: Superset Auth Fixed (#3156) 2022-03-04 12:02:51 -08:00
codingwithabhi
ad341e8259
fix ISSUE-3137: updated-redash-library-and-function (#3157) 2022-03-04 12:02:08 -08:00
Ayush Shah
0d1fa67116
Added fix for strptime expecting string (#3154) 2022-03-04 23:36:52 +05:30
Pere Miquel Brull
4116233697
Fix #3105 - ColumnValuesToMatchRegex & other fixes (#3149) 
Fix #3105 - ColumnValuesToMatchRegex & other fixes (#3149)
 2022-03-04 18:11:49 +01:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data (#3142) 
Fix #3112 - col profile safety & sample data (#3142)
 2022-03-04 13:14:11 +01:00
codingwithabhi
40d3f5e239
column-issue-fixed (#3138) 
* column-issue-fixed

* column-type-lookup-optimized
 2022-03-04 17:01:10 +05:30
Snyk bot
834bb8e483
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities (#3134) 
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1290331
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1298721
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1300249
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396444
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396445
 2022-03-04 08:34:24 +01:00
Snyk bot
8132b91c30
fix: ingestion/tests/integration/lineage/airflow/requirements.txt to reduce vulnerabilities (#3130) 
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-APACHEAIRFLOW-2413442
- https://snyk.io/vuln/SNYK-PYTHON-APACHEAIRFLOW-2414089
- https://snyk.io/vuln/SNYK-PYTHON-WTFORMS-40581
 2022-03-04 07:49:58 +01:00
Pere Miquel Brull
e96ac838ff
Fix #3084 - Implement missing tests (#3117) 
Fix #3084 - Implement missing tests
 2022-03-04 06:59:47 +01:00
codingwithabhi
37457dc668
table-name-fail-fix- (#3114) 2022-03-03 13:44:34 -08:00
Ayush Shah
84fd717c57
Sql_alchemy_helper Engine fix (#3116) 
* Added connect_args and options for creation of engine

* Added connect_args to profiler engine

* Error fixed on database_common profiler - isinstance error type or tuple of types
 2022-03-03 23:39:06 +05:30
Ayush Shah
c3cc685663
Excluded db2 from all plugins as it was creating issues with docker image creation (#3097) 2022-03-03 14:55:40 +05:30
Mayur Singal
3f144a7370
fix #3077: Fixed validation error in ldap (#3079) 
* fix #3077: fixed validation error

* removed print

* changes returntype to OMetaUserProfile
 2022-03-03 11:11:07 +05:30
Pere Miquel Brull
71207de362
Fix #2875 - Profiler API Sink (#3011) 
Fix #2875 - Profiler API Sink
 2022-03-02 16:46:28 +01:00
Sriharsha Chintalapani
0b789788da
Fix #3051: Glossary-term suggest api has fqdn same as name (#3052) 2022-03-01 11:19:43 -08:00
Mayur Singal
98ddf5fba3
Fix #3041: Handled AttributeError (#3042) 2022-03-01 08:48:09 -08:00
Mayur Singal
c59a5e882d
fix #3035: handled none entity (#3036) 2022-03-01 08:06:16 -08:00
Alberto Miorin
fe5618c8f1
Fix #3037: metadata --version doesn't work (#3038) 2022-03-01 12:19:36 +01:00
Sriharsha Chintalapani
15d0440599
Fix #1220: catch and log any errors during the es index (#1220) 2022-03-01 12:27:50 +05:30
codingwithabhi
06d9329ae3
Atlas connector (#2855) 
* Fix #1161: Add Atlas Connector

* Atlast Decimal type handled

* Atlas col_data_type handled

* Atlas columns exception handling implemented

* atlas-services-added-into-single-file

* import-updated

* authentication-fix

* atlas-connector-services-added

* code-smell-removed

* code-smell-removed

* code-smell-removed

* file-exist-check-added

* updated-mapping-json-logic

* pr-comment-changes-completed

* atlas-linegae-added

* atlas-linegae-added

* pr-changes-done

* code-formatted

* bug-resolved

* topic-bug-resolved

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-03-01 11:50:14 +05:30
Ayush Shah
568845b65c
Power BI connector (#3019) 
* Power BI Dashboard and Tiles added

* Added Powerbi dependency

* Modified Powerbi debug logs

* Bump up _version.py

* Modified Power BI - added failure status, resolved comments
 2022-03-01 10:09:35 +05:30
Mayur Singal
c49af971a7
Fix #2984: added azure sso auth (#3002) 2022-02-28 11:44:28 -08:00
Pere Miquel Brull
00552f6d36
Fix #3012 - Dependency breaking Airflow Container (#3015) 
Fix #3012 - Dependency breaking Airflow Container
 2022-02-28 17:11:18 +01:00
codingwithabhi
83c9b75a5a
Metabase lineage (#3003) 
* metabase-lineage

* metabase-lineage-completed
 2022-02-26 14:56:09 -08:00
Ayush Shah
412d61a875
Fix Okta Authentication and Validation - Ingestion (#2955) 2022-02-26 08:19:36 -08:00
Mayur Singal
e79be68bea
Fix #2937: added clickhouse usage connector (#2987) 2022-02-26 08:18:49 -08:00
Mayur Singal
b211435bac
Fix #2946: Presto Ingestion issues fix (#2986) 
* Fix #2946: Presto Ingestion issues fix

* added col lenght

* removed print

* removed comment

* removed mysql import
 2022-02-26 12:12:49 +05:30
Sriharsha Chintalapani
fa62a1e4e9
Fix #2991: Add ES support for glossary (#2993) 2022-02-25 20:53:53 -08:00
Pere Miquel Brull
990608522a
Fix #2981 - Update Profile to match TableProfile (#2982) 2022-02-25 09:26:30 -08:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False (#2976) 2022-02-24 08:38:56 -08:00
Mayur Singal
df98931ed4
fix #2809: Auto populate View Lineage to Tables (#2977) 2022-02-24 08:28:40 -08:00
Mayur Singal
6a2180e975
Fix #2539: redshift lineage mapping (#2828) 
* py_format

* Fixed code smells

* used util method to ingest lineage

* removed sample sql query
 2022-02-24 13:20:09 +05:30
Pere Miquel Brull
a4b383fa83
Fix #2897 - Profiler CLI (#2967) 
Fix #2897 - Profiler CLI
 2022-02-24 08:03:50 +01:00
codingwithabhi
2ef2edbf17
Bigquery lineage mapping (#2849) 
* lineage-boilerplate-code-added

* bigquery-lineage-completed

* lineage-code-optimised

* code-cleaned

* code-smell-fixed

* code-refined

* added-database-name-in-fqdn

* code-smell-removed

* exception-handled

* removed-print-statement

* formatted-setup.py

* added-sqllineage-version

* included-valid-type-none

* debug-added-in-logger

* lineage-logic-updated

* updated-lineage-params

* global-config-variables-removed

* return-type-updated-in-entity

* updated-conditionin-from-entity

* imported-sqllineage-inside-method

* code-smell-removed

* code-formatted
 2022-02-24 11:59:00 +05:30