yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-08 09:08:34 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,395 Commits 707 Branches 151 Tags
Commit Graph

1489 Commits

Author SHA1 Message Date
codingwithabhi
2006b2b8ac
bigquery-unittest-added (#3479) 
* bigquery-unittest-added

* mock-added-in-create_bigquery_client

* complex-struct-added

* makefile-updated-to-install-all-packages-for-unittest

* bigquery-unittest-updated-via-file-sink
 2022-03-31 14:27:51 +05:30
Pere Miquel Brull
9ced748c4f
Use root for FQDN (#3780) 2022-03-31 12:05:11 +05:30
Mayur Singal
7ab9584517
Fix #3700: Array datatype error fixed (#3758) 2022-03-31 12:02:03 +05:30
Sriharsha Chintalapani
f79b251509
Fix #3771: Main branch schemas and ingestion is failing; Fix #2992: Remove ChangeEvents log from ElasticSearch Indexes (#3772) 2022-03-30 18:26:57 -07:00
Pere Miquel Brull
c22381fdc8
Fix #3747 - FQDN model in ometa api (#3748) 
Fix #3747 - FQDN model in ometa api (#3748)
 2022-03-30 08:54:47 +02:00
Pere Miquel Brull
b3087d08b9
Fix #3522 - Add timeout to profiler (#3707) 
Fix #3522 - Add timeout to profiler (#3707)
 2022-03-30 08:54:27 +02:00
codingwithabhi
4a60d5d0b2
bigquery-sample-data-fix (#3611) 
* bigquery-sample-data-fix

* fetch_sample_data-return-updated

* partition_field-added
 2022-03-29 18:43:34 +05:30
Ayush Shah
bb7dbb04b8
Fix for unhashable type (#3729) 2022-03-29 14:01:35 +05:30
Pere Miquel Brull
3b7b65d46c
Upper bound click req (#3724) 2022-03-29 11:28:41 +05:30
Trøyel
07ae09bed1
lower model references to match between dbt and database (spark) (#3695) 
* lower model references to match between dbt and database (spark)

Add lower on model_fqn and get_table_fqn to increase matching between dbt and database references on Spark.

* Update sql_source.py

move lower out of general function and apply only on node matching

* Update sql_source.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-03-28 21:55:18 +05:30
Mayur Singal
144e0b3cf3
Fix #3528: ingest sql queries (#3578) 
* Fix #3528: ingest sql queries

* ingested sql queries and fixed incorrect query count

* fixed log messages

* Optimized code

* used fallback
 2022-03-28 16:13:23 +05:30
Pere Miquel Brull
1c21abebdd
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696) 
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696)
 2022-03-28 08:33:02 +02:00
Ayush Shah
351db56687
Added fix for Sample_Usage not being ingested in Local docker (#3650) 2022-03-27 22:38:13 -07:00
Pere Miquel Brull
d4c3304a2b
Simplify order by to not reference the CTE (#3662) 2022-03-25 11:30:11 -07:00
Pere Miquel Brull
4672a88415
Fix #3633 - Databricks length compilation (#3634) 
* Fix databricks length compilation

* Cast step to float
 2022-03-24 19:30:21 +05:30
Onkar Ravgan
87c36c094f
Fix #3259: Added option in CLI to ingest sample data (#3616) 
* ISSUE-3588: Added option in cli to ingest sample data

* ISSUE-3259: Added flag in CLI to skip sample data ingestion

* Fixed security hotspots

* changed lines in dependency file

* Using datetime instead of random for dag id

* Changed variable names

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-24 19:26:04 +05:30
Ayush Shah
07266b58f7
Fix: Added DeltaLake Service type (#3639) 
* fix-deltalake

* added deltalake.json

* Bumped up version
 2022-03-24 18:42:00 +05:30
Mayur Singal
d844e006eb
Fix #3635: Fixed attribute errorr (#3636) 
* table comments optimized

* Fix #3635: Fixed attribute errorr

* Revert "table comments optimized"

This reverts commit c6004761ae1617ad215234ff64cf3d48570dda28.
 2022-03-24 16:25:44 +05:30
Ayush Shah
a87ed206c0
Fix Redshift Usage (#3624) 2022-03-23 22:07:25 -07:00
Snyk bot
3173646484
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities (#3618) 2022-03-23 18:26:41 -07:00
Pere Miquel Brull
792be37cb2
Fix #3529 - Profiler is not working on views (#3617) 
* tmp pass dialect when building ORM

* Format
 2022-03-23 10:38:59 -07:00
codingwithabhi
49c089e4a3
Usage status for stage and bulk sink added (#3605) 
* Usage status for stage and bulk sink added

* record-list-added-in-bulksink-usage-status
 2022-03-23 16:59:42 +05:30
Ayush Shah
d5a215636d
fix 3594 - modified fallbacks (#3601) 2022-03-22 18:35:36 -07:00
Alberto Miorin
5309dae08d
Fix #3507: Trino connector, support optional database field (#3551) 
* Fix #3507: Trino connector, support optional database field

* override prepare and next_record

* fix formatting

* fix return type
 2022-03-22 16:03:00 +01:00
Pere Miquel Brull
eb906589fd
Fix #3525 - Profiler breaks on Postgres data (#3583) 
Fix #3525 - Profiler breaks on Postgres data (#3583)
 2022-03-22 15:55:44 +01:00
Onkar Ravgan
32b80ef329
ISSUE-3542: Added fields in config file (#3549) 
* ISSUE-3542: Added fields in congig file

* Removed callback_url key from config

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-22 19:35:09 +05:30
Mayur Singal
a38b08882a
Fix #3566: ingesting sample data with space in name (#3586) 2022-03-22 18:29:03 +05:30
Ayush Shah
9a620c380d
Fixing Metadata indexing issue (#3580) 2022-03-22 14:37:41 +05:30
Ayush Shah
5cacd33e2e
Standardized Metabase db_service_name across dashboards (#3458) 
* Standardized Metabase db_service_name across dashboards

* Resolved Code Smell

* Update metabase.py
 2022-03-22 12:21:54 +05:30
Mayur Singal
d6d9afa8be
Fix #3118: Allowing multiple databases for snowflake (#3464) 2022-03-21 10:31:17 -07:00
Pere Miquel Brull
548a0ab722
Fix #3437 & #3186 - Airflow lineage Task Group & Tests (#3460) 2022-03-21 10:29:49 -07:00
Ayush Shah
b865d85d85
Docker Calculation fix + Reset DB command added (#3459) 2022-03-21 10:28:58 -07:00
Ayush Shah
538ee87acc
Fix tests - added recursion delete and error handling (#3560) 2022-03-21 10:00:39 -07:00
Mayur Singal
2631dbbe7e
Fix #3487: fixed MySQL multiple database ingestion issue (#3489) 
* Fix #3487: fixed MySQL multiple database ingestion issue

* moved schma names to prepare

* fixed comment
 2022-03-21 17:09:46 +05:30
Mayur Singal
98421f2d56
fix #3423: excluded unwanted query types (#3484) 2022-03-17 09:40:44 -07:00
Sriharsha Chintalapani
3f91ae33c5
feat(ingestion): make ingestion image runtime configurable (#3087) 
Co-authored-by: Jorgen Evens <jorgen@evens.eu>
 2022-03-16 22:54:14 -07:00
Ayush Shah
83de95c3f2
Bigquery Custom query for partitioned table and policy tag fix (#3472) 
* Bigquery Custom query for partitioned table and policy tag fix

* Added source to tag label

* Modified default partition query as per partition key
 2022-03-16 21:05:25 -07:00
Mayur Singal
3aa8755a7f
Fix #3465: Added trino version (#3466) 2022-03-16 09:00:08 -07:00
Mayur Singal
6254fd8468
Fix #3419: large complex datatype issue fixed (#3449) 
* large complex datatype issue fixed

* removed unused variable
 2022-03-16 12:21:44 +05:30
Ayush Shah
28a1918ed8
Fixed Looker - Dashboard and Dashboard Elements (#3441) 
* Looker fix

* Update looker.py
 2022-03-16 11:52:29 +05:30
Pere Miquel Brull
16e82d45de
Fix #3371 - Run Profiler and Tests on a % of the data (#3424) 
Fix #3371 - Run Profiler and Tests on a % of the data (#3424)
 2022-03-16 06:05:59 +01:00
Mayur Singal
7eaea054c1
Fix #3332: fixed varbyte & time issue (#3401) 
* Fix #3332: fixed varbyte & time issue

* added time without timezone

* optimized code

* code_smell_fixed

* removed unused var

* reduced cognitive complexity
 2022-03-15 19:48:16 +05:30
codingwithabhi
55c65b5c53
issue-3420: debug-logger-added (#3434) 2022-03-15 19:13:31 +05:30
Mayur Singal
3e92693d34
Fix #3419: Databricks struct, array & map supported (#3426) 
* Fix #3419: Databricks struct, array & map supported

* optimized code

* added comments
 2022-03-15 19:13:05 +05:30
Onkar Ravgan
ad04136847
Fix #3095: Added support for private key (#3408) 
* ISSUE-3095: Add support for private key in snowflake

rebase main branch

* Fix #3095: Added support for private key

* Fix #3095: Added support for private key and review changes

* Fix #3095: Added support for private key and review changes

* changed direct assignment of dictionary

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-15 18:19:02 +05:30
Ayush Shah
a6e2ee78c4
Update docker.py (#3430) 2022-03-15 17:18:00 +05:30
codingwithabhi
e043e89dff
ISSUE-3293: optimized-metadata-extraction (#3409) 
* ISSUE-3293: optimized-metadata-extraction

* tuple-removed-for-_get_table_comment
 2022-03-15 09:22:51 +05:30
Pere Miquel Brull
130bbb0c5c
Fix #3104 - Remove unused imports with pycln (#3370) 
Fix #3104 - Remove unused imports with pycln (#3370)
 2022-03-14 06:59:15 +01:00
Ayush Shah
7c84f063e6
Minor Fixes - Ingestion - Datetime format, Looker fix (#3365) 
* Minor Fixes - UTC timezone for usage, tag method modification, looker fix

* Modified core version

* Snowflake Usage Result limit and Makefile ignore env fix
 2022-03-11 13:31:42 +05:30
Pere Miquel Brull
f0dd85b9f7
Fix #3356 - Vertica concat and len (#3358) 2022-03-10 08:01:47 -08:00