yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-16 13:07:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 726 Branches 153 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Onkar Ravgan
7b26b5ce24
tableau-connector-fix-added (#3946) 
* Fixed Tableau source config

* Review changes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-04-08 19:23:44 +05:30
codingwithabhi
bb76a2f11b
salesforce-connector-fixed (#3923) 
* salesforce-connector-fixed

* salesforce-connection-updated

* ran-make-core_bump_version_dev

* code-formatted

* removed-get_connection_url

* code-formatted

* code-formatted

* code-formatted
 2022-04-08 16:08:31 +05:30
Onkar Ravgan
5219bad5e1
singlestore-connector-fix-added (#3937) 
* Singlestore config fix
Rebase with main

* Fixed Singlestore source config

* Formating changes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-04-08 15:09:10 +05:30
Onkar Ravgan
aae29b1675
Fixed vertica source configs (#3910) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-04-08 14:13:22 +05:30
codingwithabhi
300e8fec55
snowflake-connector-fix (#3885) 
* snowflake-connector-fixed

* schema-filter-fixed

* updated-connection_arguments

* ran-py_format

* removed-FQN-computation

* ran-make-core_bump_version_dev-and-py_format

* ranpy_format
 2022-04-08 13:28:54 +05:30
dvecerdea
230fc256d6
Refactor Trino Connector and allow proxy setup in trino connection config (#3810) 
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
 2022-04-07 12:50:37 -07:00
Ayush Shah
7c3a6082a6
Refactor - Redshift Connection (#3920) 2022-04-07 08:52:38 -07:00
Pere Miquel Brull
8a7fcf0e54
Fix #3593 - Refactor Ometa client providers structure (#3915) 
Fix #3593 - Refactor Ometa client providers structure (#3915)
 2022-04-07 16:54:20 +02:00
Mayur Singal
3651efd7f5
Databricks Source Fix (#3917) 
Databricks Source Fix (#3917)
 2022-04-07 16:40:50 +02:00
Pere Miquel Brull
93525aea0d
Fix #3823 & Fix generate default Enum field (#3909) 
* Fix sample data DAG

* Fix callback imports

* Use --set-default-enum-member in generate

* Format

* Add faulty merge hard_delete

* Fix airflow lineage, improve naming and fix lineage tests

* Add mysql url test

* Add mysql url test

* Update CI name

* Fix test ometa endpoint

* Format

* Fix metadata config
 2022-04-07 18:22:50 +05:30
Onkar Ravgan
4dce0a061a
Dynamodb source fix (#3882) 
Dynamodb source fix (#3882)
 2022-04-07 10:15:47 +02:00
Pere Miquel Brull
408f930eb8
Fix #3866 - includeTables, improve filtering and lazy connection (#3908) 
Fix #3866 - includeTables, improve filtering and lazy connection (#3908)
 2022-04-07 09:03:28 +02:00
Mayur Singal
d7c73362a7
Clickouse Source Fix (#3891) 2022-04-06 10:20:37 -07:00
Daniel
bb16bd5bde
Fix #3860: Add support for custom OIDC SSO (#3892) 2022-04-06 09:34:04 -07:00
Pere Miquel Brull
bd4071bd64
Fix #3826 & #3886 - Profiler workflow & filter pattern (#3893) 
Fix #3826 & #3886 - Profiler workflow & filter pattern (#3893)
 2022-04-06 17:05:00 +02:00
Mayur Singal
7292695bd3
Sample Data Fix (#3888) 
* Sample Data Fix
 2022-04-06 18:26:54 +05:30
Mayur Singal
b709a8055e
Fixed MSSQL Source (#3877) 
Fixed MSSQL Source (#3877)
 2022-04-06 14:21:46 +02:00
Pere Miquel Brull
4e55ea0154
Fix #3850 - JSON Schemas for lineage (#3880) 
* Use new JSON schemas in lineage

* Add sqlite
 2022-04-06 12:24:15 +02:00
Pere Miquel Brull
63533eb388
Fix for connectors based on refactoring of schemas V2 (#3870) 
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-04-05 18:33:25 -07:00
Pere Miquel Brull
b3480693e4
Fix #3824 - OMeta Schema and JSON Connections (#3861) 
Fix #3824 - OMeta Schema and JSON Connections (#3861)
 2022-04-05 21:20:39 +02:00
codingwithabhi
dbfe488a9e
Schema support fix (#3856) 
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
 2022-04-05 10:51:42 -07:00
Pere Miquel Brull
e2539c5e83
Fix #3844 - First iteration for deprecating MetadataServerConfig (#3853) 
* Style

* deprecate MetadataServerConfig

* Remove audience from Okta
 2022-04-05 18:02:45 +05:30
Sriharsha Chintalapani
7b3e459eb3
Fix #3659 Refactor Service Connection String to be specific to per service (#3804) 
* Fix #3659 Refactor Service Connection String to be specific to per service

* Simplify and centralize Airflow Pipeline info for REST (#3740)

* Remove code

* Modified Configs based on refactoring schema (#3816)

* Clean WorkflowContext


Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-04-04 12:46:09 -07:00
dvecerdea
23d68b24d9
Replace sqlalchemy-trino with trino[sqlalchemy] (#3800) 2022-04-01 12:12:03 -07:00
Onkar Ravgan
01b246f586
ISSUE-3485: Added DynamoDB Unit Test (#3488) 
* ISSUE-3485: Added DynamoDB Unit Test

* Added more tests and optimized code

* Re-added list check condition

* Added file sink test

* Fixed file path

* added assert for table and column names

* Modified exception block and optimized test cases

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-31 20:38:17 +05:30
Sriharsha Chintalapani
b14c8dc2c4
Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the separator to : (#3778) 
* Issue-3685: Variable based separator used for fullyQualifiedName instead of hardcoded . for Python and make the sepearator to :

* Fix failing test

* Use colon for run_local_docker validation

* Update tests FQDN

* Update tests FQDN

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
 2022-03-31 19:20:27 +05:30
Mayur Singal
d69618d37e
Fix #3665: Added schema filter pattern (#3781) 2022-03-31 14:53:06 +05:30
codingwithabhi
2006b2b8ac
bigquery-unittest-added (#3479) 
* bigquery-unittest-added

* mock-added-in-create_bigquery_client

* complex-struct-added

* makefile-updated-to-install-all-packages-for-unittest

* bigquery-unittest-updated-via-file-sink
 2022-03-31 14:27:51 +05:30
Pere Miquel Brull
9ced748c4f
Use root for FQDN (#3780) 2022-03-31 12:05:11 +05:30
Mayur Singal
7ab9584517
Fix #3700: Array datatype error fixed (#3758) 2022-03-31 12:02:03 +05:30
Sriharsha Chintalapani
f79b251509
Fix #3771: Main branch schemas and ingestion is failing; Fix #2992: Remove ChangeEvents log from ElasticSearch Indexes (#3772) 2022-03-30 18:26:57 -07:00
Pere Miquel Brull
c22381fdc8
Fix #3747 - FQDN model in ometa api (#3748) 
Fix #3747 - FQDN model in ometa api (#3748)
 2022-03-30 08:54:47 +02:00
Pere Miquel Brull
b3087d08b9
Fix #3522 - Add timeout to profiler (#3707) 
Fix #3522 - Add timeout to profiler (#3707)
 2022-03-30 08:54:27 +02:00
codingwithabhi
4a60d5d0b2
bigquery-sample-data-fix (#3611) 
* bigquery-sample-data-fix

* fetch_sample_data-return-updated

* partition_field-added
 2022-03-29 18:43:34 +05:30
Ayush Shah
bb7dbb04b8
Fix for unhashable type (#3729) 2022-03-29 14:01:35 +05:30
Pere Miquel Brull
3b7b65d46c
Upper bound click req (#3724) 2022-03-29 11:28:41 +05:30
Trøyel
07ae09bed1
lower model references to match between dbt and database (spark) (#3695) 
* lower model references to match between dbt and database (spark)

Add lower on model_fqn and get_table_fqn to increase matching between dbt and database references on Spark.

* Update sql_source.py

move lower out of general function and apply only on node matching

* Update sql_source.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-03-28 21:55:18 +05:30
Mayur Singal
144e0b3cf3
Fix #3528: ingest sql queries (#3578) 
* Fix #3528: ingest sql queries

* ingested sql queries and fixed incorrect query count

* fixed log messages

* Optimized code

* used fallback
 2022-03-28 16:13:23 +05:30
Pere Miquel Brull
1c21abebdd
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696) 
Fix #3645 - Revisit lineage for Airflow 1.10.15 (#3696)
 2022-03-28 08:33:02 +02:00
Ayush Shah
351db56687
Added fix for Sample_Usage not being ingested in Local docker (#3650) 2022-03-27 22:38:13 -07:00
Pere Miquel Brull
d4c3304a2b
Simplify order by to not reference the CTE (#3662) 2022-03-25 11:30:11 -07:00
Pere Miquel Brull
4672a88415
Fix #3633 - Databricks length compilation (#3634) 
* Fix databricks length compilation

* Cast step to float
 2022-03-24 19:30:21 +05:30
Onkar Ravgan
87c36c094f
Fix #3259: Added option in CLI to ingest sample data (#3616) 
* ISSUE-3588: Added option in cli to ingest sample data

* ISSUE-3259: Added flag in CLI to skip sample data ingestion

* Fixed security hotspots

* changed lines in dependency file

* Using datetime instead of random for dag id

* Changed variable names

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-03-24 19:26:04 +05:30
Ayush Shah
07266b58f7
Fix: Added DeltaLake Service type (#3639) 
* fix-deltalake

* added deltalake.json

* Bumped up version
 2022-03-24 18:42:00 +05:30
Mayur Singal
d844e006eb
Fix #3635: Fixed attribute errorr (#3636) 
* table comments optimized

* Fix #3635: Fixed attribute errorr

* Revert "table comments optimized"

This reverts commit c6004761ae1617ad215234ff64cf3d48570dda28.
 2022-03-24 16:25:44 +05:30
Ayush Shah
a87ed206c0
Fix Redshift Usage (#3624) 2022-03-23 22:07:25 -07:00
Snyk bot
3173646484
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities (#3618) 2022-03-23 18:26:41 -07:00
Pere Miquel Brull
792be37cb2
Fix #3529 - Profiler is not working on views (#3617) 
* tmp pass dialect when building ORM

* Format
 2022-03-23 10:38:59 -07:00
codingwithabhi
49c089e4a3
Usage status for stage and bulk sink added (#3605) 
* Usage status for stage and bulk sink added

* record-list-added-in-bulksink-usage-status
 2022-03-23 16:59:42 +05:30
Ayush Shah
d5a215636d
fix 3594 - modified fallbacks (#3601) 2022-03-22 18:35:36 -07:00