yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-13 11:36:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 720 Branches 152 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Pere Miquel Brull
810e6c7dfc
Fix #5822 - Remove looker env and rename props (#5700) 
Fix #5822 - Remove looker env and rename props (#5700)
 2022-07-24 16:02:26 +02:00
Pedro Sereno
14b9439b98
feature: add metabase sqllineage extraction (#6257) 
* feature: add metabase sqllineage extraction

this solves issue-6190 and also fixes a bug in the existing lineage
that was trying to access key with a typo for the database name

* fix: sqllineage import
 2022-07-23 13:44:31 +02:00
Francisco J. Jurado Moreno
78dd44ed32
[TASK-6140] Add OMeta header to SQLAlchemy-based queries (#6293) 
[TASK-6140] Add OMeta header to SQLAlchemy-based queries (#6293)
 2022-07-23 12:31:26 +02:00
Francisco J. Jurado Moreno
756dae5605
[TASK-6241] Cache ES ingestion when ingesting usage (#6276) 
* Cache ingestion

* Uncomment secrets manager

* Fix experiment stuff

* Fix style

* Add LRU cache

* Add tests

* Fix code smell
 2022-07-22 23:33:22 +02:00
Nahuel
4d4a2fc2cf
FIX#5916: Only admin user retrieves connection params when external Secrets Manager is configured (#6228) 
* Implementation for stop sending connection credentials when user is BOT

* Change way we add the connection to the service in the Secret Manager

* Services connection is not required as we want to stop returning it when SM is configured
 2022-07-22 14:02:29 -07:00
Teddy
28623c7455
Fixes #6078 - DB column named metadata conflict with SQA reserved attribute (#6282) 2022-07-22 19:05:32 +02:00
Mayur Singal
75ccc803ad
Fix #5410: Topology for Pipeline Services (#6085) 
Fix #5410: Topology for Pipeline Services (#6085)
 2022-07-22 13:59:14 +02:00
Teddy
d34d347a1c
overwrite default sum function to add super for BQ overflow (#6252) 2022-07-22 07:49:00 +02:00
Teddy
893665f33d
Fixes #6031 & #6236 -- Handle binary field & UUID when ingesting sample data (#6233) 
Fixes #6031 & #6236 -- Handle binary field & UUID when ingesting sample data (#6233)
 2022-07-21 20:14:44 +02:00
Pere Miquel Brull
385b7edac9
Prepare CI for Airflow APIs (#6240) 
Prepare CI for Airflow APIs (#6240)
 2022-07-21 12:29:57 +02:00
Teddy
e1fac99353
Fixes #5723 and implement interface processor logic (#6219) 
* Added datetime for min/max

* Added profiler interface

* Update core.py to work with profiler_interface

* Implement interface logic for orm_profiler object

* Fix unique_ratio logic

* removed changes to table.json

* Added Protocol for type hint

* Changed protocol to abc + fixed sonar code smell

* Fixed py_format
 2022-07-20 17:54:10 +02:00
Pere Miquel Brull
2936c0e4e3
Remove retry in ES query (#6191) 
Remove retry in ES query (#6191)
 2022-07-20 12:44:50 +02:00
Onkar Ravgan
1673b1aa30
DynamoDB Topology refactor (#5967) 
DynamoDB Topology refactor (#5967)
 2022-07-20 10:42:40 +02:00
Onkar Ravgan
1e1f5d4e8e
Refactored Salesforce for topology (#6197) 
* Refactored salesforce for topology

* formatting fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-07-20 08:28:21 +02:00
Francisco J. Jurado Moreno
0cfe6e6cb7
[ISSUE-6162] Escape wildcards on revised RS query (#6200) 
[ISSUE-6162] Escape wildcards on revised RS query (#6200)
 2022-07-20 06:34:26 +02:00
Suresh Srinivas
4c62237bcb
Fixes #6133 - Add support for Team Hiearchy (#6134) 
* Adding different team types for supporting organization team hierarchy

* Add support for team hierarchy

* Create organization during initalization

* Team hierachy test for POST methods

* Add PUT and PATCH support for changing team hiearchy

* Added tests for the team hiearchy feature

* Restored v003 sql files and added v004

* Merge conflicts with main and adopt new JSON based configuration

* Remove configuration Organization name to simplify user MUST do configurations

* Snowflake Make Query tag Optional (#6114)

* Snowflake make query tag optional

* Modified Description

* [Backend][UsageResource] Add PUT to enable updating Usage #6117 :::::: and allow adding space to tagCAtegory and Tags (#6119)

* [Backend][UsageResource] Add PUT to enable updating Usage #6117

* [Backend][UsageResource] Allow space in tags category and primary tags #6121

* [Backend][UsageResource] Update in more genric way to make use of space in resourcePath

* ui changes for allowing space in tag and tag category name

* [Backend][Improvement]add test for put and post

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>

* Adding different team types for supporting organization team hierarchy

* Add support for team hierarchy

* Create organization during initalization

* Team hierachy test for POST methods

* Add PUT and PATCH support for changing team hiearchy

* Added tests for the team hiearchy feature

* Restored v003 sql files and added v004

* Merge conflicts with main and adopt new JSON based configuration

* Remove configuration Organization name to simplify user MUST do configurations

* Python jsonSchema code generation not respecting  defaults

* fixed failing cypress

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
 2022-07-19 11:10:52 -07:00
Mayur Singal
9308fe6df3
Fixed Marked Deleted Tables (#6199) 2022-07-19 18:14:36 +02:00
Francisco J. Jurado Moreno
710591f106
[ISSUE-6162] Upgrade RS SQL statement query (#6188) 
* Upgrade RS SQL statement query

* Fix query, remove dupes
 2022-07-19 17:46:12 +02:00
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128) 
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
 2022-07-19 14:51:44 +02:00
Shailesh Parmar
04db051197
Revert "Pipeline lineage edge UI (#5891)" (#6159) 
This reverts commit 4d898a120fd4410a8ed660db252bc270710e9323.
 2022-07-19 18:07:46 +05:30
Pere Miquel Brull
9fa5d5cab2
Fix #6154 - Python Client to PATCH descriptions (#6165) 
* Prepare patch description utilities for python client

* Improvements
 2022-07-19 12:58:58 +02:00
Pere Miquel Brull
627883f24b
Wrap sample data ingestion (#6176) 2022-07-19 08:11:48 +02:00
Pere Miquel Brull
9ad34f51a7
Fix #5452 - Send usage with PUT (#6174) 
* Send usage with PUT

* Wrap get details

* Wrap get details
 2022-07-19 07:42:58 +02:00
Onkar Ravgan
8c9dc91ccf
Refactored Datalake and Deltalake for Topology (#6034) 
* rebasing with main

* refactored deltalake for topology

* using requests instead of urllib

* formatting fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-07-19 06:37:27 +02:00
Mayur Singal
da559150c1
Snowflake Make Query tag Optional (#6114) 
* Snowflake make query tag optional

* Modified Description
 2022-07-18 20:29:27 +02:00
Pere Miquel Brull
7b6332edef
Fix #6045 - Parse gracefully the connection on Test Connection (#6149) 
* Parse gracefully test connection

* Test file renames
 2022-07-18 18:50:27 +02:00
Onkar Ravgan
78e41a66a6
Snowflake column name empty issue (#6120) 
* added whitespace if column name empty

* Added comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-07-18 10:21:56 +02:00
Mayur Singal
0322e12b45
View lineage better exception handling (#6142) 2022-07-18 10:21:47 +02:00
Mayur Singal
6b10adc40f
Bigquery View Lineage Fix (#6129) 2022-07-17 10:36:24 -07:00
Mayur Singal
4b5b184177
Fix #6091: Fix Datalake arrays must be of the same length (#6092) 2022-07-17 18:26:54 +02:00
Onkar Ravgan
44ed8f094d
Replaced with underscore (#6123) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-07-17 18:26:04 +02:00
Onkar Ravgan
4d898a120f
Pipeline lineage edge UI (#5891) 
Pipeline lineage edge UI (#5891)
 2022-07-17 18:25:37 +02:00
Mayur Singal
98304683c9
Fix #6109: Fixed Snowflake Array Issue (#6111) 2022-07-17 18:20:54 +02:00
Pere Miquel Brull
0a921abf8b
Fix #6005 - Create ML Model Topology (#6080) 
Fix #6005 - Create ML Model Topology  (#6080)
 2022-07-14 15:07:53 +02:00
Pere Miquel Brull
479a8de486
Fix #5885 - Provider loading fails for airflow <2.3 (#5927) 
Fix #5885 - Provider loading fails for airflow <2.3 (#5927)
 2022-07-14 15:07:39 +02:00
Milan Bariya
954635b6dc
FIX 5907: Ingest Trino complex type (#5931) 
* FIX 5907: Ingest Trino complex type

* Included Row & Array Datatype

* Resolved review comments

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
 2022-07-14 11:28:50 +05:30
Milan Bariya
187de08d1f
dbServiceName field move from serviceConnection to sourceConfig (#6047) 2022-07-14 11:25:31 +05:30
nna077
baa5295cc2
Add Date/Time Metrics In Profiler Tab (#5821) 
Add Date/Time Metrics In Profiler Tab (#5821)
 2022-07-13 21:23:03 +02:00
Mayur Singal
2df9fd4ae2
Fix #5896: Fixed empty description issue in dbt (#6069) 2022-07-13 09:32:17 -07:00
Mayur Singal
aa3f2662ea
Fix #6057: Fix Amundsen Dashboards (#6059) 
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-07-13 15:58:33 +02:00
Teddy
5d584731ed
Fixes #6042 -- Add escape character to modulo function (#6044) 
* Added excaping character for modulo function

* Fixed MSSQL Median computation

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-07-13 14:43:56 +02:00
Teddy
d097199d2f
Added validation in profiler workflow to ensure service name exists and raise more explicit error (#6036) 
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-07-13 14:43:48 +02:00
Milan Bariya
c2b15a4377
FIX 5712: make generate gives different results depending on OS (#6035) 
FIX 5712: make generate gives different results depending on OS (#6035)
 2022-07-13 11:53:27 +02:00
Pere Miquel Brull
00c14c0b7e
Fix #5336 - Add startTime, endTime and logLink to taskStatus (#5969) 
Fix #5336 - Add startTime, endTime and logLink to taskStatus (#5969)
 2022-07-12 06:23:54 +02:00
Mayur Singal
9da62be6f4
Fix #5806: Fix Clickhouse Usage (#6010) 2022-07-12 06:21:23 +02:00
Teddy
f0926d9b75
Fixes #3463 -- Implement Custom SQL Data Quality Tests (#5973) 
Fixes #3463 -- Implement Custom SQL Data Quality Tests (#5973)
 2022-07-12 06:21:11 +02:00
Mayur Singal
c4c5afe081
Snowflake Password Optional Field (#5994) 2022-07-11 12:39:43 +05:30
Mayur Singal
9ca4280505
Snowflake View Definition Fix (#5974) 2022-07-09 10:38:44 +02:00
Mayur Singal
ebc9a24ee0
Connection options fix (#5971) 
* Connection Options Fix

* Fixed Condition
 2022-07-08 17:44:18 +02:00
Teddy
11487571b0
Fixes #5964 -- Trino Median function and columnValuesToMatchRegex wording (#5965) 
* added logic for trino median function

* Fixed columnValuesToMatchRegex result wording

* Replaced table with column for toMatchRegex test
 2022-07-08 15:55:50 +02:00