yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-09-17 21:10:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,284 Commits 793 Branches 161 Tags
Commit Graph

2362 Commits

Author SHA1 Message Date
Ayush Shah
8e57b165a6
Fix LineTooLong (#11833) 
* Fix LineTooLong

* Add Timeout ( fix lint )
 2023-06-01 09:40:18 +05:30
Pere Miquel Brull
11c07ee8ab
Fix #11516 - SAP Hana Connector (#11777) 
* SAP Hana skeleton

* Add SAP Hana Connector

* Fix ingestion and docs

* Prep SAP Hana Profiler

* Linting

* Update index.md

* Revert: Update index.md

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2023-05-31 16:00:31 +02:00
Mayur Singal
ae386d2e2b
Add Table Sample Data During Sample Data ingestion (#11773) 2023-05-31 12:23:45 +00:00
Mayur Singal
9e437fceec
Fix redshift view lineage parsing issue (#11702) 
* Fix redshift view lineage parsing issue

* address review comments
 2023-05-31 12:10:39 +00:00
Mayur Singal
b57bbf833f
Fix #11572: Glue Support Partition Columns & Use Pydantic Models (#11776) 2023-05-31 12:03:34 +00:00
Pere Miquel Brull
e02fc231da
Improve logging for test connection workflow (#11794) 2023-05-30 10:36:10 +05:30
Chirag Madlani
7adc291364
fix(ui): circular deps for entityReference.json (#11760) 
* fix(ui): circular deps for entityReference.json

* Fix circular Dependency python

* Cap Delta Spark version

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2023-05-26 18:02:21 +05:30
Pere Miquel Brull
5bd1b09402
Add new Looker test connection steps (#11749) 2023-05-24 18:01:08 +02:00
Mayur Singal
c44bff8fd3
Fix ValueError: too many values to unpack for col lineage (#11723) 2023-05-24 11:30:44 +05:30
Sriharsha Chintalapani
6509a3670a
Fix #11664: Refactor patch_mixin to use jsonpatch lib (#11696) 
* Fix #11664: Refactor patch_mixin to use jsonpatch lib

* Migrate to jsonpatch

* Fix nested cols

* Format

* Update patch_description

* Table constraints

* tag

* owner

* column tag

* column desc

* Format

* Format

* Fix log

* Update dbt patch

* Update column fqn

* Fix test

* Fix tests

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2023-05-23 15:47:11 +02:00
Onkar Ravgan
7589b7eeef
fixed kafka basicaauth bug (#11729) 2023-05-23 19:05:01 +05:30
Onkar Ravgan
f677408f20
Fixes 11603: Tableau Data Sources as Data Models (#11688) 
* added initial changes

* Added lineage details

* fixed pylint

* Fixed name

* Fixed empty lists
 2023-05-22 18:07:02 +02:00
Teddy
8c50d1af52
Fixes #4565 - Fetch Metrics from System tables (#11645) 
* feat: fetch metrics from system tables

* feat: add permission doc for fetching metrics from system tables

* feat: fix E2E tests to reflect full table row count after table metric update

* feat: ran linting

* feat: fix doc string engine name + function typing

* feat: ran python linting
 2023-05-22 09:04:18 +02:00
Teddy
ddbc7fe14d
Fixes #11570 - Add support for BQ Multi-project Profiler (#11692) 
* fix: extracted profiler object from workflow and implemented factory to allow service base logic

* fix: ran python linting

* fix: renamed `base` to `base_profiler_source`

* fix: add logic to set correct database for BQ multi project ID connections

* fix: ran python linting
 2023-05-20 14:22:53 -07:00
Mayur Singal
8ef98076ae
Fix view lineage not generated for oracle (#11648) 2023-05-19 10:47:55 -07:00
Pere Miquel Brull
0eb2201f94
Restructure NER Scanner internals (#11690) 
* Simplify col name scanner

* Restructure NER Scanner internals
 2023-05-19 18:21:01 +02:00
Mayur Singal
fafbfdaeab
Fix postgres view lineage parsing issue (#11689) 2023-05-19 17:47:50 +02:00
Ayush Shah
ad7258e7be
Fixes 10949: return Chunks for file formats & Centralize logic for different auth configs (#11639) 
* Centralize Auth and File formats datalake
 2023-05-19 18:54:28 +05:30
Pere Miquel Brull
d52d773707
Send encrypted automation workflow (#11681) 2023-05-19 15:04:42 +02:00
Mayur Singal
e9992a52a8
Fix #1604: Add Spline Pipeline Connector (#11562) 
* Fix #1604: Add Spline Connector

* Add tests & grammer validation

* Spline UI Changes & Docs

* fix pipeline workflow doc

* chore: use common field for dbService name

* chore: use const for beta services

* chore: add service icon

* Update ingestion/src/metadata/ingestion/source/pipeline/spline/metadata.py

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
 2023-05-19 14:46:32 +05:30
Pere Miquel Brull
50ad38ea0f
Fix #11548 - Secrets Managers comms with OMeta (#11602) 
* Remove secretsManagerCredentials from backend

* Remove secretsManagerCredentials from backend

* Add secrets manager loader

* Load SM in the ometa client

* Fix tests

* Fix tests

* Fix Lint

* Mock AWS region

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2023-05-19 09:43:11 +02:00
Pere Miquel Brull
4626363fd8
Fix parsing for Storage (#11663) 2023-05-19 09:36:44 +02:00
Pere Miquel Brull
b60f198674
Fix GitHub reader headers and add docs (#11675) 
* Fix header and add docs

* Format
 2023-05-19 09:36:30 +02:00
Chirag Madlani
763b96b8fe
bump(ui): rjsf to v5 (#11549) 
* bump(ui): rjsf to v5
It will fix validation and extra parameter issues

* address comments
fix code smells
fix cypress failure

* revert schema files

* bigquery fix
sonar cloud fix

* fix big query

* fix superset

* fix cypress

* fix cypress for big query

* fix failures

* fix java issue

* revert connectionBasicType.json
create custom SupersetConnection.json

* fix Tableau service issues #11637
 2023-05-18 08:03:54 -07:00
Pere Miquel Brull
8795337f88
Clean NER Scanner imports (#11653) 2023-05-18 12:53:22 +02:00
Mayur Singal
e4997c3749
Fix #11571: Support custom database name for glue (#11631) 2023-05-18 14:16:56 +05:30
Onkar Ravgan
e6a7ffc57c
Fixes: 11540 Added api_version and domain fields to Salesforce (#11618) 
* Added sales new fields

* fixed image after merge

* Fix Failing Test

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
 2023-05-18 10:53:44 +05:30
Pere Miquel Brull
1b90badd0e
Restructure PII processor (#11640) 
* Restructure PII processor

* Restructure PII processor

* Format
 2023-05-17 15:58:17 +02:00
Mayur Singal
ea615eed9d
Fix elasticsearch error (#11635) 2023-05-17 15:48:20 +05:30
Onkar Ravgan
3d9d4416b7
Fixed incompatible column name for Postgres version 11.6 (#11536) 
* postgres col name on version

* Added dependancy

* Added paranthesis validation

* review comments and tests
 2023-05-15 11:48:03 +05:30
Onkar Ravgan
cff403a05a
Validate if tags are created before attaching them to CreateRequest (#11554) 
* Added tags validation

* typo fixed
 2023-05-11 16:04:55 +00:00
Pere Miquel Brull
6040078a7c
Validate context in Airflow (#11551) 2023-05-11 12:23:43 +02:00
Sriharsha Chintalapani
e3a99e2f84
Fix Airflow ingestion: check if downstream task are null (#11539) 
* Fix Airflow ingestion: check if downstream task are null

* Fix Airflow ingestion: check if downstream task are null
 2023-05-11 06:43:57 +02:00
Mayur Singal
f7a0d3f5f2
Fix E2E Vertica & System Metric (#11525) 2023-05-10 17:35:55 +05:30
Mayur Singal
be7b056d72
Fix tableau models to make fields optional (#11513) 2023-05-10 12:23:44 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460) 
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
 2023-05-09 12:05:35 +02:00
Pere Miquel Brull
80af2b20bb
Centralize SSL Schemas & Add SSL for Airflow REST (#11363) 2023-05-08 21:05:10 +02:00
Ayush Shah
65fc94a292
Fix Dynamodb connection (#11473) 
---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
 2023-05-08 15:48:38 +00:00
Mayur Singal
ddc3060184
Fix vertica comments for version 9 (#11479) 2023-05-08 11:04:28 +00:00
Mayur Singal
074418eac3
Fix: Snowflake support extarnal tables (#11466) 2023-05-08 15:54:42 +05:30
Mayur Singal
a897954afc
Improve filtering for lineage query (#11457) 2023-05-08 15:18:51 +05:30
Ayush Shah
2c9ba537eb
Fix min max on rowversion/timestamp mssql (#11455) 2023-05-08 14:52:53 +05:30
Mayur Singal
e20f75fa54
Fix #11468: Fix salesforce scheme issue (#11474) 2023-05-08 14:02:17 +05:30
Nahuel
b22192575d
Fix#11216: Use Enum for SASL Mechanism for Kafka and Redpanda connections (#11385) 
* Fix#11216: Use ENUM for SASL Mechanism for Kafka and Redpanda connections

* Minor change

* Address PR comments

* Fix postgres migration
 2023-05-08 09:35:49 +02:00
Noe Alejandro Perez Dominguez
b9aef4156f
Allow client requests to be retried (#11464) 
This is regarding: https://github.com/psf/requests/issues/4664

The change allows errors to be handled and retried.

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
 2023-05-08 08:31:55 +02:00
Keith Sirmons
65c5b44eaa
Impala Connection Profiler is_nan rollback; Histogram fix. (#11388) 2023-05-05 21:45:30 +02:00
Onkar Ravgan
c7902344cb
Added tableau owner test connection step (#11436) 
* Added tableau owner test connection

* typo fixed

* remvoed generic exception
 2023-05-05 18:29:50 +05:30
Mayur Singal
2793c927cd
Fix postgres cypress issue (#11441) 2023-05-04 17:09:27 +00:00
Mayur Singal
6ddf7034ae
Add exception handling for tableau sheets (#11429) 
* Add exception handling for tableau sheets

* remove meating
 2023-05-04 16:38:27 +05:30
Mayur Singal
3f65c8ab0f
Fix Vertica column fetch query (#11424) 
* Fix vertica column fetch query

* fix timestamp datatype
 2023-05-04 13:37:00 +05:30