yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-11-03 20:19:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,522 Commits 876 Branches 177 Tags
Commit Graph

1849 Commits

Author SHA1 Message Date
Pere Miquel Brull
5bd1b09402
Add new Looker test connection steps (#11749) 2023-05-24 18:01:08 +02:00
Mayur Singal
c44bff8fd3
Fix ValueError: too many values to unpack for col lineage (#11723) 2023-05-24 11:30:44 +05:30
Onkar Ravgan
3fbddc2a03
upgrade kafka dep (#11721) 2023-05-23 09:59:12 -07:00
Sriharsha Chintalapani
6509a3670a
Fix #11664: Refactor patch_mixin to use jsonpatch lib (#11696) 
* Fix #11664: Refactor patch_mixin to use jsonpatch lib

* Migrate to jsonpatch

* Fix nested cols

* Format

* Update patch_description

* Table constraints

* tag

* owner

* column tag

* column desc

* Format

* Format

* Fix log

* Update dbt patch

* Update column fqn

* Fix test

* Fix tests

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2023-05-23 15:47:11 +02:00
Onkar Ravgan
7589b7eeef
fixed kafka basicaauth bug (#11729) 2023-05-23 19:05:01 +05:30
Onkar Ravgan
efb37fa7af
Fixed tableau e2e (#11716) 2023-05-23 15:36:08 +05:30
Pere Miquel Brull
1370325762
Fix typing_extension verson (#11719) 
* fix extension

* fix extension
 2023-05-23 10:09:31 +02:00
Onkar Ravgan
f677408f20
Fixes 11603: Tableau Data Sources as Data Models (#11688) 
* added initial changes

* Added lineage details

* fixed pylint

* Fixed name

* Fixed empty lists
 2023-05-22 18:07:02 +02:00
Teddy
9f2a02c718
fix: increase sleep delay for system tables (#11704) 2023-05-22 13:43:50 +00:00
Teddy
8c50d1af52
Fixes #4565 - Fetch Metrics from System tables (#11645) 
* feat: fetch metrics from system tables

* feat: add permission doc for fetching metrics from system tables

* feat: fix E2E tests to reflect full table row count after table metric update

* feat: ran linting

* feat: fix doc string engine name + function typing

* feat: ran python linting
 2023-05-22 09:04:18 +02:00
Teddy
ddbc7fe14d
Fixes #11570 - Add support for BQ Multi-project Profiler (#11692) 
* fix: extracted profiler object from workflow and implemented factory to allow service base logic

* fix: ran python linting

* fix: renamed `base` to `base_profiler_source`

* fix: add logic to set correct database for BQ multi project ID connections

* fix: ran python linting
 2023-05-20 14:22:53 -07:00
Mayur Singal
8ef98076ae
Fix view lineage not generated for oracle (#11648) 2023-05-19 10:47:55 -07:00
Pere Miquel Brull
0eb2201f94
Restructure NER Scanner internals (#11690) 
* Simplify col name scanner

* Restructure NER Scanner internals
 2023-05-19 18:21:01 +02:00
Mayur Singal
fafbfdaeab
Fix postgres view lineage parsing issue (#11689) 2023-05-19 17:47:50 +02:00
Ayush Shah
ad7258e7be
Fixes 10949: return Chunks for file formats & Centralize logic for different auth configs (#11639) 
* Centralize Auth and File formats datalake
 2023-05-19 18:54:28 +05:30
Pere Miquel Brull
d52d773707
Send encrypted automation workflow (#11681) 2023-05-19 15:04:42 +02:00
Mayur Singal
e9992a52a8
Fix #1604: Add Spline Pipeline Connector (#11562) 
* Fix #1604: Add Spline Connector

* Add tests & grammer validation

* Spline UI Changes & Docs

* fix pipeline workflow doc

* chore: use common field for dbService name

* chore: use const for beta services

* chore: add service icon

* Update ingestion/src/metadata/ingestion/source/pipeline/spline/metadata.py

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
 2023-05-19 14:46:32 +05:30
Pere Miquel Brull
50ad38ea0f
Fix #11548 - Secrets Managers comms with OMeta (#11602) 
* Remove secretsManagerCredentials from backend

* Remove secretsManagerCredentials from backend

* Add secrets manager loader

* Load SM in the ometa client

* Fix tests

* Fix tests

* Fix Lint

* Mock AWS region

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2023-05-19 09:43:11 +02:00
Pere Miquel Brull
4626363fd8
Fix parsing for Storage (#11663) 2023-05-19 09:36:44 +02:00
Pere Miquel Brull
b60f198674
Fix GitHub reader headers and add docs (#11675) 
* Fix header and add docs

* Format
 2023-05-19 09:36:30 +02:00
Chirag Madlani
763b96b8fe
bump(ui): rjsf to v5 (#11549) 
* bump(ui): rjsf to v5
It will fix validation and extra parameter issues

* address comments
fix code smells
fix cypress failure

* revert schema files

* bigquery fix
sonar cloud fix

* fix big query

* fix superset

* fix cypress

* fix cypress for big query

* fix failures

* fix java issue

* revert connectionBasicType.json
create custom SupersetConnection.json

* fix Tableau service issues #11637
 2023-05-18 08:03:54 -07:00
Pere Miquel Brull
8795337f88
Clean NER Scanner imports (#11653) 2023-05-18 12:53:22 +02:00
Mayur Singal
e4997c3749
Fix #11571: Support custom database name for glue (#11631) 2023-05-18 14:16:56 +05:30
Onkar Ravgan
e6a7ffc57c
Fixes: 11540 Added api_version and domain fields to Salesforce (#11618) 
* Added sales new fields

* fixed image after merge

* Fix Failing Test

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
 2023-05-18 10:53:44 +05:30
Pere Miquel Brull
1b90badd0e
Restructure PII processor (#11640) 
* Restructure PII processor

* Restructure PII processor

* Format
 2023-05-17 15:58:17 +02:00
Mayur Singal
ea615eed9d
Fix elasticsearch error (#11635) 2023-05-17 15:48:20 +05:30
Pere Miquel Brull
c0ea11a477
Add libsasl deps (#11613) 2023-05-16 14:32:48 +02:00
Mayur Singal
b53a362772
Increase delay for system metric in e2e tests (#11607) 2023-05-16 06:57:36 +00:00
Pere Miquel Brull
019014b8d3
11579 Task - Add () in sample data (#11591) 2023-05-15 10:09:57 +02:00
Onkar Ravgan
3d9d4416b7
Fixed incompatible column name for Postgres version 11.6 (#11536) 
* postgres col name on version

* Added dependancy

* Added paranthesis validation

* review comments and tests
 2023-05-15 11:48:03 +05:30
Akash Jain
92d5bfa94e
fix: versions in main branch (#11478) 
* fix: versions in main branch

* Prepare main branch for next release 1.1.0

* prepare main for latest release 1.0.1
 2023-05-15 10:42:29 +05:30
Mayur Singal
e61bb3cf0d
Fix snowflake E2E: add system metric sleep time (#11569) 2023-05-12 14:09:57 +05:30
Onkar Ravgan
cff403a05a
Validate if tags are created before attaching them to CreateRequest (#11554) 
* Added tags validation

* typo fixed
 2023-05-11 16:04:55 +00:00
Mayur Singal
ef7b02529d
Remove sqlalchemy-ibmi from db2 dependency (#11553) 
* Remove sqlalchemy-ibmi from db2 dependency

* remove from json schema

* add migration

* update what's new
 2023-05-11 15:03:26 +02:00
Pere Miquel Brull
6040078a7c
Validate context in Airflow (#11551) 2023-05-11 12:23:43 +02:00
Pere Miquel Brull
f22d604c54
Remove old tests (#11505) 
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
 2023-05-11 10:29:30 +02:00
Sriharsha Chintalapani
e3a99e2f84
Fix Airflow ingestion: check if downstream task are null (#11539) 
* Fix Airflow ingestion: check if downstream task are null

* Fix Airflow ingestion: check if downstream task are null
 2023-05-11 06:43:57 +02:00
Mayur Singal
f7a0d3f5f2
Fix E2E Vertica & System Metric (#11525) 2023-05-10 17:35:55 +05:30
Mayur Singal
be7b056d72
Fix tableau models to make fields optional (#11513) 2023-05-10 12:23:44 +05:30
Teddy
60de33d7cf
Fixes #11384 - Implement mem. optimization for sys. metrics (#11460) 
* fix: optimize system metrics retrieval for memory

* fix: ran python linting

* fix: logic to retrieve unique system metrics operations

* fix: added logic to clean up query before parsing it

* fix: added E2E tests for rds, bq, snflk system metrics

* fix: ran python linting

* fix: fix postgres query + add default byte size to env var

* fix: ran python linting
 2023-05-09 12:05:35 +02:00
Pere Miquel Brull
80af2b20bb
Centralize SSL Schemas & Add SSL for Airflow REST (#11363) 2023-05-08 21:05:10 +02:00
Ayush Shah
65fc94a292
Fix Dynamodb connection (#11473) 
---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
 2023-05-08 15:48:38 +00:00
Mayur Singal
ddc3060184
Fix vertica comments for version 9 (#11479) 2023-05-08 11:04:28 +00:00
Mayur Singal
074418eac3
Fix: Snowflake support extarnal tables (#11466) 2023-05-08 15:54:42 +05:30
Mayur Singal
a897954afc
Improve filtering for lineage query (#11457) 2023-05-08 15:18:51 +05:30
Ayush Shah
2c9ba537eb
Fix min max on rowversion/timestamp mssql (#11455) 2023-05-08 14:52:53 +05:30
Mayur Singal
e20f75fa54
Fix #11468: Fix salesforce scheme issue (#11474) 2023-05-08 14:02:17 +05:30
Pere Miquel Brull
aaf92a9ae8
Bump python-daemon (#11477) 2023-05-08 09:59:57 +02:00
Nahuel
b22192575d
Fix#11216: Use Enum for SASL Mechanism for Kafka and Redpanda connections (#11385) 
* Fix#11216: Use ENUM for SASL Mechanism for Kafka and Redpanda connections

* Minor change

* Address PR comments

* Fix postgres migration
 2023-05-08 09:35:49 +02:00
Noe Alejandro Perez Dominguez
b9aef4156f
Allow client requests to be retried (#11464) 
This is regarding: https://github.com/psf/requests/issues/4664

The change allows errors to be handled and retried.

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
 2023-05-08 08:31:55 +02:00