yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-10 10:08:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 710 Branches 152 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client (#7502) 
Fix #7165 - Handle SSL certificates on ometa client (#7502)
 2022-09-16 09:39:27 +02:00
Mayur Singal
02f0945bb6
Fix #7159: Fixed nested column issue in bigquery (#7492) 2022-09-16 07:05:35 +02:00
Teddy
1ba6e284fe
Fixes #7118 by cleaning up test names (#7494) 
* Cleaned up tests names and add registry name tests

* Updated documentation for test types supported by OM
 2022-09-16 07:04:56 +02:00
Teddy
25d1789195
Fixes #7500 Added logic to fetch compose file from release (#7501) 
* Added logic to fetch compose file from release

* Used client version utility
 2022-09-15 19:32:30 +02:00
Teddy
3fdbe6ecfb
Added logic to report column level metric computation failure for profiler (#7465) 2022-09-15 17:39:29 +02:00
Milan Bariya
8502bf8e49
Fix: DBT root config error handled (#7446) 
* Fix: DBT root config error handled

* Fix: DBT root config error handled

* Fix: Py-test

* Fix: Change based on comments
 2022-09-15 18:26:05 +05:30
Nahuel
86ebb2025f
Fix#7407: Add custom source connections for different service types (#7419) 
* Fix #4639: Custom Service Schema

* Add custom source as service for different connections type

* Minor typo fix

* Add new service connections to UI

* Fix minor error

* Rename field config to connectionOptions

* Remove sourcePythonClass default value

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
 2022-09-15 10:53:27 +02:00
NiharDoshi99
5eb45948bd
Fixed: PostGIS geometry type (#7382) 
Fixed: PostGIS geometry type (#7382)
 2022-09-15 10:35:15 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Milan Bariya
591517a487
Fix: Align pre-commit isort (#7380) 2022-09-14 15:10:06 +02:00
Teddy
0bb83f138b
Fixed table filter pattern for bigquery service (#7416) 2022-09-14 15:00:45 +02:00
Mayur Singal
95b570178a
Fixed Logging Error for airflow lineage backend (#7438) 
* Fixed Loggin Error

* pyformat
 2022-09-14 06:33:09 +02:00
Teddy
d171e2f100
Removed typing_extension dependency (#7406) 2022-09-13 15:10:11 +02:00
Teddy
71679137a0
Fixes #6009 - Adds SQA MetaData object instance per DB (#7388) 
* Added SQA MetaData object instance per DB to allow same schema/table name across multiple db

* Update ingestion/src/metadata/orm_profiler/orm/converter.py

updated type hint
 2022-09-12 18:05:36 +02:00
Teddy
0677b5258f
Fixes #7299 by updating GE submodule to new test API (#7332) 
* Update GE logic to the new test API

* Cleaned up part of the code from
update to TestSuiteMixin

* Added + fixed tests

* Deleted unused files for GE tests

* fixed python tests
 2022-09-11 20:07:19 -07:00
Akash Jain
f2fc45ea41
feat: prepare-for-next-release-0-13-0 (#7348) 2022-09-09 01:25:41 +05:30
Onkar Ravgan
5aabf76b49
PowerBi urls fixed (#7295) 
* PowerBi urls fixed

* added constants

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-08 10:30:32 +05:30
Teddy
45c457280b
Fix Amundsen migration & added logic for table entity owners (#7288) 
* Fixed minor bugs with Amundsen ingestion and added logic to add table entity owners

* Updated version requirement for amundsen doc

* Fixed python style
 2022-09-07 09:20:06 +02:00
Nahuel
b829a2cbf3
Fix: Improvements on secret manager implementation (#7282) 
* Change local secret manager by noop

* Update openmetadata-secure-test.yaml
 2022-09-07 09:18:59 +02:00
Pere Miquel Brull
82a5348fb3
Improve mlflow error handling (#7262) 
* Improve mlflow error handling

* Improve mlflow error handling

* Update rest plugin docs

* Revert "Update rest plugin docs"

This reverts commit 08d56741efba04980fbfeb67d723d7bcdba27994.
 2022-09-06 15:24:52 -07:00
Pere Miquel Brull
659d72841e
Improve Nifi error handling (#7275) 2022-09-06 15:24:12 -07:00
Teddy
488a4898e8
Profiler close session after metric computation (#7269) 
* Added logic to close session after metric computation

* used context manager to manage session
 2022-09-06 22:16:28 +02:00
Sriharsha Chintalapani
d29a230726
Fix #7104: Add support for get resource permission by FQN (#7270) 2022-09-06 12:30:52 -07:00
Onkar Ravgan
a5737cd040
Changed chart filter status (#7265) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-06 08:04:18 -07:00
Onkar Ravgan
9be3df4a1e
Integrated DBT tests (#7122) 
* Integrated DBT tests

* Fixed py tests

* Review comments addressed

* Changed test suite name default value

* Added fixes

* update ui changes for new field

* send data along with api

* update name

* fixes for UI

* fixes for UI

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
 2022-09-05 22:25:31 +05:30
Pere Miquel Brull
e08bd1b1d2
Add exception handling (#7217) 2022-09-05 18:50:22 +02:00
Teddy
22eca3a6f6
Fixes #7215 -- no bind for param (#7226) 
* Fix no bind for params

* Update ingestion/src/metadata/orm_profiler/orm/functions/median.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-09-05 15:53:31 +02:00
Nahuel
8f1ef49cdb
Fix issue ingesting Kafka when the basic auth is enabled in the Schema Registry (#7203) 2022-09-04 15:59:11 +02:00
Nahuel
6f196a5c12
Added workflow config for redpanda (#7170) 2022-09-03 18:20:09 +02:00
Teddy
dc84cdbc8e
Fixed problem with include columns profiler runs (#7177) 2022-09-03 18:18:50 +02:00
Mayur Singal
de2904990d
Add Query Tag in Snowflake Profiler (#7106) 
* Add Query Tag in Snowflake Profiler

* Revert conflict

* Move to session_factory

* Replace engine with session

* remove set_session_tag from init

* set_session_tag with session as args
 2022-09-02 14:58:57 +02:00
Teddy
d9003a90e7
Added logic to handle testSuite when no database is set in service co… (#7129) 
* Added logic to handle testSuite when no database is set in service connection

* Fixed python formatting
 2022-09-01 22:06:13 +02:00
Teddy
891603e72f
Remove unique computation for unsupported fields (#7117) 2022-09-01 15:57:33 +02:00
Teddy
9dbcb3911b
Fix minor column data quality test bugs (#7111) 
* Fixed test name issue + filtered out partition details for non BQ tables

* Exclude non BQ table from partition processing

* Fixed test + formating
 2022-09-01 13:47:00 +02:00
Pere Miquel Brull
613a329f40
Fix #7089 - Add Redpanda connector (#7092) 
Fix #7089 - Add Redpanda connector (#7092)
 2022-09-01 06:39:27 +02:00
Pere Miquel Brull
7d2527bbeb
Fix #6961 - Fallback to another IP service (#7019) 
Fix #6961  - Fallback to another IP service (#7019)
 2022-09-01 06:39:12 +02:00
Teddy
ef41382cb1
Fixes #7094 by fixing minior bugs in table tests (#7095) 2022-08-31 21:35:33 +02:00
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096) 
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
 2022-08-31 21:30:24 +02:00
Teddy
811f640a18
Fixes #6891 by implementing support for VARIANT DType (#7084) 2022-08-31 19:01:00 +02:00
Teddy
01309249c8
Added logic to allow profile data to be ingested when sample data fetch fails (#7088) 
* Added logic to allow profile data to be ingested when sample data fetching faisl

* Update ingestion/src/metadata/orm_profiler/profiler/core.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-08-31 18:29:56 +02:00
Pere Miquel Brull
76a83cb9ec
Fix #6959 - metadata CLI with postgres (#7031) 
* Use the CLI to install OM with postgres

* CLI update
 2022-08-31 14:21:35 +02:00
Nahuel
0762e39172
Minor fixes related to Secrets Manager implementation (#7046) 
* Minor fixes related to Secrets Manager implementation

* Fix failing test
 2022-08-31 14:14:55 +02:00
Pere Miquel Brull
d791fe8289
Fix #6816 - Add supportsQueryComment & Fix #7078 - Athena Session Token (#7079) 
* Athena with aws session token

* add supports query comment property to the required db services

* Hide query comment toggle
 2022-08-31 14:03:54 +02:00
Suresh Srinivas
cffecc550a
Fixes #7072 - Remove life cycle policies (#7073) 
* Fixes #7072 - Remove life cycle policies

* Remove policy sink

* Remove OMetaPolicy

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-08-31 12:47:03 +05:30
Pere Miquel Brull
3c95423301
Handle internal runtime errors when validating workflows (#7049) 2022-08-31 07:55:40 +02:00
Mayur Singal
7caac4616f
Fix #6645: Remove required fields from mssql (#7065) 2022-08-31 06:52:37 +02:00
Mayur Singal
ef324f8614
Fix #6945: Add session query tag for usage (#7060) 2022-08-31 06:43:57 +02:00
Nahuel
db41be4c4a
Fix#6929: docker-compose services should wait until OpenMetadata DB is created (#7025) 
* Added the docker compose for postgres

* Added changes as per the comments on PR

* Airflow Connectivity to Postgres

* Changes are done as per the comments

* Replocate changes to local dockerfile

* Fixed Airflow Dockerfile

* docker-compose services should wait until OpenMetadata DB is created

* remove unnecesary wait for db service

* Add dependencies to airflow image

* Add missing dependencies to airflow Dockerfile

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
 2022-08-30 23:55:46 +02:00
Teddy
a39c4db8e7
Add partial support for BQ partitioned table (#7066) 
* Added support for BQ time based partition (not ingestion)

* Fixed minor errors in test suite workflow
 2022-08-30 11:39:15 -07:00
Mayur Singal
791245c0e8
Redshift Mark Partitioned Tables (#7063) 2022-08-30 18:40:51 +02:00