yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-27 08:44:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,579 Commits 865 Branches 175 Tags
Commit Graph

1307 Commits

Author SHA1 Message Date
Ashish Gupta
8ddab79dc1
UI :- Remove rc-tree and react-table dependencies (#8049) 
* Remove rc-tree and react-table dependencies

* fix unit test issue

* File Formatted

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2022-10-11 15:42:58 +05:30
Teddy
3b7f576d04
Fixed linting for Profiler (#7922) 
* - Fixed linting
- Added logic to skip partition check when engine is not BQ
- Added ingestion partition logic to testSuite

* Fixed python formating

* Fixed test for BQ partition
 2022-10-11 09:36:36 +02:00
Mayur Singal
22ac150d7b
Database Source Lint (#8034) 2022-10-11 13:05:08 +05:30
Nahuel
806dcea0de
Fix Superset REST client requests (#8058) 2022-10-11 08:23:26 +02:00
Teddy
3c093f65fc
Fixes test suite pylint (#7937) 
* Fixed linting for testSuite

* fixed python format

* Fixed conflict
 2022-10-11 06:55:14 +02:00
Teddy
d0984c5a43
Fixes lineage linting (#7956) 
* Fixed pylint

* Fixed python formating
 2022-10-11 06:55:08 +02:00
Mayur Singal
a2894f7990
Dashboard Source Lint (#7987) 2022-10-11 06:50:55 +02:00
Pere Miquel Brull
f031293af0
Fix Pylint ingestion/bulksink and ingestion/stage (#8030) 
* Pylint ingestion bulksink

* Pylint stage

* Remove test

* Remove stage
 2022-10-10 14:06:43 +02:00
Onkar Ravgan
107eeef8c7
Added fixes according to pylint (#8009) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-10-10 12:53:47 +02:00
Nahuel
5c499d2a7a
Add CLI E2E tests for MySQL (#8041) 
* Add CLI E2E tests for MySQL

* Fix setup.py and pylint

* Add missing doc and update code after pylint refactor
 2022-10-10 11:36:20 +02:00
Pere Miquel Brull
b6ff10f781
Pylint ingestion models (#8029) 2022-10-10 06:51:24 +02:00
Pere Miquel Brull
ab2fabee63
Pylint api (#8040) 2022-10-10 06:50:28 +02:00
Mayur Singal
13f6f79f30
Metadata Source Lint (#8018) 2022-10-10 06:46:59 +02:00
Mayur Singal
b8e989af6c
Pipeline Source Lint (#8002) 2022-10-10 06:46:31 +02:00
Mayur Singal
4e51c70dcc
Messaging & MlModel Source Lint (#8008) 
* Messaging Source Lint

* MlModel Source Lint
 2022-10-10 06:46:24 +02:00
Teddy
90c569eadc
Removed click.Tuple() and used nargs instead (#8035) 2022-10-07 18:43:07 +02:00
Sriharsha Chintalapani
5be142959a
Fix #8036: Superset ingestion fails during the lineage fetch for charts (#8037) 2022-10-07 18:42:46 +02:00
Pere Miquel Brull
783557e6da
Fix Pylint for ingestion/sink (#7961) 
* pylint on sink

* Add missing registration
 2022-10-07 07:02:27 +02:00
Teddy
cd6b3d6b8a
Removes support database for Trino Connection (#7973) 
* Removes support database for Trino Connection

* Added logic to set catalog or database attribute for connection if not already set
 2022-10-06 10:39:23 +02:00
Teddy
e244a241c3
added logic to clean up quotes from table constraints (#7959) 2022-10-05 16:09:33 +02:00
Milan Bariya
cd43f1fdcf
Fix: connector for hive has double dash (#7953) 2022-10-05 12:01:13 +02:00
Teddy
15f7c4aa41
Fix param name for median test (#7942) 
* Fixed param name for median test

* Fixed unite test for median DQ
 2022-10-05 06:32:28 +02:00
Teddy
64fdebe491
Fix #7911 -- Trino profiler query (#7920) 2022-10-04 21:22:13 +02:00
Pere Miquel Brull
9c64aedd77
Fix pylint in ometa_api (#7899) 2022-10-04 16:57:07 +02:00
Ayush Shah
ad53c509ba
Fix Bigquery ADC diff projectid (#7935) 2022-10-04 19:58:17 +05:30
Sriharsha Chintalapani
8efc0370e5
Fix #7904: Filter out old tasks which doesn't have dag runs while publishing status (#7905) 
* Fix #7904: Filter out old tasks which doesn't have dag runs while publishing status

* Fix #7904: Filter out old tasks which doesn't have dag runs while publishing status
 2022-10-04 06:34:55 +02:00
Abhishek Pandey
566602373f
datalake-gcs-performance-improved (#7609) 2022-10-04 09:52:10 +05:30
Mayur Singal
7ecc09c17c
Glue Pipeline Name Fix (#7892) 2022-10-03 19:38:10 +05:30
Teddy
63b5233fd3
Added util command to overwrite dag_generated_config path in DAG file (#7831) 
* Added util command to overwrite dag_generated_config path in DAG file

* Added logic to only write file on change
 2022-10-03 09:24:47 +02:00
Teddy
819188cfc1
Fixed mysql BLOB type when ingesting sample data (#7813) 2022-10-02 16:44:41 -07:00
Mayur Singal
ca51fa0245
Fix #7801: Fixed Glue Pipeline (#7832) 
Co-authored-by: Apple <apple@Apples-MacBook-Pro.local>
 2022-10-02 16:43:35 -07:00
Nahuel
593ca3a4a0
Fix bot creation and edition logic (#7796) 
* Fix bot creation and edition logic

* Fix minor error creating user

* Fix failing test

* Minor fixes

* Add missing tests for new flows

* Fix put_failIfBotHasARelationshipToAnotherUser test

* Changes after manual testing

* Move where auth_provider is retrieved in the secret manager
 2022-10-01 11:25:56 +02:00
Teddy
595e5c1b89
Added checks to see if DAG can reach OM (#7794) 2022-09-30 17:57:03 +02:00
Milan Bariya
d2adde53c6
Add: Add metadata restore CLI (#7596) 
* Add: Add metadata restore CLI

* Fix: Query execution error

* Fix: Query execution error

* Fix: Change based on comments

* Update ingestion/src/metadata/cli/restore.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-09-30 18:32:16 +05:30
Vj-L
e473d2caa4
Fixed clean function in docker.py (#7806) 
* Fixed clean function in docker.py

* Fixed clean function in docker.py

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-30 14:14:09 +05:30
Vj-L
489d506e3a
Removed the volume for Database (#7798) 
* Removed the volume for Database

* Removed the volume for Database

* Added named volume

* Added named volume

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-29 21:44:12 +05:30
Vj-L
6cfd16925a
Added default volumes (#7741) 
* Added default volumes

* Ran make py_format for formatting

* Added sample data in mount directories

* Updated as per the comments

* Done changes for --ingest_sample_data flag

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-29 14:53:55 +05:30
Teddy
962866a30e
Fixes #7280 - Implements support for BYTEA DType (#7749) 
* Added support for postgres bytea data type

* Added BYTEA support for profiler and converts bytes to hex on results read
 2022-09-28 13:28:35 +02:00
Mayur Singal
24daae88e9
Add flag use fqn for filter patterns (#7755) 2022-09-28 16:41:22 +05:30
Milan Bariya
f6ef053196
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731) 
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731)
 2022-09-28 11:59:54 +02:00
Teddy
7f81c28e58
Fix minor issues with dbt test results ingestion (#7744) 
* - Added support for test ingestion without `dbt docs generate` run
- removed millisecond from timestamp
- changed test result failure to 0

* Removed unused methods
 2022-09-27 17:04:23 +02:00
Onkar Ravgan
dc74089f0e
Fixed pipeline FQN bug (#7740) 
* Fixed pipeline FQN

* fixed messaging service

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-27 14:23:59 +05:30
Onkar Ravgan
8afbbb8642
Ingest DBT tags (#7726) 
* added tags

* Added dbt tags ingestion

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-27 11:12:53 +05:30
Milan Bariya
1c78e835d9
Fix: Error initializing ingest: ‘RedshiftSource’ object has no attribute ‘dbt_manifest’ (#7723) 2022-09-26 19:42:22 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler (#7506) 2022-09-26 19:41:40 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI (#7637) 
* Update JSON schemas

* Update create and update endpoint and remove /generateToken endpoint

* Add AuthMechanism and Token Expiry Field on the Add bot page

* Remove unwanted tests

* Add logic to show authMechanism based on auth provider

* Add authConfig to bots details page

* Backend implementation with secret manager

* Fix invalid date issue

* Add support for update bot token details

* Add logic for SSO auth

* Add fields for google sso auth client

* Add Edit Option.

* Updated ingestion CLI and secret manager issues

* Updated tests with errors

* Removed unused method

* Removed test files

* Fix broken JSON schema

* Fix typescript error

* Pass the bot permissions from the bot details page

* Minor errors related to the secret manager

* Restore Airflow configuration for retrocompability

* Add support for all SsoServiceType client config

* Fix Unit test

* Update tests

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2022-09-26 18:26:24 +05:30
NiharDoshi99
d9f3ab23d7
Fixed: SampleData Teams and teamTypes (#7682) 2022-09-26 18:22:41 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions (#7653) 
* Added control for DBT descriptions

* Fixed tests

* Added UI changes

* fixed maven ci tests

* Java formatting changes

* ui review fixes

* Fixed pytests

* Fixed python integration tests

* fixed airflow tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-26 16:19:47 +05:30
Mayur Singal
2df214a381
Revamp filter patterns (#7662) 2022-09-26 12:23:32 +05:30
Teddy
c6fcad2c1d
Fixes #7478 -- Added Hive syntax for RAND and PERCENTILE functions (#7685) 
* Added Hive syntax for RAND and PERCENTILE functions

* Added logic to handle missing context attributes in post_process of the topology

* Removed commit to wrong brancg
 2022-09-23 15:48:09 -07:00