yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-03 22:58:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,692 Commits 698 Branches 150 Tags
Commit Graph

283 Commits

Author SHA1 Message Date
Onkar Ravgan
424239840f
Added result limits to usage queries (#6748) 
* Added result limits to queries

* Fixed formatting

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-08-17 08:07:39 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added (#6513) 
* dagster-connector-added

* code-formatted

* dagster-comments-removed

* dagster-comments-removed

* dagster-unittest-added

* code-formatted-pr-comments-resolved

* improved-code-quality

* increased-py-test-time-out

* improved-dagster-tests

* improved-dagster-tests

* reverted-pytests-timeout

* dagster-pytest-improved

* added-schema-in-omdcore

* updated-schema-in-omd-core

* ui-schema-updated-omd-core

* updated-dagster-schema

* dagter-schema-test-updated
 2022-08-13 15:18:14 +05:30
Pere Miquel Brull
99f0c96df4
Fix #6278 - Lineage workflow + Usage workflow (#6568) 
* Fixing conflicts

* Fixing Conflicts

* Fix snowflake

* Prepare snowflake and redshift

* snowflake use a single query

* Add bigquery

* Add clickhouse

* format

* Add query log lineage source

* Add filters to core

* Prepare mssql usage

* Update schemas

* Add example workflows

* Prepare lineage deployment

* Remove lineage

* Use filters

* Prep lineage DAG

* Prepare Lineage Ingestion

* Test lineage workflow

* format

* Comments

* fixed tests

* Revert "fixed tests"

This reverts commit 0e846c7c4806098e4adf7c071d133d1df68aedf5.

* fixed get connection method

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-08-12 13:24:58 +05:30
Shailesh Parmar
455c2d039e
(Feat) UI: Add Profiler Tab as per new mock (#6627) 
* add initial setup and added profiler tab

* added unit test for tableprofiler component

* added more coverage for table profiler component

* added get and put request and functionality for profiler setting

* added unit test for new components

* miner fix

* added data-testid for profiler settings component

* changed input box to slider for profile sample

* updated setting model design

* replaced select with treeSelect

* added unit test for setting modal

* fixing flaky cypress related to resizeObserver loop limit

* fixed failed unit test and added selected sample profiler text

* addressing comments
 2022-08-10 14:46:50 +05:30
Onkar Ravgan
af33cc0a31
Fixed Tableau ingestion issue (#6671) 
* Fixed Tableau ingestion issue

* revmoved doc string

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-08-09 23:55:32 +05:30
Nahuel
cf2cb6d531
Fix#6517: Add clusterName property to the application config yaml (#6610) 
* Add cluster name in the app configuration and start using it to create secrets id

* Update secret manager client in openmetadata for using default auth provider

* Add missing property in test config file
 2022-08-09 09:00:43 +02:00
Abhishek Pandey
a08201e383
multiple-database-service-names-added-in-dashboard (#6591) 
* multiple-database-service-names-added-in-dashboard

* code-formatted

* code-smell-removed

* code-formatted

* improved-dbserviceName-handling-in-dashboard

* fix checks failing

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
 2022-08-08 22:21:28 +05:30
Ayush Shah
a6db2e8a84
Fix for profiler: modified filter patterns and added error handling (#6608) 2022-08-08 10:43:17 +05:30
Mayur Singal
5e1b124d57
Fix #6530 & Fix #4975: Oracle Connection Enhancements (#6579) 
* Fix #6530 & Fix #4975: Oracle Connection Enhancements

* updated migrations & docs
 2022-08-05 10:28:04 +05:30
Teddy
b37bca5471
Fixes #2954 -- Ingest sample data for profile, test suite and co. (#6586) 
Fixes #2954 -- Ingest sample data for profile, test suite and co. (#6586)
 2022-08-04 19:44:21 +02:00
Sriharsha Chintalapani
1a42428e42
Add time series extention (#6416) 
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
 2022-08-04 07:22:47 -07:00
Milan Bariya
45e6c2c7d7
Sample Data Ingestion use Create request (#6546) 
* Sample Data Ingestion use Create request

* Fix: Code smell

* Fix: make_pyformat

* Fix: Changed based on comments
 2022-08-04 11:13:48 +02:00
Mayur Singal
bafca3b7b6
Fix #6387: Clean Ingestion (#6405) 
* Fix #6387: Clean Ingestion

* postgres fix

* Fixed Location in Sample Data
 2022-07-29 08:51:58 +02:00
Mayur Singal
c6efe8c142
Fix #6158: Fivetran Connector Added (#6329) 
* Fivetran Connector Added

* Fivetran unit test added

* Fixed Unit Tests

* Added Fivetran Docs & Added Fivetran in Pipeline Listing
 2022-07-27 20:50:56 +05:30
Abhishek Pandey
f125c597a9
Atlas connector fix (#4112) 
* refactored-atlas-schema

* atlas-source-connector-fixed

* code-formatted

* updated-service-creation

* code-formatted

* atlas-json-updated

* atlas-removed-from-database-service

* atlas-fqn-and-execution-flow-updated

* atlas-connector-fixed

* atlas--amundsen-removed-from-db-service

* code-cleanup

* removed-unused-codes

* code-smelled

* code-smell-removed
 2022-07-25 11:23:36 +05:30
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128) 
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128)
 2022-07-19 14:51:44 +02:00
Shailesh Parmar
04db051197
Revert "Pipeline lineage edge UI (#5891)" (#6159) 
This reverts commit 4d898a120fd4410a8ed660db252bc270710e9323.
 2022-07-19 18:07:46 +05:30
Onkar Ravgan
4d898a120f
Pipeline lineage edge UI (#5891) 
Pipeline lineage edge UI (#5891)
 2022-07-17 18:25:37 +02:00
Milan Bariya
187de08d1f
dbServiceName field move from serviceConnection to sourceConfig (#6047) 2022-07-14 11:25:31 +05:30
Pere Miquel Brull
a6dd100be4
Fix metadata es DAG (#5933) 2022-07-07 12:15:09 -07:00
Pere Miquel Brull
9ca7a75e2d
Add col lineage in sample usage (#5790) 2022-06-30 12:16:06 +02:00
Mayur Singal
dc497d298b
Fix #5768: Clickhouse Client Connection Fix (#5771) 2022-06-30 12:14:27 +02:00
Mayur Singal
d7cf1289d4
Yaml Fixes (#5733) 2022-06-29 15:25:14 +02:00
Milan Bariya
338d1efe40
FIX 5419: Glue pipeline connector not working (#5467) 
FIX 5419: Glue pipeline connector not working (#5467)
 2022-06-27 11:38:41 +02:00
Sriharsha Chintalapani
8528c51b9c
Fix #5516: Refactor elasticsearch indexes to be same as entity specifications (#5573) 
* Fix #5516: Refactor elasticsearch indexes to be same as entity specifications

Co-authored-by: darth-coder00 <aashit@getcollate.io>
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
 2022-06-27 01:19:27 -07:00
Pere Miquel Brull
bb4ac68ee3
Add backend connection for airflow dag extraction 2022-06-24 20:01:50 +02:00
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494) 
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
 2022-06-21 18:02:50 +02:00
Pere Miquel Brull
a14de6eee1
Fix #5367 - MlFlow connector & MLServices (#5446) 
Fix #5367 - MlFlow connector & MLServices (#5446)
 2022-06-21 14:54:36 +02:00
Onkar Ravgan
21dac15176
Added Mode Connector (#5475) 
* rebase with main

* Added lineage for mode

* added lineagerunner and enum constants

* added host port

* refactored mode according to new dashboard topology

* checkstyle fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-06-19 23:59:38 +05:30
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added (#5343) 
datalake-csv-files-ingestion-added (#5343)
 2022-06-15 08:57:21 +02:00
Milan Bariya
ab7689d7a8
FIX 5131: Fix Get Pipeline Status from Airflow metadata connector (#5396) 
FIX 5131: Fix Get Pipeline Status from Airflow metadata connector (#5396)
 2022-06-13 17:44:21 +02:00
Mayur Singal
51a275c481
Fix #1121: Added Airbyte Source (#5372) 
Fix #1121: Added Airbyte Source (#5372)
 2022-06-13 06:45:25 +02:00
Pere Miquel Brull
8e9d0a73f6
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265) 
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
 2022-06-08 16:10:40 +02:00
Milan Bariya
5e3f190f5d
Add: Add databaseSchema filed in Yaml file (#5316) 2022-06-07 12:12:41 +05:30
Mayur Singal
b3428771a3
Fix #4767: Refactor Usage & Lineage (#5190) 
Fix #4767: Refactor Usage & Lineage (#5190)
 2022-06-03 10:12:28 +02:00
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector (#5107) 
Refactored PowerBi Connector (#5107)
 2022-06-01 10:36:12 +02:00
Mayur Singal
f9bb54ed91
Fix #5162: Sample usage fixed (#5163) 
* Fix #5162: Sample usage fixed

* Test Fix
 2022-05-26 15:15:41 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125) 
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125)
 2022-05-25 08:35:16 +02:00
Pere Miquel Brull
9effaa8037
Update mlmodel sample data (#5060) 2022-05-20 08:45:26 +02:00
Mayur Singal
e1a207a37f
Migration Script Updated Yaml (#5021) 2022-05-18 20:03:16 +05:30
Ayush Shah
da7b67173c
Modified jsons to yamls (#4980) 2022-05-17 18:12:18 +05:30
Mayur Singal
f61ab495ff
Added sample query log file (#4996) 2022-05-17 18:01:00 +05:30
Pere Miquel Brull
c6915ca510
Fix #4923 - Presto ingestion & SQLAlchemy test connection refactor (#4946) 
Fix #4923 - Presto ingestion & SQLAlchemy test connection refactor (#4946)
 2022-05-14 06:44:43 +02:00
Pere Miquel Brull
52dac4ab37
Fix #4905 - Glue db and filters (#4907) 
Fix #4905 - Glue db and filters (#4907)
 2022-05-12 15:49:03 +02:00
Milan Bariya
0acf88e1ba
ISSUE-1072: Add Apache Pinot support (#4649) 
* ISSUE-1072: Add Apache Pinot support

* ISSUE-1072: Add Apache Pinot support

* Rename pinotdbConnection.json to pinotDBConnection.json
 2022-05-11 11:13:28 +02:00
Mayur Singal
76e36e812d
0.9 to 0.10 Metadata Migration Script (#4572) 
0.9 to 0.10 Metadata Migration Script (#4572)
 2022-05-10 09:33:27 +02:00
Ayush Shah
a4212ec356
Revamp Snowflake (#4653) 
Revamp Snowflake (#4653)
 2022-05-09 15:54:36 +02:00
Sriharsha Chintalapani
34858f3b32
Topics: Add Sample data (#4787) 
* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data

* Topics: Add Sample data
 2022-05-09 12:50:54 +02:00
Mayur Singal
fd521763d4
Fix #4590: Usage through query log file (#4719) 
* Usage through query log file

* Pick fileds if available in file

* Created Usage Souce
 2022-05-09 11:37:52 +02:00
Pere Miquel Brull
5700f6d68e
Fix #4768 - Add Location path (#4770) 
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
 2022-05-07 21:10:13 -07:00