yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-04 21:32:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,566 Commits 823 Branches 166 Tags
Commit Graph

18 Commits

Author SHA1 Message Date
Onkar Ravgan
949989fb1c
Added dbt parser (#9982) 
* Added dbt parser

* Added library dependency

* format and final fixes

* Addressed review comments

* Fixed typo
 2023-01-29 20:47:39 +01:00
Pere Miquel Brull
c368116697
Add dbt cloud URL as an input parameter (#9911) 
* Add dbt cloud URL as an input parameter

* support dbt cloud url from UI

* Flag dbtCloudUrl as required

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
 2023-01-26 09:36:03 +01:00
Pere Miquel Brull
f2fb0521c2
Update airflow loggers and rename ometa loggers (#9868) 
* Update airflow loggers and rename ometa loggers

* ANSI print to logger

* Remove colored logging from tests

* Merge ometa_logger into the one used in loggers class

* linting

* linting

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
 2023-01-23 16:28:17 +01:00
Onkar Ravgan
c1fdc59e84
Added DBT Workflow fixes (#9419) 
* Added DBT fixes

* Addressed review comments
 2022-12-20 19:06:01 +05:30
Mayur Singal
497eca70ab
Fix DBT HTTP source error (#9397) 2022-12-19 14:55:31 +01:00
Mayur Singal
425a50bc3a
DBT ingestion improvements (#9383) 
* DBT ingestion improvements

* use fqn build instead of join

* fix linting

* fix linting
 2022-12-19 06:37:54 +01:00
Ashish Gupta
7c181a5a89
Dbt worflow (#9302) 2022-12-16 17:00:28 +05:30
Nahuel
f57fe1d507
Fix#8577: Ingestion Pipelines sensitive passwords fields are stored in secrets store (#8725) 
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test

* Bots sensitive passwords fields are stored in secrets store

* Ingestion pipeline sensitive passwords fields are stored in secrets store

* Fix Java style

* Add update for ingestion pipelines on start up

* Add pylint exception

* Fix broken test

* Update UI references
 2022-11-15 06:34:49 +01:00
Onkar Ravgan
d9b50b5be9
Added project id to DBT cloud config (#8062) 
* Added project id to DBT cloud config

* added field in cloud config source Dbt config

* fix unit test issue

* Fixed pylint

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
 2022-10-19 18:59:33 +05:30
Pere Miquel Brull
4b3ca065c4
Fix #3394 - Pylint fixes and add it to CI (#8084) 
Fix #3394 - Pylint fixes and add it to CI (#8084)
 2022-10-11 17:15:02 +02:00
Onkar Ravgan
107eeef8c7
Added fixes according to pylint (#8009) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-10-10 12:53:47 +02:00
Onkar Ravgan
9be3df4a1e
Integrated DBT tests (#7122) 
* Integrated DBT tests

* Fixed py tests

* Review comments addressed

* Changed test suite name default value

* Added fixes

* update ui changes for new field

* send data along with api

* update name

* fixes for UI

* fixes for UI

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
 2022-09-05 22:25:31 +05:30
Nahuel
4c6f0c7bda
Fix#6027: Fix logging in metadata package modules except ingestion and orm_profiler (#6970) 
* Fix logging in metadata package modules except ingestion and orm_profiler

* Reduce log level to _get_columns_with_constraints method
 2022-08-29 06:46:06 +02:00
Pere Miquel Brull
e2916b2521
Organise ingestion module (#6515) 
Organise ingestion module (#6515)
 2022-08-03 09:55:50 +02:00
Onkar Ravgan
ba725b81e7
Dbt Fixes and removed urllib from DBT and ometa (#5928) 
* Adding default values

* removed urllib and dbt fixes

* removed urllib and dbt fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-07-07 17:02:32 +02:00
Onkar Ravgan
5537db2ab4
Added DBT Cloud support (#5436) 
Added DBT Cloud support (#5436)
 2022-06-13 18:05:13 +02:00
Onkar Ravgan
6f97b25175
Added prefix while parsing bucket objects (#4665) 
* Added prefix to s3 bucket objects

* Added support for prefixes in gcs and s3 for DBT

* implented review comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-05-05 10:49:10 +05:30
Onkar Ravgan
148d7f47ec
Refactor DBT for schema changes (#4497) 
Refactor DBT for schema changes (#4497)
 2022-04-26 14:10:47 +02:00