Milan Bariya
994b769d25
Databricks Connection - User & Password clean ( #6866 )
...
* Databricks Connection - User & Password clean
* Fix: Python checkstyle failed
* Fix: update the migration scripts
2022-08-23 14:36:58 +02:00
Nahuel
4e176fbc66
Fix#5917: Implementation of temp secret for testing connection ( #6832 )
...
* Implementation of temp secret for testing connection
* Fix tests
2022-08-22 08:43:23 +02:00
Nahuel
8691022d0f
AWS SSM secrets manager implementation on ingestion ( #6805 )
...
* Implementation of AWS SSM as secrets manager
* Remove dead code
* Minor fixes
* Allow using default credentials in AWS client
* Fixed py style
* Fixed tests imports
* Minor changes
* Add patch to failing test
* Fix how we were storing dbtConfigSource
* Address PR comments
2022-08-19 16:15:40 +02:00
Suresh Srinivas
7302c1658d
Upgrade dependencies for 0.12 release ( #6815 )
2022-08-18 16:13:04 -07:00
Nahuel
89ec1f9c6d
AWS SSM secrets manager implementation on backend ( #6771 )
...
* SSM secrets manager implementation in backend
* Add test and refactor
* Use SecretString type for storing parameters
2022-08-18 11:06:14 +02:00
Nahuel
00ce67c01e
Fix#6643: Secure in secrets manager the dbtConfigSource object ( #6743 )
...
* Secure in secrets manager the dbtConfigSource object
* Add missing tests
* Fix minor bug
* Minor code refactor
2022-08-17 10:32:43 +02:00
Nahuel
30e7312203
Fix#5920: Expose hostPort field for some services ( #6678 )
...
* Expose hostPort field for some services
* Fix failing tests after changes
* Remove added interface to json schemas
* Change implementation to use annotations for exposing fields of objects
* Update JsonUtils test
* Format Java code
2022-08-16 09:54:47 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added ( #6513 )
...
* dagster-connector-added
* code-formatted
* dagster-comments-removed
* dagster-comments-removed
* dagster-unittest-added
* code-formatted-pr-comments-resolved
* improved-code-quality
* increased-py-test-time-out
* improved-dagster-tests
* improved-dagster-tests
* reverted-pytests-timeout
* dagster-pytest-improved
* added-schema-in-omdcore
* updated-schema-in-omd-core
* ui-schema-updated-omd-core
* updated-dagster-schema
* dagter-schema-test-updated
2022-08-13 15:18:14 +05:30
Nahuel
80ca224c39
Fix: Avoid store sensitive info in events repository using custom annotation ( #6666 )
...
* Avoid store sensitive infomation in created event when a Secrets Manager is configured
* Refactor code to start using custom annotations in the json schma deffinition
* Remove unused config object
* Add removed comment
* Add separated entity comparision for events in EntityResourceTest
* Add missing mask property in service connection schemas
* Update openmetadata-core pom.xml
* Missing import in openmetadata-core pom.xml
2022-08-12 15:56:37 -07:00
Nahuel
65517beb62
Fix#5919: Implementation of migration process when a Secrets Manager is configured ( #6584 )
...
* Implementation of migration process when a Secrets Manager is configured
* Update conf/openmetadata.yaml
* Address PR comments
* Minor change in SQL statment in CollectionDAO
* Address Sonar security hotspot issue
2022-08-09 16:11:57 +02:00
Nahuel
cf2cb6d531
Fix#6517: Add clusterName property to the application config yaml ( #6610 )
...
* Add cluster name in the app configuration and start using it to create secrets id
* Update secret manager client in openmetadata for using default auth provider
* Add missing property in test config file
2022-08-09 09:00:43 +02:00
Nahuel
986480af7c
Fix DatabaseServiceType enum in JSON schema definition ( #6642 )
2022-08-08 21:57:59 +02:00
Ayush Shah
a6db2e8a84
Fix for profiler: modified filter patterns and added error handling ( #6608 )
2022-08-08 10:43:17 +05:30
Suresh Srinivas
7825986105
Fixes #6554 Add support for team of type Group ( #6588 )
...
* Fixes #6554 Add support for team of type Group
* Fixing test failure
2022-08-05 10:49:42 -07:00
Sriharsha Chintalapani
1a42428e42
Add time series extention ( #6416 )
...
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-04 07:22:47 -07:00
Suresh Srinivas
951251a444
Fixes #6518 - Support conditional policies and policies overhaul ( #6519 )
2022-08-03 12:08:19 -07:00
Parth Panchal
dd8b7fb5b0
Maven publish config changes in pom.xml ( #6502 )
...
* Config for maven publish
* Config for maven publish
* Config for maven publish
* Config for maven publish
* Config for maven publish
* Config for maven publish
* Config for maven publish
2022-08-03 10:49:44 +05:30
Nahuel
a878aa911c
Fix#6212: Retrieve connection params from secret manager in CLI commands ( #6441 )
...
* Retrieve connection params from secret manager for database connectors
* Retrieve connection params from secret manager for all services except database connectors
* Stop retrieving connection from SM in Airflow rest plugin
* Retrieve connection params from secret manager for dashboard services
* Retrieve connection params when initializing Workflow/ProfilerWorkflow objects
* Align services topologies + comment changes in topology runner
* Address SonarCloud bug detected
* Update database service topology
* Address PR comments
* Address PR comments
* Address PR comments
2022-08-02 09:13:46 +02:00
mohitdeuex
1d3e876121
[Backend][Java SDK] Version Validation Fix ( #6472 )
2022-08-01 06:58:47 -07:00
Suresh Srinivas
109b937fd4
Use JSON schema constraints to validate policies and other misc cleanup ( #6451 )
2022-07-30 15:23:18 -07:00
Vivek Ratnavel Subramanian
afab066f3e
Fix build error ( #6450 )
...
* Fix build error
* Fixed the path to apis.md
* Fix policyUtils
2022-07-30 13:21:52 -07:00
Vivek Ratnavel Subramanian
dac17af9ca
Update rule.json
2022-07-30 09:45:26 -07:00
Suresh Srinivas
3352ff5eb2
Remove priority from policy rules ( #6438 )
2022-07-29 11:04:49 -07:00
Nahuel
839d25217e
Fix: detected high severity vulnerabilities by Snyk ( #6430 )
...
* Fix detected high severity vulnrabilities by snyk
* Revert changes on ingestion/src/metadata/ingestion/source/database/mysql.py
2022-07-29 12:14:23 +02:00
Sriharsha Chintalapani
5f8e2a7f4f
Generic Test Case definition to capture different testcases ( #5647 )
2022-07-28 13:58:41 -07:00
Mayur Singal
c6efe8c142
Fix #6158 : Fivetran Connector Added ( #6329 )
...
* Fivetran Connector Added
* Fivetran unit test added
* Fixed Unit Tests
* Added Fivetran Docs & Added Fivetran in Pipeline Listing
2022-07-27 20:50:56 +05:30
Parth Panchal
f28f4afcc6
Fixed#6349: Backend : Getting Invalid field name extension for Topic, Pipeline, Dashboard and Ml Model. ( #6380 )
...
* Fixed#6349: Backend : Getting Invalid field name extension for Topic, Pipeline, Dashboard and Ml Model.
* Fixed#6349: Backend : Getting Invalid field name extension for Topic, Pipeline, Dashboard and Ml Model.
2022-07-27 17:33:58 +05:30
Nahuel
52b416ba65
Fix#5918: Save Airflow config credentials in secrets manager when bootstrapping ( #6270 )
...
* Implementation for saving auth provider airflow parameters in the Secret Manager
* Add Airflow configuration validator
* Add tests for validators
* Add missing tests
2022-07-25 07:08:14 +02:00
Nahuel
4d4a2fc2cf
FIX#5916: Only admin user retrieves connection params when external Secrets Manager is configured ( #6228 )
...
* Implementation for stop sending connection credentials when user is BOT
* Change way we add the connection to the service in the Secret Manager
* Services connection is not required as we want to stop returning it when SM is configured
2022-07-22 14:02:29 -07:00
restnek
41d0c182cb
ISSUE-3790: Remove unnecessary public modifiers in tests ( #6222 )
...
Co-authored-by: Sergey Akentyev <Sergey.Akentyev@nedra.digital>
2022-07-22 16:00:46 +05:30
Nahuel
0602e8c894
Fix#5924: Implement secret manager for Airflow REST Plugin ( #6128 )
...
Fix#5924: Implement secret manager for Airflow REST Plugin (#6128 )
2022-07-19 14:51:44 +02:00
Nahuel
65260263fc
Fix #5915 : Implementation of AWS Secret Manager ( #5925 )
...
* Implement Secrets Manager abstraction + refactor service repositories
* Rename secrets manager factory method for consistency
* Fix typo in openmetadata conf yaml file
* Bump version
* Fix SonarCloud code smells
* Add secrets manager provider as an Enum + send it in the server configuration in the ingestion pipeline
* Apply suggestions from code review
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
* Change secret manager implementations to be singleton
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-07-13 20:49:27 +02:00
Milan Bariya
c2b15a4377
FIX 5712: make generate gives different results depending on OS ( #6035 )
...
FIX 5712: make generate gives different results depending on OS (#6035 )
2022-07-13 11:53:27 +02:00
Vj-L
011651f078
"Updated the tags with latest tag" ( #5962 )
...
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-08 16:43:39 +05:30
Parth Panchal
686e715341
added config to publish to maven repository in catalog pom.xml ( #5870 )
...
* added config to publish to maven repository in catalog pom.xml
* addressing java checkstyle
* empty-commit
* signing commit
* signing commit test
* signing commit test with different key
* moving plugins
2022-07-06 13:06:49 +05:30
Parth Panchal
418a5a4724
added event error and fernet classes to openmetadata-core ( #5799 )
2022-07-05 10:34:17 +05:30
Parth Panchal
b15d8853d6
reverting files added in core ( #5775 )
2022-06-30 13:26:25 +05:30
Parth Panchal
584c440c43
added ferent and evenet error classes to openmetadata-core ( #5735 )
2022-06-30 08:42:20 +05:30
mohitdeuex
7f25b82408
[Backend][TaskNotification] Update the Group Id for to org.open-metadata ( #5663 )
2022-06-28 11:10:07 +05:30
mohitdeuex
bbf1fb8320
[Backend][Openmetadata-core] update schema and files as per catalog-rest-service ( #5659 )
2022-06-27 08:00:34 -07:00
Vivek Ratnavel Subramanian
d65c97c4e8
Fix #5382 Backend: Update timestamp of thread for any reaction ( #5443 )
2022-06-13 23:12:20 -07:00
Suresh Srinivas
b44da7733e
Upgrade dependencies for release 0.11 ( #5326 )
2022-06-06 18:34:44 -07:00
mohitdeuex
a299cfbc86
[Backend] Java Client SDK [WIP] ( #5149 )
...
* [Backend] Java Client SDK #4961 [WIP]
* [Backend] Java Client SDK #4961 ..Fix the OpenMetadata[lowercase d] added version plugin
* [Backend] Java Client SDK #4961 ..Add Version utils to core and Using Custom Interceptor to modify request body as per OMD supported JSON Schema
* [Backend] Using exclude nulls to modify request
* [Backend] Google SSO changes tested and fixed for Service Credentials
* [Backend] Okta SSO added
2022-06-06 11:22:43 +05:30
Milan Bariya
ec1aca926a
Fix #5210 : Review database field for connectors ( #5225 )
...
* Fix #5210 : Review database field for connectors
2022-06-06 10:48:23 +05:30
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector ( #5107 )
...
Refactored PowerBi Connector (#5107 )
2022-06-01 10:36:12 +02:00
Abhishek Pandey
ba88aa1668
Issue 4660: Bigquery ADC FIx ( #5241 )
...
* fixed-bigquery-adc
2022-06-01 13:52:55 +05:30
Abhishek Pandey
591a65d161
updated-json-schema-types ( #5047 )
...
* updated-json-schema-types
* code-formatted
* gsc-credential-format-updated
2022-05-25 11:53:55 +02:00
Pere Miquel Brull
8e121fb306
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector ( #5125 )
...
Fix #4096 - PipelineService JSON refactor & Airflow metadata source connector (#5125 )
2022-05-25 08:35:16 +02:00
Suresh Srinivas
9d25596227
Fixes #5122 Add backend and API support for column-level lineage ( #5123 )
...
* Fixes #5122 Add backend and API support for column-level lineage
* amend
* Fix test failures
2022-05-24 16:00:12 -07:00
mohitdeuex
9a3fa2e532
[ #5025 ] - [BACKEND] Moving common files to OpenMetadata-core #5025 [W… ( #5032 )
2022-05-18 22:37:49 -07:00
