yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2026-01-07 04:56:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,651 Commits 1,030 Branches 195 Tags
Commit Graph

58 Commits

Author SHA1 Message Date
Nahuel
65517beb62
Fix#5919: Implementation of migration process when a Secrets Manager is configured (#6584) 
* Implementation of migration process when a Secrets Manager is configured

* Update conf/openmetadata.yaml

* Address PR comments

* Minor change in SQL statment in CollectionDAO

* Address Sonar security hotspot issue
 2022-08-09 16:11:57 +02:00
Nahuel
cf2cb6d531
Fix#6517: Add clusterName property to the application config yaml (#6610) 
* Add cluster name in the app configuration and start using it to create secrets id

* Update secret manager client in openmetadata for using default auth provider

* Add missing property in test config file
 2022-08-09 09:00:43 +02:00
Vivek Ratnavel Subramanian
4f61169df6
feat(ui): Add support for slack chat (#6015) 
* feat(ui): Add support for slack chat

* updated icons and styling

* Add to all the pages

* Fix UT failure
 2022-07-14 19:31:27 +05:30
Nahuel
65260263fc
Fix #5915: Implementation of AWS Secret Manager (#5925) 
* Implement Secrets Manager abstraction + refactor service repositories

* Rename secrets manager factory method for consistency

* Fix typo in openmetadata conf yaml file

* Bump version

* Fix SonarCloud code smells

* Add secrets manager provider as an Enum + send it in the server configuration in the ingestion pipeline

* Apply suggestions from code review

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

* Change secret manager implementations to be singleton

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
 2022-07-13 20:49:27 +02:00
Pere Miquel Brull
048801067a
Add fernet back (#6063) 2022-07-13 14:03:46 +02:00
Akash Jain
fa5105191b
Fix/issue-5883 (#5958) 2022-07-12 19:55:38 +05:30
Sriharsha Chintalapani
8528c51b9c
Fix #5516: Refactor elasticsearch indexes to be same as entity specifications (#5573) 
* Fix #5516: Refactor elasticsearch indexes to be same as entity specifications

Co-authored-by: darth-coder00 <aashit@getcollate.io>
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
 2022-06-27 01:19:27 -07:00
Sriharsha Chintalapani
e8c5ddc342
Fix #5235: AIRFLOW_AUTH_PROVIDER value to be custom-oidc instead of customOidc (#5537) 2022-06-24 20:43:20 -07:00
Sriharsha Chintalapani
ad0c6dad88
Fix #5613: Add fernet encryption and remove connection details for non admin users (#5614) 
* Fix #5613: Add fernet encryption and remove connection details for non-admin users
 2022-06-24 16:44:37 -07:00
mohitdeuex
be18feb928
[Backend] Websocket implementation added (#5440) 
* [Backend] Websocket implementation added

* [Backend] Websocket implementation added [google formatter fix]

* [backend] Updated Reiew Comments

* [backend] Updated CheckStyle
 2022-06-15 10:14:47 +05:30
Vivek Ratnavel Subramanian
d65c97c4e8
Fix #5382 Backend: Update timestamp of thread for any reaction (#5443) 2022-06-13 23:12:20 -07:00
Sriharsha Chintalapani
bd98919d64
Fix openmetadata conf (#5403) 
* Fix openmetadata conf
 2022-06-09 22:08:01 -07:00
Sriharsha Chintalapani
1923591a94
Fix #5275: OpenMetadata database driver should be configurable via Env (#5402) 2022-06-09 21:02:32 -07:00
Sriharsha Chintalapani
c2e83923e2
Fix #5272: Add a env variable to configure log level for OpenMetadata Server (#5273) 2022-06-02 11:15:16 -07:00
Vivek Ratnavel Subramanian
059acfc529
Backend: Enforce principal domain in the JWT filter (#5155) 2022-06-01 10:07:12 -07:00
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386) 
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
 2022-05-27 15:39:13 +05:30
Vivek Ratnavel Subramanian
ae51a49ce1
Fix #4746. UI: Connection Arguments and Connection Options should support inner dicts (#4779) 2022-05-07 14:51:40 -07:00
Sriharsha Chintalapani
4531190af6
Fix #4637: Support JWT Token generation for bot accounts (#4647) 
* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts
 2022-05-05 15:32:33 +05:30
Akash Jain
0f63a4063e
Enable custom oidc provider name env override. (#4642) 2022-05-02 22:38:11 -07:00
Sriharsha Chintalapani
dd27da2121
Fix #4597: Log audit events into a separate log file (#4598) 
* Fix #4597: Log audit events into a separate log file

* Fix #4597: Log audit events into a separate log file
 2022-04-29 11:06:46 -07:00
mosiac1
c6e8181fa9
Add postgres support (#3952) 
* Add postgres support

* Add testing for postgresql databases

Split surefire tests into: unit-tests, postgres-integration-tests, mysql-integration-tests
Integration tests get db information from system properties
All tests ending in ResourceTests.java are integration tests, all other are unit tests
Move to using testscointainers, remove embeded mysql

* Fix some tests

* Fix webhook and table tests

* Fix random name generation in tests, remove parallelism

* Fix style

* Add headers, fix config files

* Apply formatting

* Fix tag ussage query for postgres

* Replace references to mysql with generic database

* Fix postgres migration file

* Fix postgres migration script
 2022-04-27 10:58:44 -07:00
Akash Jain
0beeef3f97
pluralize list input environment varialbles (#4473) 2022-04-25 17:11:02 +05:30
Akash Jain
54162b7c6d
fix: List Configuration from Environment Variable for Authorizer and Authentication Configuration (#4305) 
* ability to provide list from env in yaml config

* remove security config file as we do not maintain
 2022-04-21 11:29:26 +05:30
Akash Jain
018cd0aec6
fix: Google SSO Audience default value (#4285) 
* Update openmetadata.yaml

* updated audience default value
 2022-04-20 15:48:13 +02:00
Akash Jain
7958e81918
server host api url env for airflow configuration (#4261) 2022-04-19 23:24:48 -07:00
Akash Jain
ff26b6d93e
fix: OpenMetadata Airflow config with SSO (#4197) 2022-04-19 10:39:50 -07:00
Sriharsha Chintalapani
be836e5404
Fix #4071: PUT IngestionPipeline missing property & error message (#4085) 
Fix #4071: PUT IngestionPipeline missing property & error message (#4085)
 2022-04-13 08:40:21 +02:00
Sriharsha Chintalapani
06cc35d048
Fix #4082: Do not start slack event publisher if there is no config (#4083) 2022-04-12 17:25:23 -07:00
Akash Jain
80d1b05864
fix for changes in #3738 (#3782) 2022-03-31 18:42:14 +05:30
Vivek Ratnavel Subramanian
0c12a55ebf
Add ENV variable support for sandbox mode enabled config (#3687) 2022-03-25 17:23:07 -07:00
Vivek Ratnavel Subramanian
f0927ecebb
Fix #3236: Add support for secure docker compose with an env file (#3241) 
* Fix #3236: Add support for secure docker compose with an env file
 2022-03-08 07:05:31 -08:00
Sriharsha Chintalapani
97245a5b9f
Fix #2807: Merge openmetadata.yaml and openmetadata-server.yaml (#2808) 
Co-authored-by: darth-coder00 <aashit@getcollate.io>
 2022-02-28 19:04:39 +05:30
Alberto Miorin
0e73de4658
See #2486. Implement encryption at rest (#2488) 
* See #2486. Add fernet Java library to encrypt DatabaseService.DatabaseConnection.password

* Add support for rotation.

* Add support for CLI to rotate the key.

* The fernet key can be null. No encryption will be done.

* Add FernetConfiguration

* Add env variable for Fernet.

* Convert base64 to base64url

* Decrypt (admin or bot) or nullify tokens for all methods including ListVersions and GetVersion

* Fix test with owner USER to handle null in DatabaseConnection
 2022-02-08 09:50:39 +01:00
Sachin Chaurasiya
4b56d2fb0e
Fix: #2551 migrationConfiguration is missing from conf/openmetadata-security.yaml. (#2552) 2022-02-02 12:20:42 +05:30
Pere Miquel Brull
b82854c56e
Fix #2479 - Check migration at server start (#2489) 
* Validate migrations on start

* Output to logs

* Validate Flyway Migrations at Catalog start

* Add flyway validation test config

* Sonarcloud try stream

* Revert migration validation
 2022-02-01 08:31:34 +01:00
Sriharsha Chintalapani
b47f49e418
Fix #2403: Add support for deleted entities to be published into Slack Events (#2404) 
* Fix #2403: Add support for deleted entities to be published into Slack Events

* Fix #2403: Add support for deleted entities to be published into Slack Events
 2022-01-25 14:39:12 +05:30
Akash Jain
23d3b8648d
Added env for airflow and elasticsearch (#2381) 2022-01-24 21:44:57 +05:30
Sriharsha Chintalapani
10e71a7e09
Fix #2340: Ingestion pipeline deployment refactor (#2341) 
* Fix #2340: Ingestion pipeline deployment refactor
 2022-01-21 22:06:14 -08:00
Sriharsha Chintalapani
c4d7c76198
Event publishers to ElasticSearch and Slack (#2118) 
* ElasticSearch & Slack Event publishers

* Fix #2165: Support for deleted entities in ElasticSearch
 2022-01-12 16:35:27 -08:00
Sriharsha Chintalapani
80cc907224
Fix #2168: Fix bootstrap_storage to parse env variables in the server config (#2169) 
* Fix #2168: Fix bootstrap_storage to parse env variables in the server config
 2022-01-11 16:47:11 -08:00
Sriharsha Chintalapani
7b24e31973
Fix #2143: Allow environment variables to be substituted in OpenMetadata config (#2146) 
* Fix #2143: Allow environment variables to be substituted in OpenMetadata config
 2022-01-11 10:13:49 -08:00
Matt
4a4124d45d
Rename CatalogAuthorizer to Authorizer (#1966) 2021-12-29 11:37:47 -08:00
SeungwanJo
83a23d5568
edit: mysql jdbc connection option (#1874) 2021-12-21 08:41:06 -08:00
Sriharsha Chintalapani
2d348e9704
Add SSL options to ElasticSearch client - Ingestion & Server (#1548) (#1557) 
* Add SSL options to ElasticSearch client - Ingestion & Server (#1548)

* Add SSL options to ElasticSearch client - Ingestion & Server

* Add SSL options to ElasticSearch client - Ingestion & Server

* Issue-1556: Support for ElasticSearch SSL , Bootstrap command create and delete, ingestion updates for change descriptions

* Issue-1556: Fix checkstyle issues

* Issue-1556: Fix checkstyle issues
 2021-12-04 18:54:36 -08:00
Sriharsha Chintalapani
63a93c8944
Fix #1356: Add new entities to ES index from OpenMetadata server (#1423) 
* Fix #1356: Add new entities to ES index from OpenMetadata server

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2021-12-04 08:45:17 -08:00
parthp2107
a9e70e6a89
License header update (#1498) 
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
 2021-12-01 12:46:28 +05:30
Sriharsha Chintalapani
edcbb04e3a
Fix #1417: openmetadata-security.yml missing airflowConfiguration (#1425) 2021-11-27 10:53:57 -08:00
sureshms
922db8d785 Core changes for eventing completed 2021-11-10 12:44:35 -08:00
Sriharsha Chintalapani
58460f3f2b
Fix #1034: workflow/bot operations API (#1053) 
* [WIP] workflow/bot operations API

* workflow/bot operations API

* workflow/bot operations API- Fix tests

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Add list runs api

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews
 2021-11-09 20:56:45 -08:00
vijaypm
b8863648d6
Issue 898 (#905) 
* ISSUE-898: additional information in the prerequisities for building and running code

* ISSUE-898: removed unreachable old doc

* ISSUE-898: added new docker compose to expose MySQL and ES ports to host machines

* ISSUE-898: changed jdbc connect url to allow Public Key Retrieval

* ISSUE-898: fixed log name to openmetadata.log

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
 2021-10-22 19:35:12 -07:00