79 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
3c9d39e9af
Fix #9158: OpenSearch/ElasticSearch - Language based mappings (#9163)
* Add language for Search mappings

* Fix #9158: OpenSearch/ElasticSearch - Language based mappings

* Add analyzer to search in Japanese

* Adding JP es analyzer for all the indexes

* Fix review comments

* rebase with main

Co-authored-by: Megumi AIKAWA <megumi.aikawa@gmail.com>
2023-01-09 21:42:01 -08:00
Nahuel
e998ecc407
Deprecate configurations for auth provider configuration on Airflow (#8896)
* Deprecate configurations for auth provider configuration on Airflow

* Fix code after merging

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2022-12-15 12:28:46 -08:00
Pere Miquel Brull
ba9109d318
Fix #9044 - Add prometheus event monitor (#9176)
* Add prometheus event monitor

* Format

* Format
2022-12-09 11:51:39 +01:00
Talal
e73777cbe7
Fixes #9167 - Default value for SLACK_CHAT_SLACK_URL (#9174)
* Fixes #9167 - Added a default value for SLACK_CHAT_SLACK_URL

* Fixes #9167 - Added a default value for SLACK_CHAT_SLACK_URL
2022-12-07 17:17:30 +05:30
Pere Miquel Brull
dda8f8054e
Fix #8571 - Log IngestionPipeline status change to CloudWatch (#9013)
* Prep monitoring skeleton

* Fix naming

* Push Ingestion Pipeline status to cloudwatch

* Review comments and tests

* import

* Remove singleton object

* Format
2022-11-28 17:45:18 +01:00
Suresh Srinivas
0d75eb9ff2
Fixes #8313 Deprecate botPrincipals from open metadata configuration (#8314) 2022-10-21 20:49:41 -07:00
Mohit Yadav
cba9240fe9
[Email] Added explicit senderMail in configuration (#8126)
* [Email] Added explicit senderMail in configuration

* Fix failing tests

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-13 18:24:32 +05:30
Sriharsha Chintalapani
801012d2a6
Add remote debug port (#8045)
* Add remote debug port

* Add remote debug port

* Add remote debug port

* Add remote debug port
2022-10-11 11:13:15 +05:30
Suresh Srinivas
de7a616788
Add log layout for tests and also printing ISO8601 timestamp (#8071) 2022-10-10 18:42:59 -07:00
Mohit Yadav
d04ce5341d
[Basic auth fixes] Added check to prevent brute-force attack (#7803)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

* Fix issue with CP

* Fix issue with CP

* [Basic Auth] Added Brute forcing check , blocks user login for 10 mins + send update on mail

* Review Comments updated

Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-10-01 02:03:43 +05:30
Sriharsha Chintalapani
a946c3fc5a
Fix #7782: Add console appender to OpenMetadata logs (#7783)
* Fix #7782: Add console appender to OpenMetadata logs

* Add format

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-09-28 18:15:57 -07:00
Chirag Madlani
93ffbbbebf
feat(ui): login via email and password - Basic auth (#7558)
* feat(ui): login via email and password - Basic auth

* create admin users

* update basic auth

* create user on bootstrap

* update basic auth flow

* fix lint

* update basic auth ui forms

* update error messages

* fix cypress tests

* Added private key /public key in conf
Default invitation for invited users on bootstrapping user with invitation mail
Added self/signup flags , handled login scenarios around it
On migration persisting previous user auth mechanism also handled

* Missing fixes

* Move self signup to config

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-09-23 16:05:54 +05:30
mohitdeuex
4b594d0d6e
[BasicAuth] Added Basic Authentication (#7390)
* Fixed issue with testCases not posted in slack

* Return empty string in case of faling to build url

* [BasicAuth] Added Basic Authentication APIs

* [BasicAuth] Checkstyle

* [BasicAuth] Test yaml updated

* [BasicAuth] Update review comments

* [BasicAuth] Refresh logic added

* [BasicAuth] Add sql updates

* [BasicAuth] Maintain dependency version in main pom.xml

* [BasicAuth] Updated as per new module

* [BasicAuth] Fixes for refresh and missing edge scenario handled

* [BasicAuth] remove quotes

* [BasicAuth] Fix merge conflicts
2022-09-19 11:38:45 +05:30
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client (#7502)
Fix #7165 - Handle SSL certificates on ometa client (#7502)
2022-09-16 09:39:27 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Nahuel
b829a2cbf3
Fix: Improvements on secret manager implementation (#7282)
* Change local secret manager by noop

* Update openmetadata-secure-test.yaml
2022-09-07 09:18:59 +02:00
Pere Miquel Brull
7d2527bbeb
Fix #6961 - Fallback to another IP service (#7019)
Fix #6961  - Fallback to another IP service (#7019)
2022-09-01 06:39:12 +02:00
Nahuel
0762e39172
Minor fixes related to Secrets Manager implementation (#7046)
* Minor fixes related to Secrets Manager implementation

* Fix failing test
2022-08-31 14:14:55 +02:00
Nahuel
db41be4c4a
Fix#6929: docker-compose services should wait until OpenMetadata DB is created (#7025)
* Added the docker compose for postgres

* Added changes as per the comments on PR

* Airflow Connectivity to Postgres

* Changes are done as per the comments

* Replocate changes to local dockerfile

* Fixed Airflow Dockerfile

* docker-compose services should wait until OpenMetadata DB is created

* remove unnecesary wait for db service

* Add dependencies to airflow image

* Add missing dependencies to airflow Dockerfile

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-08-30 23:55:46 +02:00
mohitdeuex
c8ab6fa59b
[Backend][Settings] Settings through UI (#6514) 2022-08-25 06:37:44 -07:00
Vivek Ratnavel Subramanian
f23357ba68
Update slack chat to redirect to a URL (#6909) 2022-08-25 15:25:11 +05:30
Nahuel
65517beb62
Fix#5919: Implementation of migration process when a Secrets Manager is configured (#6584)
* Implementation of migration process when a Secrets Manager is configured

* Update conf/openmetadata.yaml

* Address PR comments

* Minor change in SQL statment in CollectionDAO

* Address Sonar security hotspot issue
2022-08-09 16:11:57 +02:00
Nahuel
cf2cb6d531
Fix#6517: Add clusterName property to the application config yaml (#6610)
* Add cluster name in the app configuration and start using it to create secrets id

* Update secret manager client in openmetadata for using default auth provider

* Add missing property in test config file
2022-08-09 09:00:43 +02:00
Vivek Ratnavel Subramanian
4f61169df6
feat(ui): Add support for slack chat (#6015)
* feat(ui): Add support for slack chat

* updated icons and styling

* Add to all the pages

* Fix UT failure
2022-07-14 19:31:27 +05:30
Nahuel
65260263fc
Fix #5915: Implementation of AWS Secret Manager (#5925)
* Implement Secrets Manager abstraction + refactor service repositories

* Rename secrets manager factory method for consistency

* Fix typo in openmetadata conf yaml file

* Bump version

* Fix SonarCloud code smells

* Add secrets manager provider as an Enum + send it in the server configuration in the ingestion pipeline

* Apply suggestions from code review

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

* Change secret manager implementations to be singleton

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-07-13 20:49:27 +02:00
Pere Miquel Brull
048801067a
Add fernet back (#6063) 2022-07-13 14:03:46 +02:00
Akash Jain
fa5105191b
Fix/issue-5883 (#5958) 2022-07-12 19:55:38 +05:30
Sriharsha Chintalapani
8528c51b9c
Fix #5516: Refactor elasticsearch indexes to be same as entity specifications (#5573)
* Fix #5516: Refactor elasticsearch indexes to be same as entity specifications

Co-authored-by: darth-coder00 <aashit@getcollate.io>
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-06-27 01:19:27 -07:00
Sriharsha Chintalapani
e8c5ddc342
Fix #5235: AIRFLOW_AUTH_PROVIDER value to be custom-oidc instead of customOidc (#5537) 2022-06-24 20:43:20 -07:00
Sriharsha Chintalapani
ad0c6dad88
Fix #5613: Add fernet encryption and remove connection details for non admin users (#5614)
* Fix #5613: Add fernet encryption and remove connection details for non-admin users
2022-06-24 16:44:37 -07:00
mohitdeuex
be18feb928
[Backend] Websocket implementation added (#5440)
* [Backend] Websocket implementation added

* [Backend] Websocket implementation added [google formatter fix]

* [backend] Updated Reiew Comments

* [backend] Updated CheckStyle
2022-06-15 10:14:47 +05:30
Vivek Ratnavel Subramanian
d65c97c4e8
Fix #5382 Backend: Update timestamp of thread for any reaction (#5443) 2022-06-13 23:12:20 -07:00
Sriharsha Chintalapani
bd98919d64
Fix openmetadata conf (#5403)
* Fix openmetadata conf
2022-06-09 22:08:01 -07:00
Sriharsha Chintalapani
1923591a94
Fix #5275: OpenMetadata database driver should be configurable via Env (#5402) 2022-06-09 21:02:32 -07:00
Sriharsha Chintalapani
c2e83923e2
Fix #5272: Add a env variable to configure log level for OpenMetadata Server (#5273) 2022-06-02 11:15:16 -07:00
Vivek Ratnavel Subramanian
059acfc529
Backend: Enforce principal domain in the JWT filter (#5155) 2022-06-01 10:07:12 -07:00
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Vivek Ratnavel Subramanian
ae51a49ce1
Fix #4746. UI: Connection Arguments and Connection Options should support inner dicts (#4779) 2022-05-07 14:51:40 -07:00
Sriharsha Chintalapani
4531190af6
Fix #4637: Support JWT Token generation for bot accounts (#4647)
* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts

* Fix #4637: Support JWT Token generation for bot accounts
2022-05-05 15:32:33 +05:30
Akash Jain
0f63a4063e
Enable custom oidc provider name env override. (#4642) 2022-05-02 22:38:11 -07:00
Sriharsha Chintalapani
dd27da2121
Fix #4597: Log audit events into a separate log file (#4598)
* Fix #4597: Log audit events into a separate log file

* Fix #4597: Log audit events into a separate log file
2022-04-29 11:06:46 -07:00
mosiac1
c6e8181fa9
Add postgres support (#3952)
* Add postgres support

* Add testing for postgresql databases

Split surefire tests into: unit-tests, postgres-integration-tests, mysql-integration-tests
Integration tests get db information from system properties
All tests ending in ResourceTests.java are integration tests, all other are unit tests
Move to using testscointainers, remove embeded mysql

* Fix some tests

* Fix webhook and table tests

* Fix random name generation in tests, remove parallelism

* Fix style

* Add headers, fix config files

* Apply formatting

* Fix tag ussage query for postgres

* Replace references to mysql with generic database

* Fix postgres migration file

* Fix postgres migration script
2022-04-27 10:58:44 -07:00
Akash Jain
0beeef3f97
pluralize list input environment varialbles (#4473) 2022-04-25 17:11:02 +05:30
Akash Jain
54162b7c6d
fix: List Configuration from Environment Variable for Authorizer and Authentication Configuration (#4305)
* ability to provide list from env in yaml config

* remove security config file as we do not maintain
2022-04-21 11:29:26 +05:30
Akash Jain
018cd0aec6
fix: Google SSO Audience default value (#4285)
* Update openmetadata.yaml

* updated audience default value
2022-04-20 15:48:13 +02:00
Akash Jain
7958e81918
server host api url env for airflow configuration (#4261) 2022-04-19 23:24:48 -07:00
Akash Jain
ff26b6d93e
fix: OpenMetadata Airflow config with SSO (#4197) 2022-04-19 10:39:50 -07:00
Sriharsha Chintalapani
be836e5404
Fix #4071: PUT IngestionPipeline missing property & error message (#4085)
Fix #4071: PUT IngestionPipeline missing property & error message (#4085)
2022-04-13 08:40:21 +02:00
Sriharsha Chintalapani
06cc35d048
Fix #4082: Do not start slack event publisher if there is no config (#4083) 2022-04-12 17:25:23 -07:00
Akash Jain
80d1b05864
fix for changes in #3738 (#3782) 2022-03-31 18:42:14 +05:30