33 Commits

Author SHA1 Message Date
Mohit Yadav
05ae862f15
Fix for issue leading to vulnerability flags + extras (#11044)
* Rest passwrod link update + Fix the socket connection error issue RFC

* prevent logging of stackTrace

* add default created ingestion pipelines

* provider added

* provider added
2023-04-14 11:31:36 +05:30
Mohit Yadav
a7760dc2be
Fix some Email Issue (#11025)
* Fix some Email Issue

* Restore default email setting

* Removed Unused config
2023-04-12 19:11:10 +05:30
Sriharsha Chintalapani
eb92ea9069
Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Cont… (#10809)
* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..

* Fix #10808: Add configuration to enable HSTS, X-Frame-Options, X-Content-Type-Options etc..
2023-04-05 16:50:12 +02:00
Mohit Yadav
07b821844a
Restructured Reindexing + Added Automated Reindexing on Glossary import (#10882)
* Restructured Reindexing + Added Automated Reindexing on Glossary import

* Revert Openmetadata yaml

* Fix pending issues

* Fix stats

* Refactor to workflows and SearchIndex

* Fix Failing tests

* Get status for stream and push status with

* fix UI build failing

* replace all with entity list before hit api

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-04-05 18:47:51 +05:30
Mohit Yadav
a095d23fb5
Handle Email From UI (#10906)
* Handle Email From UI

* Resolved Conflicts

* Fix Failing Tests

* Fix Failing Tests

* Fix Failing checkstyle failing

* Return Masked Password + handle null in case of Saml Missing Config
2023-04-05 10:31:51 +05:30
07Himank
29f49ee783
Ingestion pipeline by service type task (#10914)
* working on ingestion getList Issue

* filter ingestion pipeline by pipelineType

* revoked docker conf

* removed old changes and formatted

* .

* addressing comments

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-04-04 17:03:57 +05:30
07Himank
4eb1ec81e1
Update query task for activity feed (#10895)
* solved change event query update for activity feed

* working on url config

* testing

* fix bug in slack alerts

* fixing alerts url

* fixed space issue url issue and edited the testcases for changeeventparser

* fixed email markers bug

* default value added

* removed my gmail config

* fix

* addressing comments

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-04-04 17:02:08 +05:30
Nahuel
6fa6b95f74
Fix: Remove bot configuration with SSO service account (#10847)
* Add deprecation warning for SSO config for bots

* Fix logging
2023-03-30 17:37:45 +00:00
Parth Panchal
8f424e1787
Fixed#10565: Make Prometheus Mappings Configurable (#10671)
* Fixed#10565: Make Prometheus Mappings Configurable

* Fixed#10565: Make Prometheus Mappings Configurable

* Fixed#10565: Make Prometheus Mappings Configurable

* Addressing comments and fixed nullpointer in tests

* Fixed#10565: Make Prometheus Mappings Configurable

* Addressing comments

* Fixing tests
2023-03-28 12:51:52 +05:30
Mohit Yadav
11032a2d48
SAML feature (#10669)
* Added Saml Feature

* add localization

* fix tests

* added collate copyright

* remove thread.getType

* fixed keystore issues and updated review comments

* remove private key getter

* update test saml config

* update test saml config

* Update openmetadata-service/src/main/java/org/openmetadata/service/security/saml/OMMicrometerHttpFilter.java

Co-authored-by: Nahuel <nahuel@getcollate.io>

* review comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-24 21:56:49 +05:30
Nahuel
247016307d
Fix#8648: Mask sensitive info from API responses (#10307)
* Mask sensitive info from API responses

* Rename converter classes

* Add missing Java classes from JSON schemas and class converters

* Update test service connection schema

* Update datalakeConnection JSON schema and fix some tests

* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh

* Fix Pipeline and Database service tests

* Minor refactor

* Fix CsvUtilTest

* Fix EventMonitorFactoryTest

* Fix CloudWatchEventMonitorTest

* Update datalake metadata

* Update bigquery metadata

* Fix test connection functionality

* Fix OMeta service api test

* Update gcsValues title and revert changes in GH actions

* Mask sensitive enabled by default for local docker

* Add missing tests

* Address PR comments

* Address PR comments

* fix ui breaks on gcsValues.json

* Address PR comments

* Minor refactor

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-03 18:10:01 +00:00
Mohit Yadav
7b6771f1cf
Revert "Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)" (#10083)
This reverts commit e164bbb760886ca30327a5c0fe7983341775f7d1.
2023-02-02 20:19:32 +05:30
Mohit Yadav
e164bbb760
Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)
* Prevent Authentication bypass using Jwt Token Config in case of OM supporting token generation

* fix failing tests
2023-02-02 20:18:28 +05:30
Suresh Srinivas
ac157a8f0b
Fixes #9618 Allow apostrophe in entity names (#9642)
* Fixes #9618 Allow apostrophe in entity names

* Add support for space in entity names (with exception) and column names

* Add regex checks to entity names, table column names to allow only required characters

* fix: allowed characters in entityName

* Add all the allowed special characters in the entity name in tests

* Allow '&', '/', ':' only for the table

* Override basic entityName by defining entity specific entityName for Python code gen

* fix: dagster migration + json schema path

* fix: python style check

* Fix test failure

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-01-17 11:34:29 -08:00
Mohit Yadav
1deeb70bfc
Fix UI issue due to dropwizard Upgrade (#9590)
* Fix UI issue due to dropwizard Upgrade

* Added Header
2023-01-03 17:43:22 +00:00
Suresh Srinivas
1430e7e9c0
Code cleanup changes (#9361) 2022-12-16 16:14:40 -08:00
Teddy
80043e329e
Add micrometer page view metrics (#9062) 2022-11-29 19:37:29 +01:00
Pere Miquel Brull
dda8f8054e
Fix #8571 - Log IngestionPipeline status change to CloudWatch (#9013)
* Prep monitoring skeleton

* Fix naming

* Push Ingestion Pipeline status to cloudwatch

* Review comments and tests

* import

* Remove singleton object

* Format
2022-11-28 17:45:18 +01:00
Sriharsha Chintalapani
8a95ec1329
Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer (#8959)
* Fix #8958: Add initialization ordering and remove user/bot initialization from Authorizer

* Refactor EmailUtil initialization

* Fix config values

* Fix smtpsettings check

* Fix uninitialize EmailUtil

* remove unused USER_REPOSITORY

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2022-11-23 08:54:20 +00:00
Nahuel
e5abdc8c5c
Fix#8577: Services sensitive passwords fields are stored in secrets store (#8671)
* Services sensitive passwords fields are stored in secrets store

* Update services on application startup in case of changes in the JSON Schema

* Minor changes after manual test
2022-11-14 13:48:50 +01:00
Suresh Srinivas
6306c9ac8d
Fixes #8688 Enforce mutuallyExclusive tag labels (#8689) 2022-11-12 18:44:17 -08:00
Nahuel
91d0460b27
Fix#8577: Refactor part of the secrets manager implementation (#8617)
* Removed part of the secrets manager implementation in the server side

* Removed part of the secrets manager implementation in the openmetadata python library side

* Remove deprecated test

* Address pylint checks

* Address new pylint checks

* Address PR comments

* Fix import on airflows apis

* Clear singleton instances for running Ometa secrets manager test
2022-11-11 09:59:15 +01:00
Suresh Srinivas
292672a970
Clean up code warnings (#8532) 2022-11-04 11:24:46 -07:00
Mohit Yadav
6efe6df96b
[LDAP] Added Ldap-Authentication (#8256)
* [LDAP] Add Ldap-Authentication

* Refactor Basic to Service Layer

* added read login config

* pom updates

* review comments

* review comments

* move authenticator after authorizer

* merge conflicts resolve

* add init method , for initializing authenticator

* sonar fix
2022-10-27 22:56:20 +05:30
Shivam Shrey
0babaa52e0
ISSUE-7848: Fix variable names as per naming convention (#8228)
* ISSUE-7848: Rename local variables to match regular expression for camel case

* ISSUE-7848: Refactor package name as per naming convention
2022-10-26 05:54:40 -07:00
Suresh Srinivas
0d75eb9ff2
Fixes #8313 Deprecate botPrincipals from open metadata configuration (#8314) 2022-10-21 20:49:41 -07:00
Mohit Yadav
cba9240fe9
[Email] Added explicit senderMail in configuration (#8126)
* [Email] Added explicit senderMail in configuration

* Fix failing tests

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-13 18:24:32 +05:30
Suresh Srinivas
f4acc4af1f
Fixes #8068 Remove ConstructorType annotation from Collection (#8069) 2022-10-10 23:32:48 -07:00
Mohit Yadav
f2131d58a8
[Improve] Proactively instantiate resources instead of relying on Exc… (#7983)
* [Improve] Proactively instantiate resources instead of relying on Exception Handling + removed ConfigurationHolder.java

* Review Comments updated
2022-10-07 20:50:15 +05:30
mohitdeuex
b934ed4870
Stream and Batch Global ES Error Logging added (#7780)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests

* Global ES monitoring with Stream + batch mode to allow Reindexing
2022-09-28 22:55:00 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI (#7637)
* Update JSON schemas

* Update create and update endpoint and remove /generateToken endpoint

* Add AuthMechanism and Token Expiry Field on the Add bot page

* Remove unwanted tests

* Add logic to show authMechanism based on auth provider

* Add authConfig to bots details page

* Backend implementation with secret manager

* Fix invalid date issue

* Add support for update bot token details

* Add logic for SSO auth

* Add fields for google sso auth client

* Add Edit Option.

* Updated ingestion CLI and secret manager issues

* Updated tests with errors

* Removed unused method

* Removed test files

* Fix broken JSON schema

* Fix typescript error

* Pass the bot permissions from the bot details page

* Minor errors related to the secret manager

* Restore Airflow configuration for retrocompability

* Add support for all SsoServiceType client config

* Fix Unit test

* Update tests

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-09-26 18:26:24 +05:30
mohitdeuex
4b594d0d6e
[BasicAuth] Added Basic Authentication (#7390)
* Fixed issue with testCases not posted in slack

* Return empty string in case of faling to build url

* [BasicAuth] Added Basic Authentication APIs

* [BasicAuth] Checkstyle

* [BasicAuth] Test yaml updated

* [BasicAuth] Update review comments

* [BasicAuth] Refresh logic added

* [BasicAuth] Add sql updates

* [BasicAuth] Maintain dependency version in main pom.xml

* [BasicAuth] Updated as per new module

* [BasicAuth] Fixes for refresh and missing edge scenario handled

* [BasicAuth] remove quotes

* [BasicAuth] Fix merge conflicts
2022-09-19 11:38:45 +05:30
Sriharsha Chintalapani
b2bdc54ac7
Fix #7516: Move data folder into openmetadta-service (#7517) 2022-09-17 11:35:45 -07:00