2200 Commits

Author SHA1 Message Date
Mayur Singal
ca51fa0245
Fix #7801: Fixed Glue Pipeline (#7832)
Co-authored-by: Apple <apple@Apples-MacBook-Pro.local>
2022-10-02 16:43:35 -07:00
Lord Helm
7d1b21113a
rename record to match type (#7864)
Co-authored-by: Patrick Helm <helm@synyx.de>
2022-10-02 15:41:25 -07:00
Mohit Yadav
69012d4991
Added Test Case (#7838) 2022-10-02 13:37:46 -07:00
Amit Banerjee
fdf216aadd
Remove unnecessary throws IOException (#7846) 2022-10-01 19:26:17 -07:00
Shivam Purohit
4e0a56786a
Fix final fields static (#7852) 2022-10-01 12:56:12 -07:00
Ozan Uslan
84a1b11b11
Add private constructor to utility classes to hide the implicit public one (#7850) 2022-10-01 12:13:54 -07:00
André Oliveira
736637a598
Merging if statements (#7851) 2022-10-01 11:51:39 -07:00
Sriharsha Chintalapani
03f1d4f2fb
Revert "Update TablesInitializer.java (#7735)" (#7853)
This reverts commit a3ef95644f8e854d911312dfb2cafaef6456f168.
2022-10-01 11:34:12 -07:00
emilyolsen246
a3ef95644f
Update TablesInitializer.java (#7735)
updated error messages to be logger messages
2022-10-01 10:13:54 -07:00
Mohit Yadav
5b3b9ec811
update Batch job status + missing place stream status update (#7842)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests

* Global ES monitoring with Stream + batch mode to allow Reindexing

* Updated Status Message + Status update on ESIndexDefinition Create and Delete

Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
2022-10-01 17:58:19 +05:30
Nahuel
593ca3a4a0
Fix bot creation and edition logic (#7796)
* Fix bot creation and edition logic

* Fix minor error creating user

* Fix failing test

* Minor fixes

* Add missing tests for new flows

* Fix put_failIfBotHasARelationshipToAnotherUser test

* Changes after manual testing

* Move where auth_provider is retrieved in the secret manager
2022-10-01 11:25:56 +02:00
Vivek Ratnavel Subramanian
16e8778993
Fix #7812 Backend : Leave Team is throwing an error (#7835) 2022-09-30 23:01:05 -07:00
Mohit Yadav
d04ce5341d
[Basic auth fixes] Added check to prevent brute-force attack (#7803)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

* Fix issue with CP

* Fix issue with CP

* [Basic Auth] Added Brute forcing check , blocks user login for 10 mins + send update on mail

* Review Comments updated

Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-10-01 02:03:43 +05:30
Suresh Srinivas
b2c2369d9a
Addressing a few sonar cloud flagged issues (#7800) 2022-09-29 10:57:57 -07:00
mohitdeuex
b934ed4870
Stream and Batch Global ES Error Logging added (#7780)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests

* Global ES monitoring with Stream + batch mode to allow Reindexing
2022-09-28 22:55:00 +05:30
mohitdeuex
07b995dbb2
Basic auth fixes (#7777)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

* Fix issue with CP

* Fix issue with CP

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-09-28 19:29:47 +05:30
mohitdeuex
859317494b
Basic auth fixes (#7747)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-09-28 16:57:30 +05:30
Vivek Ratnavel Subramanian
b075ed018d
Fix #7669 Backend: Patch API for teams with soft deleted child teams throws an error. Part 2 (#7764) 2022-09-27 15:38:46 -07:00
mohitdeuex
8d33da7f3d
[ES Reindex] Added ES Reindexing from API (#7717)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests
2022-09-27 21:34:07 +05:30
Vivek Ratnavel Subramanian
92aea1c179
Fix #7669 Backend: Patch API for teams with soft deleted child teams throws an error. (#7742) 2022-09-27 16:44:03 +05:30
mohitdeuex
8501322a5a
Fix Version issue b/w api/v1/version and entity {id}/versions (#7746) 2022-09-27 15:11:13 +05:30
Onkar Ravgan
8afbbb8642
Ingest DBT tags (#7726)
* added tags

* Added dbt tags ingestion

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-27 11:12:53 +05:30
Vivek Ratnavel Subramanian
e2daf73fbd
UI: TeamsSelectable component should use REST API to build teams hierarchy (#7711) 2022-09-26 16:33:48 -07:00
Nahuel
df909703eb
Fix#6615: Fix failing test still in CI (#7725)
* Fix failing test still some tests are failing

* Fix bug in service entity repository

* Fix all tests except Ingestion Pipeline integration tests

* Fix Ingestion Pipeline integration tests

* Fix failing Python tests
2022-09-26 20:39:42 +02:00
Shailesh Parmar
b81686b426
Fixed issue: Quality tests can not be created if the column names have spaces or special characters #7623 (#7698)
* Fixed issue: Quality tests can not be created if the column names have spaces or special characters #7623

* Added logic to not decode fqn param from path

* Removed commented out code

* Allowed only "_" in spacial character in test case name

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-09-26 18:52:25 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI (#7637)
* Update JSON schemas

* Update create and update endpoint and remove /generateToken endpoint

* Add AuthMechanism and Token Expiry Field on the Add bot page

* Remove unwanted tests

* Add logic to show authMechanism based on auth provider

* Add authConfig to bots details page

* Backend implementation with secret manager

* Fix invalid date issue

* Add support for update bot token details

* Add logic for SSO auth

* Add fields for google sso auth client

* Add Edit Option.

* Updated ingestion CLI and secret manager issues

* Updated tests with errors

* Removed unused method

* Removed test files

* Fix broken JSON schema

* Fix typescript error

* Pass the bot permissions from the bot details page

* Minor errors related to the secret manager

* Restore Airflow configuration for retrocompability

* Add support for all SsoServiceType client config

* Fix Unit test

* Update tests

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-09-26 18:26:24 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions (#7653)
* Added control for DBT descriptions

* Fixed tests

* Added UI changes

* fixed maven ci tests

* Java formatting changes

* ui review fixes

* Fixed pytests

* Fixed python integration tests

* fixed airflow tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
Chirag Madlani
93ffbbbebf
feat(ui): login via email and password - Basic auth (#7558)
* feat(ui): login via email and password - Basic auth

* create admin users

* update basic auth

* create user on bootstrap

* update basic auth flow

* fix lint

* update basic auth ui forms

* update error messages

* fix cypress tests

* Added private key /public key in conf
Default invitation for invited users on bootstrapping user with invitation mail
Added self/signup flags , handled login scenarios around it
On migration persisting previous user auth mechanism also handled

* Missing fixes

* Move self signup to config

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-09-23 16:05:54 +05:30
Teddy
90abd73394
Fixes #7105 -- Add support for dataType filter for TestDefinition request (#7640)
* Updated json schema to support dataType filter

* Added migration for test definition support of data type filtering

* Added backend logic to support filter on data type for testdefinitions

* Added migration for:
- supported test types
- renaming of certain tests from starting uppercase to lowercase

* removed openmetadata_db from migration

* added datatype filter in column test

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-09-23 10:31:00 +02:00
Teddy
f2bf5194bb
Fixes #7623 -- Added logic to encode and decode entityLink (#7670)
* Encode entityLink string when processing request

* Added logic to decode column type from entityLink

* mvn code formating

* Extracted unquote step into its own function
2022-09-23 09:42:33 +02:00
Suresh Srinivas
ff8a41febc
Fixes #7642 Entity versioning for Custom Properties change (#7678) 2022-09-22 21:34:40 -07:00
Sriharsha Chintalapani
77b1cc5277
Fix #7675: Authorizer should allow users to update their own profile (#7676) 2022-09-22 21:18:29 -07:00
Suresh Srinivas
569e8b9085
Fixes #7322 #7145 - Add ViewBasic operation and add access control to get, list, getVersion, listVersions (#7644) 2022-09-21 21:06:35 -07:00
Sriharsha Chintalapani
6563940b6f
Fix #7172: List teams API throwing 404 for soft deleted team even with include=all (#7618) 2022-09-21 13:34:31 -07:00
Sriharsha Chintalapani
adaa8e7493
Fix #6917: startTs & endTs filters providing paginated data (#7617)
* Fix #6917: startTs & endTs filters providing paginated data

* Updated ui side changes

* Fixed OM tests end to end test

* Fix #6917: startTs & endTs filters providing paginated data

* Fix #6917: startTs & endTs filters providing paginated data

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-09-21 13:33:47 -07:00
Teddy
3d7d7c8b44
Fixes #7309 -- Implement testPlatform filter (#7599)
* Added testPlatform filter

* Removed greatExpectations as testType

* Fixed psql statement
2022-09-21 14:01:27 +02:00
Sriharsha Chintalapani
0dd177ac2c
Fix #7619: Teams hierarchy is not working as expected in Signup and Add User pages (#7621) 2022-09-20 22:53:03 -07:00
Suresh Srinivas
24710d40f3
Fixes #7606 Warn users about deletion of data during bootstrap storage migration (#7607) 2022-09-20 11:22:41 -07:00
Parth Panchal
2c0657fe68
Fixed#7251: POST API calls to /usage endpoint are inconsistent (#7587)
* Fixed#7251: POST API calls to /usage endpoint are inconsistent

* Fixed#7251: POST API calls to /usage endpoint are inconsistent
2022-09-20 17:38:03 +05:30
Nahuel
67ae82286f
Fix#7424: Create Bots on default authorizer init (#7559)
* Create Bots on default authorizer init

* Apply suggestions from code review

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-09-20 11:28:39 +02:00
Suresh Srinivas
1128d4847d
Fixes #7396 Custom properties description are not updated (#7571) 2022-09-19 22:47:49 -07:00
Parth Panchal
bfe5710dc7
Fixed#7537: Webhook description update is not working (#7548) 2022-09-20 10:14:26 +05:30
Sriharsha Chintalapani
9b35547fa5
Fix #7562: Fix search suggest for soft-deleted entities (#7563) 2022-09-19 17:22:23 -07:00
Sriharsha Chintalapani
33ecb3dd80
Fix #7445: Search API pagination is not working as expected (#7560) 2022-09-19 15:04:44 -07:00
mohitdeuex
4c6932e172
[Basicauth] update table name (#7538)
* Fixed issue with testCases not posted in slack

* Return empty string in case of faling to build url

* [BasicAuth] Added Basic Authentication APIs

* [BasicAuth] Checkstyle

* [BasicAuth] Test yaml updated

* [BasicAuth] Update review comments

* [BasicAuth] Refresh logic added

* [BasicAuth] Add sql updates

* [BasicAuth] Maintain dependency version in main pom.xml

* [BasicAuth] Updated as per new module

* [BasicAuth] Fixes for refresh and missing edge scenario handled

* [BasicAuth] remove quotes

* [BasicAuth] Fix merge conflicts

* [BasicAuth] Update table name
2022-09-19 12:03:12 +05:30
mohitdeuex
4b594d0d6e
[BasicAuth] Added Basic Authentication (#7390)
* Fixed issue with testCases not posted in slack

* Return empty string in case of faling to build url

* [BasicAuth] Added Basic Authentication APIs

* [BasicAuth] Checkstyle

* [BasicAuth] Test yaml updated

* [BasicAuth] Update review comments

* [BasicAuth] Refresh logic added

* [BasicAuth] Add sql updates

* [BasicAuth] Maintain dependency version in main pom.xml

* [BasicAuth] Updated as per new module

* [BasicAuth] Fixes for refresh and missing edge scenario handled

* [BasicAuth] remove quotes

* [BasicAuth] Fix merge conflicts
2022-09-19 11:38:45 +05:30
Suresh Srinivas
78bd0c40c6
Change camel case package name to lower case (#7534) 2022-09-18 20:09:08 -07:00
Sriharsha Chintalapani
b2bdc54ac7
Fix #7516: Move data folder into openmetadta-service (#7517) 2022-09-17 11:35:45 -07:00
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client (#7502)
Fix #7165 - Handle SSL certificates on ometa client (#7502)
2022-09-16 09:39:27 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00