4912 Commits

Author SHA1 Message Date
Vj-L
6cfd16925a
Added default volumes (#7741)
* Added default volumes

* Ran make py_format for formatting

* Added sample data in mount directories

* Updated as per the comments

* Done changes for --ingest_sample_data flag

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-09-29 14:53:55 +05:30
Chirag Madlani
13e507b97f
UI - support elastic search reindexing from UI (#7739)
* feat(ui): support elasticsearch indexing from UI

* update apis

* update re-indexing table

* update ui

* fix ui update

* cleanup

* address review comments
2022-09-29 13:10:47 +05:30
Chirag Madlani
bab450ff70
update code owners for ingestion and backend (#7787) 2022-09-29 13:01:26 +05:30
Sachin Chaurasiya
d563c45b16
Fix 404 page is not rendering issue (#7786)
* Fix 404 page is not rendering issue

* Make changes in AppRouter
2022-09-29 12:43:14 +05:30
Sriharsha Chintalapani
a946c3fc5a
Fix #7782: Add console appender to OpenMetadata logs (#7783)
* Fix #7782: Add console appender to OpenMetadata logs

* Add format

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-09-28 18:15:57 -07:00
Shailesh Parmar
48142010d5
Cy: Fixed flakiness due to overly issue (#7781) 2022-09-28 14:19:03 -07:00
Sriharsha Chintalapani
612c083612
Fix Doc links (#7734)
* Fix Broken links

* Fix symlink

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-09-28 14:05:51 -07:00
Shilpa Vernekar
fe12e966ae
Edited the content in ReadMe. Added some features (#7778) 2022-09-28 23:30:23 +05:30
mohitdeuex
b934ed4870
Stream and Batch Global ES Error Logging added (#7780)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests

* Global ES monitoring with Stream + batch mode to allow Reindexing
2022-09-28 22:55:00 +05:30
Aniket Katkar
0b416564a3
UI: Fix failing cypress tests part-2 (#7773)
* Fixed failing user page cypress tests

* Fixed failing cypress tests for glossary

* fixing failing cypress

* Custom properties cypress fix

* fixed failing cypress for description

* miner wait added

* fixed bot cy test

* Fixed failing cypress tests for users page

* fixed mysql test failure

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-09-28 21:58:20 +05:30
Ashish Gupta
8a2c8b275a
Fix UI : Create user page along with some styling (#7776)
* Fix Create user page along with some styling

* Rectify input field error message
2022-09-28 21:56:24 +05:30
mohitdeuex
07b995dbb2
Basic auth fixes (#7777)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

* Fix issue with CP

* Fix issue with CP

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-09-28 19:29:47 +05:30
Aniket Katkar
ba1a7ca3b7
UI: Added recursive param for soft deleting teams. (#7766)
* Changes made to soft delete request for teams with recursive param

* changed soft delete message for team delete

* Worked on comments

* Worked on comments
2022-09-28 17:29:41 +05:30
Teddy
962866a30e
Fixes #7280 - Implements support for BYTEA DType (#7749)
* Added support for postgres bytea data type

* Added BYTEA support for profiler and converts bytes to hex on results read
2022-09-28 13:28:35 +02:00
mohitdeuex
859317494b
Basic auth fixes (#7747)
* [Basic Auth] Updated messages , and added changepasswor

* checkstyleFix

* Added ChangePassword feature in user page

* unpushed file

* changes as per comments

* unpushed file

* close the modal on save

* Added Admin Create User Password + Logout

* revert test

* revert yaml

* Fix failing test

* Remove token on logout

* fix for test

* added api for random pwd

* update error messages as per UI

* Added password generator in user creation

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-09-28 16:57:30 +05:30
Mayur Singal
24daae88e9
Add flag use fqn for filter patterns (#7755) 2022-09-28 16:41:22 +05:30
Milan Bariya
f6ef053196
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731)
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731)
2022-09-28 11:59:54 +02:00
Vivek Ratnavel Subramanian
0777bea3ba
Fix #7564 Add Cypress test for Team Hierarchy Dropdown (#7765)
* Fix #7564 Add Cypress test for Team Hierarchy Dropdown

* Address review comments
2022-09-28 12:33:21 +05:30
Shailesh Parmar
f715362b7a
Bug Fixed Include Column for profiler settings disapear #7759 (#7761)
* Bug Fixed Include Column for profiler settings disapear #7759

* fixed unit test
2022-09-28 11:43:50 +05:30
Chirag Madlani
6c2f6089c7
fix(ui): refresh token for basic auth (#7757) 2022-09-28 11:30:38 +05:30
Vivek Ratnavel Subramanian
b075ed018d
Fix #7669 Backend: Patch API for teams with soft deleted child teams throws an error. Part 2 (#7764) 2022-09-27 15:38:46 -07:00
Ayush Shah
8138628d26
Fix WorkflowConfig api (#7754) 2022-09-27 09:23:20 -07:00
mohitdeuex
8d33da7f3d
[ES Reindex] Added ES Reindexing from API (#7717)
* [ES Reindex] Added ES Reindexing from API

* [ES Reindex] checkstyle

* [ES Reindex] return complete record for status info

* fixes

* added limit param to get no of records

* Review Comments + Stream mode

* Review Comments

* Fix for failing tests
2022-09-27 21:34:07 +05:30
Teddy
7f81c28e58
Fix minor issues with dbt test results ingestion (#7744)
* - Added support for test ingestion without `dbt docs generate` run
- removed millisecond from timestamp
- changed test result failure to 0

* Removed unused methods
2022-09-27 17:04:23 +02:00
Sachin Chaurasiya
8875624901
Fix #7753 Empty bot view when the bot user auth mechanism is not set (#7756)
* Fix #7753 Empty bot view when the bot user auth mechanism is not set

* Add unit tests
2022-09-27 20:11:01 +05:30
Shailesh Parmar
b394925d80
(Feature) UI: Add ability to view and delete "soft-deleted" tests#7728 (#7750)
* Fixed issue: Add ability to view and delete "soft-deleted" tests #7728

* added soft-delete functionality to test case in entity details page

* added soft delete feature in data quality tab
2022-09-27 19:01:30 +05:30
Chirag Madlani
95287ab71c
test(ui): cypress tests added for re-run (#7713) 2022-09-27 18:55:58 +05:30
Sachin Chaurasiya
d3cd3f2b19
Fix Following data is not showing up on click of OM logo (#7752) 2022-09-27 18:51:27 +05:30
Sachin Chaurasiya
48c5320abb
Improve Cypress test coverage Part 1 (#7751)
* Improve Cypress test coverage Part 1

* Test Add role and assign it to the user

* Address review comments
2022-09-27 18:49:24 +05:30
Aniket Katkar
cd5c143011
UI: Fixed Failing cypress tests (#7748)
* Fixed Failing cypress tests

* changes related to filter pattern reverted
2022-09-27 18:42:49 +05:30
Chirag Madlani
bcbe1ec8e5
fix(ui): sort services on create page (#7745)
* fix(ui): sort services on create page

* address review comments
2022-09-27 18:14:06 +05:30
Vivek Ratnavel Subramanian
92aea1c179
Fix #7669 Backend: Patch API for teams with soft deleted child teams throws an error. (#7742) 2022-09-27 16:44:03 +05:30
Vj-L
3f646586cb
Updated the docs for issue-#7601 & issue-#4562 (#7714)
* Updated the docs for issue-#7601 & issue-#4562

* Updated as per the comments

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-09-27 15:28:29 +05:30
mohitdeuex
8501322a5a
Fix Version issue b/w api/v1/version and entity {id}/versions (#7746) 2022-09-27 15:11:13 +05:30
Onkar Ravgan
dc74089f0e
Fixed pipeline FQN bug (#7740)
* Fixed pipeline FQN

* fixed messaging service

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-27 14:23:59 +05:30
Chirag Madlani
09855fc4c1
chore(ui): basic auth flow improvements (#7719)
* chore(ui): basic auth flow improvements

* fix type error

* address review comments
2022-09-27 12:08:10 +05:30
Onkar Ravgan
8afbbb8642
Ingest DBT tags (#7726)
* added tags

* Added dbt tags ingestion

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-27 11:12:53 +05:30
Chirag Madlani
ada163ab2d
feat(ui): added Redpanda messaging service icon (#7733)
* feat(ui): added redpanda messaging service icon

* update icon
2022-09-27 10:39:34 +05:30
Vivek Ratnavel Subramanian
e2daf73fbd
UI: TeamsSelectable component should use REST API to build teams hierarchy (#7711) 2022-09-26 16:33:48 -07:00
Nahuel
df909703eb
Fix#6615: Fix failing test still in CI (#7725)
* Fix failing test still some tests are failing

* Fix bug in service entity repository

* Fix all tests except Ingestion Pipeline integration tests

* Fix Ingestion Pipeline integration tests

* Fix failing Python tests
2022-09-26 20:39:42 +02:00
Shailesh Parmar
f5f7e8a5c1
UI: Fixed Profiler metrics are not formatted correctly #7552 (#7720)
* UI: Fixed Profiler metrics are not formatted correctly #7552

* miner fix

* Fixed % value on profiler tab
2022-09-26 20:44:21 +05:30
Sachin Chaurasiya
448f2de3fb
FIx #7721 UI : Implement Authentication Mechanism on the bots details page (#7722)
* FIx #7721 UI : Implement Authentication Mechanism on the bots details page

* Addressing review comment
2022-09-26 20:25:49 +05:30
Aniket Katkar
cfdc50e18f
UI: Added cypress tests for soft deleted team checks. (#7718)
* Added cypress tests for checking the option for permanent delete is available for soft deleted teams

* Added checks in cypress tests for team type select while adding teams
Added 'cancel deletion' scenario while team deletion
2022-09-26 19:43:34 +05:30
Milan Bariya
1c78e835d9
Fix: Error initializing ingest: ‘RedshiftSource’ object has no attribute ‘dbt_manifest’ (#7723) 2022-09-26 19:42:22 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler (#7506) 2022-09-26 19:41:40 +05:30
Shailesh Parmar
b81686b426
Fixed issue: Quality tests can not be created if the column names have spaces or special characters #7623 (#7698)
* Fixed issue: Quality tests can not be created if the column names have spaces or special characters #7623

* Added logic to not decode fqn param from path

* Removed commented out code

* Allowed only "_" in spacial character in test case name

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-09-26 18:52:25 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI (#7637)
* Update JSON schemas

* Update create and update endpoint and remove /generateToken endpoint

* Add AuthMechanism and Token Expiry Field on the Add bot page

* Remove unwanted tests

* Add logic to show authMechanism based on auth provider

* Add authConfig to bots details page

* Backend implementation with secret manager

* Fix invalid date issue

* Add support for update bot token details

* Add logic for SSO auth

* Add fields for google sso auth client

* Add Edit Option.

* Updated ingestion CLI and secret manager issues

* Updated tests with errors

* Removed unused method

* Removed test files

* Fix broken JSON schema

* Fix typescript error

* Pass the bot permissions from the bot details page

* Minor errors related to the secret manager

* Restore Airflow configuration for retrocompability

* Add support for all SsoServiceType client config

* Fix Unit test

* Update tests

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-09-26 18:26:24 +05:30
NiharDoshi99
d9f3ab23d7
Fixed: SampleData Teams and teamTypes (#7682) 2022-09-26 18:22:41 +05:30
Ashok Mokshagundam
23f6e18a17
Running All the CI workflows on Release branches along with main branch (#7691)
* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-generate.yml

Updated workflows to run on main branch and also on all release branche

* Update py-ingestion-core-publish.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches

* Update yarn-coverage.yml

Updated workflows to run on main branch and also on all release branches

* Update airflow-apis-tests-3_9.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-mysql.yml

Updated workflows to run on main branch and also on all release branches

* Update cypress-integration-tests-postgresql.yml

Updated workflows to run on main branch and also on all release branches

* Update docs-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update java-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update maven-build.yml

Updated workflows to run on main branch and also on all release branches

* Update openmetadata-ingestion-core-version-comment.yml

Updated workflows to run on main branch and also on all release branches

* Update py-checkstyle.yml

Updated workflows to run on main branch and also on all release branches

* Update py-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update selenium-noIngestion-tests.yml

Updated workflows to run on main branch and also on all release branches

* Update sync-docs.yml

Updated workflows to run on main branch and also on all release branches
2022-09-26 16:47:35 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions (#7653)
* Added control for DBT descriptions

* Fixed tests

* Added UI changes

* fixed maven ci tests

* Java formatting changes

* ui review fixes

* Fixed pytests

* Fixed python integration tests

* fixed airflow tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30