3981 Commits

Author SHA1 Message Date
Teddy
d9003a90e7
Added logic to handle testSuite when no database is set in service co… (#7129)
* Added logic to handle testSuite when no database is set in service connection

* Fixed python formatting
2022-09-01 22:06:13 +02:00
Aniket Katkar
f5e15853f0
Fix(UI) : Improvements and bug fixes. (#7120)
* - Fixed issue 7115
- Fixed issue 7116

* Worked on comments
2022-09-01 23:27:48 +05:30
Aniket Katkar
0efcf38917
Fix(UI): Fixed policy implementation issues with team details page (#7133)
* Fixed policy implementation issues with team details page

* Worked on comments
2022-09-01 23:27:27 +05:30
Shailesh Parmar
6b61c43a0a
Profiler & Data Quality UI feedback & improvement #7090 part 3 (#7123) 2022-09-01 21:49:43 +05:30
Aniket Katkar
55793877af
Fixed issue with switch button and edit owner policy implementation in team details page (#7130) 2022-09-01 21:28:48 +05:30
mohitdeuex
9e689f7f8b
Event filter restricted usageSummary, added for testCase(with default disabled) (#7107) 2022-09-01 07:45:16 -07:00
Ashish Gupta
f4c0d82882
Added Ms Teams in setting page (#7125) 2022-09-01 20:11:36 +05:30
Sachin Chaurasiya
77c40c97f2
Fix custom property permission issue (#7126) 2022-09-01 20:11:24 +05:30
Teddy
891603e72f
Remove unique computation for unsupported fields (#7117) 2022-09-01 15:57:33 +02:00
Sachin Chaurasiya
41a04c462e
Fix #7102 UI : Update test suites, database, database schema and service pages with new permissions (#7103)
* Fix #7102  UI : Update test suites page with new permissions

* Fix unit tests

* Update test suite and testCase with permissions

* Update default permission state

* Add permission check for service page

* Fix unit test

* Add permission for database and database schema

* Add permission check for test suite pipeline

* Addressing review comment

* Fix unit tests
2022-09-01 18:29:38 +05:30
Teddy
9dbcb3911b
Fix minor column data quality test bugs (#7111)
* Fixed test name issue + filtered out partition details for non BQ tables

* Exclude non BQ table from partition processing

* Fixed test + formating
2022-09-01 13:47:00 +02:00
Shailesh Parmar
e180cb15af
Profiler & Data Quality UI feedback & improvement #7090 Part 2 (#7114)
* Profiler & Data Quality UI feedback & improvement #7090 Part 2

* addressing comment

* fixed failing unit test
2022-09-01 16:38:53 +05:30
Chirag Madlani
bcf2fc3057
feat(ui): support event filters on settings page (#6990)
* feat(ui): support event filters on settings page

* add activity feed settings

* fix lint
2022-09-01 15:40:44 +05:30
Pere Miquel Brull
613a329f40
Fix #7089 - Add Redpanda connector (#7092)
Fix #7089 - Add Redpanda connector (#7092)
2022-09-01 06:39:27 +02:00
Pere Miquel Brull
7d2527bbeb
Fix #6961 - Fallback to another IP service (#7019)
Fix #6961  - Fallback to another IP service (#7019)
2022-09-01 06:39:12 +02:00
Sachin Chaurasiya
1b685fe1ca
Fix Cypress tests (#7091)
* Fix Glossary Cypress tests

* Fix dashboard permission error

* Fix description permission on glossary

* Change addNewTagToEntity selector

* Fix policy cypress test
2022-09-01 01:27:05 +05:30
Teddy
ef41382cb1
Fixes #7094 by fixing minior bugs in table tests (#7095) 2022-08-31 21:35:33 +02:00
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096)
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
2022-08-31 21:30:24 +02:00
Shailesh Parmar
1b86b3d5e1
Profiler & Data Quality UI feedback & improvement Part1 (#7097) 2022-09-01 00:14:46 +05:30
Teddy
811f640a18
Fixes #6891 by implementing support for VARIANT DType (#7084) 2022-08-31 19:01:00 +02:00
Teddy
01309249c8
Added logic to allow profile data to be ingested when sample data fetch fails (#7088)
* Added logic to allow profile data to be ingested when sample data fetching faisl

* Update ingestion/src/metadata/orm_profiler/profiler/core.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-08-31 18:29:56 +02:00
Pere Miquel Brull
26489a00bf
Add ANTLR in UI (#7093) 2022-08-31 08:42:30 -07:00
Pere Miquel Brull
0d10f85e73
Docs updates for lineage, loggerLevel, metastore and requirements (#7085)
* Python version in requirements

* Add lineage sdk

* Deltalake metastore

* Add loggerLevel
2022-08-31 15:11:11 +02:00
Pere Miquel Brull
76a83cb9ec
Fix #6959 - metadata CLI with postgres (#7031)
* Use the CLI to install OM with postgres

* CLI update
2022-08-31 14:21:35 +02:00
Nahuel
0762e39172
Minor fixes related to Secrets Manager implementation (#7046)
* Minor fixes related to Secrets Manager implementation

* Fix failing test
2022-08-31 14:14:55 +02:00
Pere Miquel Brull
d791fe8289
Fix #6816 - Add supportsQueryComment & Fix #7078 - Athena Session Token (#7079)
* Athena with aws session token

* add supports query comment property to the required db services

* Hide query comment toggle
2022-08-31 14:03:54 +02:00
Suresh Srinivas
cffecc550a
Fixes #7072 - Remove life cycle policies (#7073)
* Fixes #7072 - Remove life cycle policies

* Remove policy sink

* Remove OMetaPolicy

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-08-31 12:47:03 +05:30
Nahuel
235117c28c
Add missing healthcheck to docker-compose-postgres (#7080) 2022-08-31 08:40:17 +02:00
Pere Miquel Brull
3c95423301
Handle internal runtime errors when validating workflows (#7049) 2022-08-31 07:55:40 +02:00
Mayur Singal
7caac4616f
Fix #6645: Remove required fields from mssql (#7065) 2022-08-31 06:52:37 +02:00
Mayur Singal
ef324f8614
Fix #6945: Add session query tag for usage (#7060) 2022-08-31 06:43:57 +02:00
Nahuel
db41be4c4a
Fix#6929: docker-compose services should wait until OpenMetadata DB is created (#7025)
* Added the docker compose for postgres

* Added changes as per the comments on PR

* Airflow Connectivity to Postgres

* Changes are done as per the comments

* Replocate changes to local dockerfile

* Fixed Airflow Dockerfile

* docker-compose services should wait until OpenMetadata DB is created

* remove unnecesary wait for db service

* Add dependencies to airflow image

* Add missing dependencies to airflow Dockerfile

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-08-30 23:55:46 +02:00
Sachin Chaurasiya
503873a0a4
Update Glossary with new roles and policy (#7067)
* Update Glossary with new roles and policy

* Fix unit tests

* Fix tests

* Fix tests
2022-08-30 13:16:33 -07:00
Chirag Madlani
b6309b6274
Fix entity permission (#7052)
* fix(ui): entity permission related updates

* fix unit tests

* fix duplicate import

* fix tests

* remove test which is not valid any longer
2022-08-30 13:10:06 -07:00
Shailesh Parmar
c681494e44
Fixed issue Update Right panel content for add test-suite workflow, and icon for test suite #7043 (#7069)
* Fixed issue Update Right panel content for add test-suite workflow, and icon for test suite #7043

* updated link redirection path for add test

* fixed failing unit test
2022-08-30 11:47:11 -07:00
Aniket Katkar
d438fbead8
Clicking on browser notification for chrome will now open new window (#7068) 2022-08-30 11:46:56 -07:00
Aniket Katkar
6547beeffc
Refactor(UI): Global settings Teams page refactoring and roles and policies update. (#7032)
* - Made organisation page default page for global settings page for teams option
- Unnecessary actions for organisation removed

* Added support for new permissions API in teams page

* Replaced hard coded path with existing util function.

* Worked on comments

* Fixed minor bug and cypress test

* fixed failing cypress tests
2022-08-31 00:11:02 +05:30
Teddy
a39c4db8e7
Add partial support for BQ partitioned table (#7066)
* Added support for BQ time based partition (not ingestion)

* Fixed minor errors in test suite workflow
2022-08-30 11:39:15 -07:00
Suresh Srinivas
1dfcb45e86
Clean up lingering code related to defaultRole field in Role entity (#7064) 2022-08-30 11:25:22 -07:00
Teddy
704385da0a
Clean up profile and test data when migrating from 0.11 to 0.12 (#7039)
* Added SQL to clean up profile and test data when migrating from 0.11 to 0.12

* Added deletion query for ingestion pipeline mysql

* Added logic to delete profiler ingestion pipeline from DB

* Update v004__create_db_connection_info.sql

added semicolon
2022-08-30 18:43:12 +02:00
Mayur Singal
791245c0e8
Redshift Mark Partitioned Tables (#7063) 2022-08-30 18:40:51 +02:00
Sachin Chaurasiya
c366d39737
Update Users, Admins and tags page with new roles and policy (#7050)
* Update Users, Admins and tags page with new roles and policy

* Fix unit tests

* Minor change
2022-08-30 21:11:46 +05:30
Damon-Zeng
7cd5579c84
add 'supportsDatabase' property in mssqlConnection.json (#7015)
* add 'supportsDatabase' property in mssqlConnection.json

* version uipdate with run 'make core_bump_version_dev'

Co-authored-by: Peng Zeng <pengzeng@PengdeMacBook-Pro.local>
2022-08-30 17:30:15 +02:00
Pere Miquel Brull
d2d3151cca
Simplify lineage logs (#7062) 2022-08-30 17:25:40 +02:00
Pere Miquel Brull
9841b0887f
Remove required fields from BQ for ADC (#7037) 2022-08-30 17:25:02 +02:00
Abhishek Pandey
8708520c28
dagster-doc-added (#7055)
* dagster-doc-added

* dagster-config-updated
2022-08-30 16:47:17 +02:00
Shailesh Parmar
3bcef4f58c
UI: Added Data Quality test suite listing page and detail page (#7014)
* initial setup for data quality form

* added stepper and form component

* added select/add test suite step form

* added form for table test and cron step

* added data quality table test form flow

* added test suite listing page

* bug fix for profiler

* added column test form

* render right panel information dynamically

* updated test as per new changes

* updated data test id

* Fixed ingestionPipeline

* Fixed pytest + python format

* miner fix, added sql editor

* removed filter for duplicate test check

* miner fix

* updated all API call for test suite ingestion page

* updated test suite view redirection

* updated ingestion infinite loader

* added edit action for test case

* added edit/add ingestion flow

* added after action for form

* remove duplicate close action

* fixed alignment issue

* added expand on row click functionality and change expand/collapse icon

* used antd component

* resolving conflict

* Fixed#7040: Test-suite count support in counts API (#7041)

* updated test suite count

* fixed failing unit test

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: Parth Panchal <83201188+parthp2107@users.noreply.github.com>
2022-08-30 19:00:51 +05:30
Mayur Singal
5a3fcafb3b
Snowflake Mark Partitioned Tables (#7021)
Snowflake Mark Partitioned Tables (#7021)
2022-08-30 14:35:09 +02:00
Akash Jain
b2f3d958ef
fix: docs env OM_AUTH_AIRFLOW_CUSTOM_OIDC_SECRET_KEY (#7053) 2022-08-30 17:44:39 +05:30
Sachin Chaurasiya
106f99f4c8
Update MyData and Explore with new roles and policy (#7018)
* Update MyData and Explore with new roles and policy

* Add placeholder for explore side panel

* Fix unit tests

* Remove Permission API call from AuthProvider

* Fix loading issue

* Update global settings left panel

* Remove feed check from mydata page

* Remove permission check from explore page

* Minor change

* Add resource permission method to provider

* Change global settings left panel

* Remove unwanted codes

* Add comments

* Addressing review comments
2022-08-30 14:42:55 +05:30