3870 Commits

Author SHA1 Message Date
Shailesh Parmar
e180cb15af
Profiler & Data Quality UI feedback & improvement #7090 Part 2 (#7114)
* Profiler & Data Quality UI feedback & improvement #7090 Part 2

* addressing comment

* fixed failing unit test
2022-09-01 16:38:53 +05:30
Chirag Madlani
bcf2fc3057
feat(ui): support event filters on settings page (#6990)
* feat(ui): support event filters on settings page

* add activity feed settings

* fix lint
2022-09-01 15:40:44 +05:30
Pere Miquel Brull
613a329f40
Fix #7089 - Add Redpanda connector (#7092)
Fix #7089 - Add Redpanda connector (#7092)
2022-09-01 06:39:27 +02:00
Pere Miquel Brull
7d2527bbeb
Fix #6961 - Fallback to another IP service (#7019)
Fix #6961  - Fallback to another IP service (#7019)
2022-09-01 06:39:12 +02:00
Sachin Chaurasiya
1b685fe1ca
Fix Cypress tests (#7091)
* Fix Glossary Cypress tests

* Fix dashboard permission error

* Fix description permission on glossary

* Change addNewTagToEntity selector

* Fix policy cypress test
2022-09-01 01:27:05 +05:30
Teddy
ef41382cb1
Fixes #7094 by fixing minior bugs in table tests (#7095) 2022-08-31 21:35:33 +02:00
Nahuel
ed58c27f76
Remove unused property extra_hosts from docker-compose files (#7096)
* Remove unused properties from docker-compose files

* Minor fix in run_local_docker script
2022-08-31 21:30:24 +02:00
Shailesh Parmar
1b86b3d5e1
Profiler & Data Quality UI feedback & improvement Part1 (#7097) 2022-09-01 00:14:46 +05:30
Teddy
811f640a18
Fixes #6891 by implementing support for VARIANT DType (#7084) 2022-08-31 19:01:00 +02:00
Teddy
01309249c8
Added logic to allow profile data to be ingested when sample data fetch fails (#7088)
* Added logic to allow profile data to be ingested when sample data fetching faisl

* Update ingestion/src/metadata/orm_profiler/profiler/core.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-08-31 18:29:56 +02:00
Pere Miquel Brull
26489a00bf
Add ANTLR in UI (#7093) 2022-08-31 08:42:30 -07:00
Pere Miquel Brull
0d10f85e73
Docs updates for lineage, loggerLevel, metastore and requirements (#7085)
* Python version in requirements

* Add lineage sdk

* Deltalake metastore

* Add loggerLevel
2022-08-31 15:11:11 +02:00
Pere Miquel Brull
76a83cb9ec
Fix #6959 - metadata CLI with postgres (#7031)
* Use the CLI to install OM with postgres

* CLI update
2022-08-31 14:21:35 +02:00
Nahuel
0762e39172
Minor fixes related to Secrets Manager implementation (#7046)
* Minor fixes related to Secrets Manager implementation

* Fix failing test
2022-08-31 14:14:55 +02:00
Pere Miquel Brull
d791fe8289
Fix #6816 - Add supportsQueryComment & Fix #7078 - Athena Session Token (#7079)
* Athena with aws session token

* add supports query comment property to the required db services

* Hide query comment toggle
2022-08-31 14:03:54 +02:00
Suresh Srinivas
cffecc550a
Fixes #7072 - Remove life cycle policies (#7073)
* Fixes #7072 - Remove life cycle policies

* Remove policy sink

* Remove OMetaPolicy

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-08-31 12:47:03 +05:30
Nahuel
235117c28c
Add missing healthcheck to docker-compose-postgres (#7080) 2022-08-31 08:40:17 +02:00
Pere Miquel Brull
3c95423301
Handle internal runtime errors when validating workflows (#7049) 2022-08-31 07:55:40 +02:00
Mayur Singal
7caac4616f
Fix #6645: Remove required fields from mssql (#7065) 2022-08-31 06:52:37 +02:00
Mayur Singal
ef324f8614
Fix #6945: Add session query tag for usage (#7060) 2022-08-31 06:43:57 +02:00
Nahuel
db41be4c4a
Fix#6929: docker-compose services should wait until OpenMetadata DB is created (#7025)
* Added the docker compose for postgres

* Added changes as per the comments on PR

* Airflow Connectivity to Postgres

* Changes are done as per the comments

* Replocate changes to local dockerfile

* Fixed Airflow Dockerfile

* docker-compose services should wait until OpenMetadata DB is created

* remove unnecesary wait for db service

* Add dependencies to airflow image

* Add missing dependencies to airflow Dockerfile

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-08-30 23:55:46 +02:00
Sachin Chaurasiya
503873a0a4
Update Glossary with new roles and policy (#7067)
* Update Glossary with new roles and policy

* Fix unit tests

* Fix tests

* Fix tests
2022-08-30 13:16:33 -07:00
Chirag Madlani
b6309b6274
Fix entity permission (#7052)
* fix(ui): entity permission related updates

* fix unit tests

* fix duplicate import

* fix tests

* remove test which is not valid any longer
2022-08-30 13:10:06 -07:00
Shailesh Parmar
c681494e44
Fixed issue Update Right panel content for add test-suite workflow, and icon for test suite #7043 (#7069)
* Fixed issue Update Right panel content for add test-suite workflow, and icon for test suite #7043

* updated link redirection path for add test

* fixed failing unit test
2022-08-30 11:47:11 -07:00
Aniket Katkar
d438fbead8
Clicking on browser notification for chrome will now open new window (#7068) 2022-08-30 11:46:56 -07:00
Aniket Katkar
6547beeffc
Refactor(UI): Global settings Teams page refactoring and roles and policies update. (#7032)
* - Made organisation page default page for global settings page for teams option
- Unnecessary actions for organisation removed

* Added support for new permissions API in teams page

* Replaced hard coded path with existing util function.

* Worked on comments

* Fixed minor bug and cypress test

* fixed failing cypress tests
2022-08-31 00:11:02 +05:30
Teddy
a39c4db8e7
Add partial support for BQ partitioned table (#7066)
* Added support for BQ time based partition (not ingestion)

* Fixed minor errors in test suite workflow
2022-08-30 11:39:15 -07:00
Suresh Srinivas
1dfcb45e86
Clean up lingering code related to defaultRole field in Role entity (#7064) 2022-08-30 11:25:22 -07:00
Teddy
704385da0a
Clean up profile and test data when migrating from 0.11 to 0.12 (#7039)
* Added SQL to clean up profile and test data when migrating from 0.11 to 0.12

* Added deletion query for ingestion pipeline mysql

* Added logic to delete profiler ingestion pipeline from DB

* Update v004__create_db_connection_info.sql

added semicolon
2022-08-30 18:43:12 +02:00
Mayur Singal
791245c0e8
Redshift Mark Partitioned Tables (#7063) 2022-08-30 18:40:51 +02:00
Sachin Chaurasiya
c366d39737
Update Users, Admins and tags page with new roles and policy (#7050)
* Update Users, Admins and tags page with new roles and policy

* Fix unit tests

* Minor change
2022-08-30 21:11:46 +05:30
Damon-Zeng
7cd5579c84
add 'supportsDatabase' property in mssqlConnection.json (#7015)
* add 'supportsDatabase' property in mssqlConnection.json

* version uipdate with run 'make core_bump_version_dev'

Co-authored-by: Peng Zeng <pengzeng@PengdeMacBook-Pro.local>
2022-08-30 17:30:15 +02:00
Pere Miquel Brull
d2d3151cca
Simplify lineage logs (#7062) 2022-08-30 17:25:40 +02:00
Pere Miquel Brull
9841b0887f
Remove required fields from BQ for ADC (#7037) 2022-08-30 17:25:02 +02:00
Abhishek Pandey
8708520c28
dagster-doc-added (#7055)
* dagster-doc-added

* dagster-config-updated
2022-08-30 16:47:17 +02:00
Shailesh Parmar
3bcef4f58c
UI: Added Data Quality test suite listing page and detail page (#7014)
* initial setup for data quality form

* added stepper and form component

* added select/add test suite step form

* added form for table test and cron step

* added data quality table test form flow

* added test suite listing page

* bug fix for profiler

* added column test form

* render right panel information dynamically

* updated test as per new changes

* updated data test id

* Fixed ingestionPipeline

* Fixed pytest + python format

* miner fix, added sql editor

* removed filter for duplicate test check

* miner fix

* updated all API call for test suite ingestion page

* updated test suite view redirection

* updated ingestion infinite loader

* added edit action for test case

* added edit/add ingestion flow

* added after action for form

* remove duplicate close action

* fixed alignment issue

* added expand on row click functionality and change expand/collapse icon

* used antd component

* resolving conflict

* Fixed#7040: Test-suite count support in counts API (#7041)

* updated test suite count

* fixed failing unit test

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: Parth Panchal <83201188+parthp2107@users.noreply.github.com>
2022-08-30 19:00:51 +05:30
Mayur Singal
5a3fcafb3b
Snowflake Mark Partitioned Tables (#7021)
Snowflake Mark Partitioned Tables (#7021)
2022-08-30 14:35:09 +02:00
Akash Jain
b2f3d958ef
fix: docs env OM_AUTH_AIRFLOW_CUSTOM_OIDC_SECRET_KEY (#7053) 2022-08-30 17:44:39 +05:30
Sachin Chaurasiya
106f99f4c8
Update MyData and Explore with new roles and policy (#7018)
* Update MyData and Explore with new roles and policy

* Add placeholder for explore side panel

* Fix unit tests

* Remove Permission API call from AuthProvider

* Fix loading issue

* Update global settings left panel

* Remove feed check from mydata page

* Remove permission check from explore page

* Minor change

* Add resource permission method to provider

* Change global settings left panel

* Remove unwanted codes

* Add comments

* Addressing review comments
2022-08-30 14:42:55 +05:30
Ayush Shah
a6a4e08af1
Fix Profiler for json or variant types (#7033) 2022-08-30 13:33:23 +05:30
mohitdeuex
b7351c220a
Added Team Webhook (#6973)
* Added Team Webhook

* Ms Teams UI for setting Page

* Updated Review Comment Changes

* minor changes

* Fix webhook types

* Updated Parser for Teams

* Change MsTeams content and created Justify Card

* Fixed failing tests cases

Co-authored-by: Ashish gupta <ag939431@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2022-08-30 11:10:02 +05:30
Ashish Gupta
0ca86c1a24
Fix the Minot Layout issue and text issue (#7024) 2022-08-30 10:38:32 +05:30
Suresh Srinivas
1de569af61
Fixes #7013 Backend : Policy rule description is not getting updated (#7027)
* Fixing test failures

* Fixes #6978  Helper function for building ChangeDescription

* Fixes #7013 Backend : Policy rule description is not getting updated
2022-08-29 22:03:38 -07:00
dependabot[bot]
3c77d49517
Bump minimist from 1.2.5 to 1.2.6 (#7022)
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-29 21:51:12 +05:30
Akash Jain
fed3cf6dae
OpenSearch Service Engine Version Docs Update (#7023) 2022-08-29 21:34:32 +05:30
Akash Jain
fdce6afa6d
fix: update gke docs (#7020) 2022-08-29 20:56:58 +05:30
Mayur Singal
b775649ba8
Postgres Mark Paertitioned Tables (#7017) 2022-08-29 17:00:22 +02:00
Abhishek Pandey
dc227cd508
closing-connection-after-each-iteration (#6954)
* closing-connection-after-each-iteration

* code-formatted

* sqlalchemy-connection-optimised
2022-08-29 16:41:23 +02:00
Aniket Katkar
f0560d121f
Fix(UI): Updated labels for add and edit announcement modals (#6988)
* announcement add and edit modal label updated

* Added feature to see the local time zone while creating or editing announcement

* fixed failing unit tests

* improved the function to get time zone
2022-08-29 19:46:56 +05:30
Ashish Gupta
b59878e1b5
Fix (#6984) doc links in OpenMetaData (#6986)
* Fix doc links in OpenMetaData

* Link updated

* remove unwanted file

* changes as per comments

* Changes as per comments
2022-08-29 19:38:54 +05:30