12410 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
6ba24acdfe
fix: upgrade @azure/msal-react from 1.3.0 to 1.5.11 (#13503)
Snyk has created this PR to upgrade @azure/msal-react from 1.3.0 to 1.5.11.

See this package in npm:


See this project in Snyk:
https://app.snyk.io/org/harshach/project/450b4396-0ef4-4bb2-8b7a-9c8e6ab6c41d?utm_source=github&utm_medium=referral&page=upgrade-pr

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
2023-10-10 12:02:31 +05:30
Mohit Yadav
ab1a156b77
Build Applications Automations (#13318)
* [WIP] Applications

* Remove JobRunr Dependency

* Cleanup Files

* Reformatted

* Add Api to delete schedule for app

* Fix Applications issue

* added missing tables for application automation

* fixed buil failure

* Add Tables for Applications

* Migrate Search Reindexing Job to New Apps

* Fixed Merge Conflicts

* Fix Build

* Add DataInsightReportJob as App

* Review Comments Fix

* update err msgs

* Add Features fields

* Add Default Search Index Application

* Fix Failures

* Add Data Insights application

* Fix trigger and add update fields

* Add Stats context

* Fix Scheduler Initialization

* Fix Stats Issue

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: 07Himank <himank07mehta@gmail.com>
Co-authored-by: 07Himank <112613760+07Himank@users.noreply.github.com>
2023-10-10 11:32:37 +05:30
Teddy
eefce68015
fix: updated DI cost analysis aggregated report (#13498) 2023-10-10 07:04:40 +02:00
Pere Miquel Brull
d3da2d1b9f
Register Ingestion pipelines just from YAML (#13501)
* Register Ingestion pipelines just from YAML

* Format
2023-10-10 07:04:04 +02:00
Pere Miquel Brull
f6a87ee02a
Fix #12082 - Bump PyAthena version (#13464) 2023-10-09 20:47:19 +02:00
Akash Jain
8b028a737b
fix(CI): postgresql ci with opensearch (#13500)
* fix(CI): Postgresql Docker Compose Services Dependency

* fix(CI): update `SEARCH_TYPE` to `opensearch`
2023-10-09 20:18:13 +05:30
Akash Jain
9549df48b4
fix(CI): Postgresql Docker Compose Services Dependency (#13492) 2023-10-09 07:42:20 -07:00
Onkar Ravgan
600cbff707
Fixed print_status import in data_insights.py (#13490) 2023-10-09 18:31:58 +05:30
Ayush Shah
1a8b11b29e
Fix Github Actions, Timeout (#13488) 2023-10-09 15:01:23 +05:30
Pere Miquel Brull
d31db4e862
metadata CLI accepts tilde for relative paths (#13487)
* metadata CLI accepts tilde for relative paths

* [Docs] - Extracting MWAA details
2023-10-09 09:45:50 +02:00
dependabot[bot]
f1a3d2addd
chore(deps): bump postcss in /openmetadata-ui/src/main/resources/ui (#13424)
Bumps [postcss](https://github.com/postcss/postcss) from 8.4.23 to 8.4.31.
- [Release notes](https://github.com/postcss/postcss/releases)
- [Changelog](https://github.com/postcss/postcss/blob/main/CHANGELOG.md)
- [Commits](https://github.com/postcss/postcss/compare/8.4.23...8.4.31)

---
updated-dependencies:
- dependency-name: postcss
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-10-09 12:39:49 +05:30
Pere Miquel Brull
f5e10c4a5f
Fix #7272 - BaseWorkflow docs and cleanup (#13471)
* DQ BaseWorkflow

* Test suite runner

* test Suite workflow

* Refactor DQ for BaseWorkflow

* Lint

* Fix source

* Fix source

* Fix source

* Fix source

* Fix test

* Prepare docs

* Clean sink

* Clean legacy classes

* typo

* ProcessorStatus
2023-10-09 07:05:05 +02:00
Ayush Shah
2df27c4662
Modify pytest timeout from 30 to 40 mins (#13484) 2023-10-09 09:49:27 +05:30
Sriharsha Chintalapani
35c4e18663
Upgrade search versions (#13479)
* working on maven shading

* update es in docker

* add maven shade for elasticsearch/opensearch dependencies

* add submodule for es/os dependencies

* upgrade docker elasticsearch to latest 8.10.2

* upgrade docker elasticsearch to latest 8.10.2

* Update Postgres dev to use OpenSearch

* Fix container service dependency

* revert conf change

---------

Co-authored-by: 07Himank <himank07mehta@gmail.com>
Co-authored-by: 07Himank <112613760+07Himank@users.noreply.github.com>
2023-10-08 11:55:34 -07:00
Sriharsha Chintalapani
b06db047a4
Make tests to run mvn clean package (#13480) 2023-10-08 08:08:14 -07:00
Ayush Shah
08d7ee6d55
Fixes #13052: Datalake Nested Columns Sample Data ingestion (#13338) 2023-10-08 20:08:51 +05:30
Sriharsha Chintalapani
21bba1c23b
Register system knowledge panels (#13412)
* Register system knowledge panels

* Add Recently Viewed Knowledge Panel

* Fix test
2023-10-08 07:34:01 -07:00
Pere Miquel Brull
4ea5549bf9
fix: openmetadata-ui/src/main/resources/ui/package.json & openmetadata-ui/src/main/resources/ui/yarn.lock to reduce vulnerabilities (#13393)
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JS-POSTCSS-5926692

Co-authored-by: snyk-bot <snyk-bot@snyk.io>
Co-authored-by: Suresh Srinivas <srini30005@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-10-07 16:03:37 -07:00
Pere Miquel Brull
c9b3724003
Support migration extensions (#13436)
* Support migration extensions

* Prep test

* Prep test
2023-10-07 16:00:47 -07:00
Ashish Gupta
e65f9600b3
fix(ui): revamp dropable ui effect for glossary terms table (#13443)
* revamp dropable ui effect for glossary terms table

* logic change for getting classname

* supported one drop style
2023-10-07 15:59:58 -07:00
Mayur Singal
ec94eb0113
Fix #12952: Fix nifi json decode error (#13465) 2023-10-07 15:59:29 -07:00
Ashish Gupta
35cdfa8f8f
fix broken breadcrumb issue in request/update pages for tags/description (#13463) 2023-10-07 16:58:14 +05:30
Suresh Srinivas
d0f3ee6a2a
Removing redunant throws exceptions (#13468) 2023-10-06 15:43:45 -07:00
Shilpa Vernekar
b23ab9fe19
docs-new (#13461) 2023-10-06 14:25:44 -07:00
Shilpa Vernekar
7cfcd56970
lineage-docs (#13472) 2023-10-06 14:25:22 -07:00
Pere Miquel Brull
aed9e3875f
DQ base workflow (#13454)
* DQ BaseWorkflow

* Test suite runner

* test Suite workflow

* Refactor DQ for BaseWorkflow

* Lint

* Fix source

* Fix source

* Fix source

* Fix source

* Fix test

* Fix test

* Fix test
2023-10-06 18:29:18 +02:00
Mayur Singal
c0ababd8ad
Fix #13336: Clean Mark All Deleted Table Flag (#13344) 2023-10-06 16:04:54 +05:30
Onkar Ravgan
3b7f023bdc
ca DI processor update (#13453) 2023-10-06 14:35:23 +05:30
Mayur Singal
2986d616b7
Fix superset owner issue for db (#13451) 2023-10-06 12:31:46 +05:30
Teddy
518fedd3fd
Cost analysis charts (#13458)
* feat: unused size report

* feat: asset count report

* feat: unused asset size

* feat: used vs unused assets count

* feat: used vs unused assets size

* feat: clients + chart result json schema
2023-10-06 08:42:38 +02:00
Nguyen Huu Loc
7ff6738527
Fix looker missing git execution on container image (#13457)
* - Add git execution to ingestion Dockerfile
- [Looker] Update missing function

* Fix pylint

* Add git execution to Dockerfile

* Remove log

---------

Co-authored-by: Loc Nguyen <loc.nguyenhuu@xendit.co>
2023-10-06 06:51:07 +02:00
Ashish Gupta
859a594429
fix domain cypress and not found after delete issue (#13450) 2023-10-05 22:59:02 +05:30
Ashish Gupta
11b034231a
fix(ui): supported pending services in assets (#13372)
* supported pending services in assets

* localization key change

* added storage service

* sonar fixes

* fix broken paths

---------

Co-authored-by: 07Himank <112613760+07Himank@users.noreply.github.com>
2023-10-05 19:20:59 +05:30
Shailesh Parmar
de2b2c6428
fix: Glossary tags are not showing proper name when using in entities #13440 (#13448) 2023-10-05 18:35:01 +05:30
Onkar Ravgan
44df02010a
Added delete API for Raw Cost Analysis Report Rows (#13435)
* Added delete API

* review comments

* fixed checkstyle

* fixed naming

* checkstyle

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-10-05 14:27:23 +02:00
Teddy
f0ab4c942d
Fixes #13267 - Remove maxLen and minLen from profiler default metrics (#13447)
* fix: change log level to debug

* remove minLength and maxLength from default metrics
2023-10-05 14:11:51 +02:00
Onkar Ravgan
1e48d2ecff
Added sd changes (#13446)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-10-05 12:24:32 +02:00
Ashish Gupta
783f8e3c33
fix search index value for search and data product (#13441) 2023-10-05 15:25:03 +05:30
Mayur Singal
0090286924
Fix Bigquery Test connection for multiproject (#13380)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-10-05 14:50:42 +05:30
Mayur Singal
f879656f0a
Fix #12047: Clean commonregex package from setup (#13439) 2023-10-05 13:41:31 +05:30
Teddy
c4a3de6a85
fix: handle tableConfig for profiler CLI (#13437)
* fix: handle tableConfig for profiler CLI

* fix: empty commit for CI
2023-10-05 10:02:57 +02:00
Teddy
ddae3d8143
Refactor Data Insight aggregators Classes (#13433)
* fix: removed legacy OS and ES aggregator classes

* fix: centralized aggregator business logic

* fix: implemented client specific aggregator

* fix: updated client instantiation to use client specific aggregator

* fix: clean up json schema

* fix: updated DI index names

* fix: added searchIndex + storedProcedure

* fix: ran linting

* fix: updated python test to include new entity types
2023-10-05 09:31:27 +02:00
Vlad
c505b638d0
Update references to Airflow instead of Airbyte (#13438) 2023-10-04 13:44:40 -07:00
Ashish Gupta
6bbb274e11
supported drag and drop to glossary level for glossary terms (#13434) 2023-10-04 22:01:54 +05:30
Shailesh Parmar
b478039207
feat(ui): Add Badge with color or icon for Tags,GlossaryTerm, Domain and DataProducts #9972 (#13349)
* feat(ui): Add Badge with color or icon for Tags,GlossaryTerm, Domain and DataProducts #9972

* added api call to patch style in glossary

* updated and refactor AsyncSelectList and tagsContainerV2

* updated tags in all the pages

* added style object in addGlossaryTerm form

* added style support in domain and tags

* fixed failing unit test

* added cypress for the style feature

* added unit test for new component

* translation-sync

* addressing comment

* fixed edit tags issue

* added style feature for domain

* fixed sonarLint

* fixed merge issue
2023-10-04 21:50:39 +05:30
Sachin Chaurasiya
be278b67ac
chore(ui): add route and sidebar prop support in app (#13430)
* chore(ui): add children support in app

* fix: assets path

* chore: add support for route and sidebar elements prop

* chore: remove children prop from app
2023-10-04 19:05:48 +05:30
Nguyen Huu Loc
ef1974edd6
Support LookML multi repos (#13140)
* Draft: Support LookML multi repos

* [Looker] manually create Dashboard datamodel

* [Looker] Support remote import & lineage for looker view

* Rollback parser.py

* refactor code

* Update code

* Remove logs & add comments

* Remove Middle & Nothing

* - Fix yield datamodel error
- Remove logs

* Support clone repo from Bitbucket

* Fix typo

* Optimize imports

* Fix pylint

---------

Co-authored-by: Loc Nguyen <loc.nguyenhuu@xendit.co>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-10-04 15:16:21 +02:00
Ayush Shah
97f4f8fbf3
Fixes 12922: Trino NaN issue + TrinoUserError (#13244)
* Fix Trino NaN issue + TrinoUserError
2023-10-04 18:39:39 +05:30
RyoAriyama
b2ee1a54ef
fix return type of docstring powerbi (#13422) 2023-10-04 15:00:06 +02:00
Anatoliy Shulika
b788061157
fixes #12771: Added Greenplum Ingestion Connector (#13128)
* ISSUE-12771: Added Greenplum Ingestion Connector

* fixed python code formating

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-10-04 14:53:53 +02:00