10673 Commits

Author SHA1 Message Date
Ayush Shah
a4430c1fd4
MINOR: Update README.md (#14411) 2023-12-20 21:44:08 +05:30
Ayush Shah
ebc0a551e5
Fixes 12947: Add Support For DQ and Profiler in Databricks Unity Catalog (#14424) 2023-12-20 21:18:05 +05:30
Onkar Ravgan
9388c39b46
Fixed add ingestion page (#14458) 2023-12-20 19:31:16 +05:30
Ayush Shah
c3fac5e97e
Fix Adls connection typo (#14449) 2023-12-20 14:25:54 +01:00
NiharDoshi99
492092720d
#12908 support for table owner in postgres (#14289)
* support pick up postgres table owner

* added owner wrapper

* optimize the code

* remove pylint error

* minor fix

* changes as per comments

* fix python checksytyle and comments

* moved process owner to database service

* update docs for version 1.3

---------

Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
2023-12-20 18:42:59 +05:30
Shilpa Vernekar
1dc79bfd3c
Docs: Links corrected (#14459) 2023-12-20 18:20:33 +05:30
Sachin Chaurasiya
4ebe34363f
Fix [#14266]: CustomProperty page loading and error toast issue (#14457) 2023-12-20 12:27:49 +00:00
Onkar Ravgan
7d032977d7
Fix 14084: Removed Airflow Mssql backend connection (#14420)
* Removed Airflow Mssql backend conn

* added breaking changes docs
2023-12-20 12:28:28 +05:30
Shilpa Vernekar
cce059d98f
Docs: Link Corrected (#14452) 2023-12-20 06:14:43 +00:00
Harsh Vador
71ca9e3855
fix #13551: show domain on users page (#14381)
* show domain on users page

* added test cases

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-20 10:58:34 +05:30
Abhishek Porwal
4c1c91e6ba
fix: issue-12540 and issue-13992 (apply highlights and sort in summary column as well as for tags). (#14253)
* sort the summarylist items based on the
glossary-term-page and applied tags in explore page

* change path split logic to get the current glossary term

* sort the tags in summaryItem based on current glossary

* prettier-fix

* minor changes

* variable name changed

* unit test update for the sorting items based on tags in entity-summary-panel-utils

* added tag highlight for column tags

* fix: existing e2e test break in glossary.spec file

* e2e for checking the column sort based on current term page in right panel

* minor changes

* e2e for checking columnTagHighlight with sort on term page

* add page tag sort functionality based on filter applied in explore page and based on current term in glossary term page

* minor change

* implement summaeryItem  highlight and sort on global search + also when apply filter

* fix: for the first render after search first elements right panel name, description etc not get highlighted

* Revert "fix: for the first render after search first elements right panel name, description etc not get highlighted"

This reverts commit e69512d625f412263e925598846a0e104561a07c.

* minor change

* add tags sort and highlight functionality in StoreProcedure Page

* add tag sort and highlight functionality in dashboard

* add summary list and tags sort and highlight functionality in Dashboard Data Modal

* remove repeated code and optimize the getFormatEntityData method

* add sort and highlight for global search and filter in Pipeline component

* minor change to fix the entity details value not get parse in some cases

* add sort and highlight for topics in explore page

* added sort and highlight fn for MlModels in explore page

* added sort and highlight functionality for Containers in explore page

* add sort and highlights for charts data

* add sort and filter functionality for searchIndexs in explore page

* cleanup first

* cleanup 2

* move constant in separate file

* some type fix and cleanup

* minor fix

* fix unit test for EntitySummaryPanelUtils

* minor fix

* revert some change and fix unit test in SearchIndexSummary component

* revert some change

* constant file name change

* update the highlight keys constant and add sort and highlight summary list based on column description also

* cleanup in EntitySummaryPanelUtils

* type errors fixing

* fixing type issues wip

* revert a change

* change a variable name and fix type error

* change the sequence of parameter in getFormattedEntityData fn

* fix unit test

* fix type issues

* fix e2e test for sorting and highlighting summaryList and its tag

* added sort and highlight for DatabaseSummary component

* added sort and highlight for DatabaseSchemaSummary component

* added sort and highlight in different service-summary component

* fix: right panel entity display name and description not get highlight on search until we select a entity card

* address comments

* address comments

* address comments 3

* fix: unit test fail after addressing comments

* address comments

* revert some change

* added unit test for newly added methods in EntitySummaryPanelUtils

* added unit test for highlightEntityNameAndDescription method

* fix conflict after taking pull and some cleanup

---------

Co-authored-by: karanh37 <33024356+karanh37@users.noreply.github.com>
2023-12-20 10:57:59 +05:30
Ayush Shah
03f884b376
MINOR: Fix Typos (#14448) 2023-12-20 10:30:23 +05:30
Onkar Ravgan
841fd9cfe7
Fixed superset excp (#14447) 2023-12-20 09:30:37 +05:30
Pere Miquel Brull
ffe4aa319f
MINOR - Truncate automations_workflow (#14446) 2023-12-19 16:53:23 +01:00
Chirag Madlani
4846103cbf
FIXED - [docs] profiler image for column (#14443)
There was a typo in the column profiler image name.
Changed it from: Colomn.png --> Column.png
2023-12-19 13:32:55 +00:00
Pere Miquel Brull
e16ad3c5dc
MINOR - Clean ingestion ES code and auth providers (#14358)
* MINOR - Clean ingestion ES code and auth providers

* clean parser

* Clean security config for the client

* Clean security config for the client

* Improve class conversion exceptions

* Fix tests

* Clean up java client

* Clean up java client

* clean parser

* Fix test

* Fix test

* fix NO_AUTH error

* Fix test

* Format

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-19 12:08:48 +01:00
Pere Miquel Brull
fac1896fdb
#13190 - Improve URL handling for Airflow REST Client (#14403)
* #13190 - Improve URL handling for Airflow REST Client

* Fmt

* Format
2023-12-19 12:08:17 +01:00
Pere Miquel Brull
0e92a975e3
#14425 - Create ingestion-base-slim image (#14426)
* #14425 - Create ingestion-base-slim image

* Format

* Bump airflow

* Bump constraints
2023-12-19 11:09:38 +01:00
Harsh Vador
824307dc9a
fix #14292: Tags Page UI issues (#14327)
* Fixed modal css & text styling

* fix unnecessary api calls

* address comments

* added locale files

* change widget message & fix unnecessary api calls

* address comments

* fix tags page import

* fix failing cyp test

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-19 15:25:18 +05:30
Sachin Chaurasiya
d79654e271
Minor: add base class for search (#14379)
* Minor: add base class for search

* fix: unit test

* add changes to for suggestions

* fix unit test

* address comment

* fix type
2023-12-19 15:02:22 +05:30
Mohit Yadav
a469d3bbe7
Add notification for Glossary Approval Task (#14438) 2023-12-19 10:24:54 +01:00
Ayush Shah
21909802b3
Apply Spotless issue fix (#14436) 2023-12-19 12:18:41 +05:30
Harsh Vador
c601dde801
fix #14159: Added support for displayName in adding ingestion (#14384)
* added support for displayName in adding ingestion

* added test cases

* minor code fix

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-19 11:32:20 +05:30
Mohit Yadav
6612ac9a51
Adds Test in Glossary Term from various languages (#14319)
* Adds Test in Glossary Term from various languages

* Update GlossaryTermResourceTest.java
2023-12-19 09:24:22 +05:30
Sriharsha Chintalapani
123ed59923
Minor: update git-blmae-ignore-revs, and uncomment ClassificationResourceTest tests code (#14431) 2023-12-18 19:16:29 -08:00
Suresh Srinivas
451a20b3cd
Adopt Java 17 features (#14430)
* Adopt Java 17 features

* Make the code comments compact
2023-12-18 17:52:01 -08:00
Sriharsha Chintalapani
1294f93e15
Minor: Migrate to latest google code style library to support Java 17 and beyond (#14429)
* Minor: add spotless and use simplecontext

* Remove context from rule evaluaiton

* Fix EventSubscription tests

* Minor: Migrate to latest google code style library to support Java 17 and beyond

* Minor: Ignore code style migration from git blame
2023-12-18 12:56:17 -08:00
Pere Miquel Brull
a83a5ba3a3
MINOR - Skip delta tests for 3.11 (#14398)
* MINOR - Bump delta for 3.11

* Update flags

* MINOR - Bump delta for 3.11

* Update tests regex

* Update version

* Deprecations

* Format

* Version

* Try delta spark

* Skip delta tests for 3.11

* Update ingestion/tests/unit/topology/pipeline/test_airflow.py
2023-12-18 17:01:57 +01:00
Onkar Ravgan
1af1caf065
Prepare alation connector schemas (#14407) 2023-12-18 13:07:42 +05:30
Onkar Ravgan
ef48b7eae7
MINOR: Added custom properties methods in python sdk (#14402)
* Added custom properties methods in python sdk

* fixed tests
2023-12-18 12:57:14 +05:30
Pere Miquel Brull
d8984d267e
#14340 & #13849 - Clean secret ID and improve encrypt/decrypt exception management (#14356)
* Fix supported characters in SM

* Update SM

* Fixes

* Fixes

* Improve class conversion exceptions

* Comments

* Rename noop to db secrets manager providee

* Update sm

* Fix

* db SM

* db SM

* Fix test

* UI

* Update openmetadata-ui/src/main/resources/ui/src/mocks/IngestionListTable.mock.ts

* update default
2023-12-18 06:43:20 +01:00
Mayur Singal
3e1bef48c7
Minor: Fix casing in MSSQL test connection query (#14412)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-12-17 16:02:32 +01:00
Pere Miquel Brull
6d046f7e3b
Revert "Update Dockerfile.ci file to use new MySQL Keys (#14400)" (#14416)
This reverts commit 33f2fdd49cae50c93cbf1f8544402bda41070a01.
2023-12-16 16:46:33 +01:00
Shilpa Vernekar
3d85d4734d
DOCS: Broken links in v1.2 corrected (#14410) 2023-12-15 18:16:00 +01:00
Pere Miquel Brull
d2bc681015
MINOR - Update CI lewagon/wait-on-check-action version (#14409)
* MINOR - Update CI lewagon/wait-on-check-action version

* MINOR - Update CI lewagon/wait-on-check-action version
2023-12-15 16:53:51 +01:00
Tom Bushell
bb3f9a4441
Fixes #9919: Cleaned up postgres lineage and fixed function in postgres query_parser (#13678)
* Replaced s.query with query_text in filters for clarity

* Removed redundant _iter function

* Updated process_table_query to return None when there are no queries to process

* Modified process_table_query to yield None if there are no queries

* Resolved formating issues and modified process_table_query to return None instead of yielding None

* pylint, fix bugs and improve code

* fix import

* pyformat

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-12-15 20:14:19 +05:30
Preet Shah
33f2fdd49c
Update Dockerfile.ci file to use new MySQL Keys (#14400)
* Update Dockerfile.ci file to use new MySQL Keys

* Update ingestion Dockerfiles files to use new MySQL Keys

* Update ingestion Dockerfiles files

* Update Dockerfiles to not hardcode the new keys

* Update comments
2023-12-15 15:46:30 +05:30
Pere Miquel Brull
4651a58980
MINOR - Don't fail fast python CI (#14399) 2023-12-15 07:57:44 +01:00
Aniket Katkar
cbf86e7d4e
added missing connector images (#14397) 2023-12-15 09:27:46 +05:30
Pere Miquel Brull
eaacc693bd
#12027 - Add support for Python 3.11 (#14385)
* Fix datamodel codegen and bump versions

* Add 3.11 tests

* Update hive

* pandas

* pandas
2023-12-14 15:46:58 +01:00
Pere Miquel Brull
d4d8f3655f
#14043 - Fix metadata backup memory profile (#14378)
* Update looker docs

* Fix db dump
2023-12-14 15:46:35 +01:00
C. Kris
74df616679
Fixes #14215: Add missing decode stage to gz/zip files in json ingestion reader. (#14375)
* add decoding stage to gz/zip files.

Files that where zip/gz where not being decoded.
This was leading to a error when we wanted them to be.

* remove unnecessary comment

---------

Co-authored-by: Carl Kristensen <carl.johan.coelho.kristensen@schibsted.com>
2023-12-14 12:47:58 +01:00
Preet Shah
512625c809
Update security-scan CI to use OpenMetadata Organization (#14383) 2023-12-14 16:06:16 +05:30
Chirag Madlani
ddee335874
Fix ci label (#14382)
* FIX(CI) Re-run CI on label update for PR

* re-run java-checkstyle on label change
2023-12-14 12:21:10 +05:30
Shilpa Vernekar
91899233f9
Docs: Updated v1.3 & changed to How-to Guides (#14380) 2023-12-13 09:28:06 -08:00
Chirag Madlani
c49b5f4065
FIX #14376: Pagination control get blocked by notification popup (#14377) 2023-12-13 15:59:38 +00:00
Mayur Singal
4f65287dae
Minor: Airflow skip task status if task deleted (#14373) 2023-12-13 18:34:14 +05:30
Mayur Singal
35d4c64e69
Minor: Improve exception handling in Superset (#14371) 2023-12-13 18:33:59 +05:30
Pere Miquel Brull
9d5c3a490f
MINOR - Prepare 1.3 docs directories (#14357) 2023-12-13 18:33:08 +05:30
Harsh Vador
c2b0c2687d
#14114: Support for personal access token (#14247)
* added user access token

* added locale files

* Add invalidate call when calling api for personal token

* added test cases

* refactor code

* code refactor

* change styling

* added test cases and code refactor

* added locale files

* fix failing test

* code refactor

* code refactor

* added common comp in bots page

* fix cypress tests

* add cypress tests

* added locale files

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-12-13 18:25:22 +05:30