10943 Commits

Author SHA1 Message Date
Pere Miquel Brull
f52e93f88f
MINOR - Automator multiple ownership (#17232) 2024-07-30 15:22:49 +02:00
Suman Maharana
c84baaf66a
Fixes #16101 - Added Metabase owner ingestion (#17156)
* Added Metabase owner ingestion

* resolved commanets

* updated owners
2024-07-30 18:16:51 +05:30
Mayur Singal
ef67474310
Data Insights Refactor (#16532)
---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Pablo Takara <pjt1991@gmail.com>
Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-07-30 17:38:43 +05:30
Aniket Katkar
7f6fc5321e
Minor: Fix playwright circular dependencies (#17228)
* Fix circular dependencies in playwright test files

* Fix the type error
2024-07-30 15:05:56 +05:30
sonika-shah
84ad2062b8
fix test (#17229) 2024-07-30 10:07:55 +02:00
sonika-shah
2f1037a10b
Fixes #16232 - fix pagination issues due to similar name (#17187)
* Fix pagination issues due to same name

* Fix postgres migration

* Implement pagination based on (name, id) cursor, storing them in JSON object form

* update comment

* Add tests

* Add tests

* fix tests
2024-07-30 09:22:39 +02:00
Sriharsha Chintalapani
fe107aa3cb
Issue #17012: Multi User/Team Ownership (#17013)
* Add multiple owners

* Multi Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 1

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 2

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 3

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 4

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 5

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 6

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 7

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 8

* Add Migrations for Owner Thread

* update ingestion for multi owner

* fix pytests

* fixed checkstyle

* Add Alert Name to Publishers (#17108)

* Add Alert Name to Publishers

* Fix Test

* Add Bound to Setuptools (#17105)

* Minor: fixed testSummaryGraph issue (#17115)

* feat: updated multi pipeline ui as per new mock (#17106)

* feat: updated multi pipeline ui as per new mock

* translation sync

* fixed failing unit test

* fixed playwright test

* fixed viewService click issue

* sorted pipeline based on test case length

* Added domo federated dataset support (#17061)

* fix usernames (#17122)

* Doc: Updated Doris & Redshift Docs (#17123)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Fix #12677: Added Synapse Connector - docs and side docs (#17041)

* Fix #17098: Fixed case sensitive partition column name in Bigquery (#17104)

* Fixed case sensitive partiion col name bigquery

* update test

* #13876: change placement of comment and close button in task approval workflow (#17044)

* change placment of comment and close button in task approval workflow

* minor change

* playwright test for the close and comment function

* supported ref in activityFeedEditor

* fix playwright test

* added playwright test for data steward

* fix the test for the data streward user

* fix the close button not showing if task has no suggestions and icon fixes

* fix sonar issue

* change glossary and add suggestion button to dropdown button

* fix the glossary failure due to button change

* icon change for add tag and description

* fix glossary cypress failure due to button chnages

* changes as per comments

* MINOR: docs links fix (#17125)

* alation link fix

* dbt yaml config source link fix

* bigquery doc fix

* Explore tree feedbacks (#17078)

* fix explore design

* update switcher icon

* show menu when search query exists

* fix selection of active service

* fix type error

* fix tests

* fix tests

* fix tests

* MINOR: Databricks view TableType fix (#17124)

* Minor: fixed AUT test (#17128)

* Fix #16692: Override Lineage Support for View & Dashboard Lineage (#17064)

* #17065: fix the tags not rendering in selector after selection in edit tags task (#17107)

* fix the tags not rendering in selector after selection in edit tags taks

* added playwright test

* minor changes

* minor fix

* fix the tags not updating in edit and accept tag

* fix explore type changes for collate (#17131)

* MINOR: changed log level to debug (#17126)

* changed log level to debug

* fixed type

* changed type to optional

* Get feed and count data of soft deleted user (#17135)

* Doc: Adding OIDC Docs (#17139)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Doc: Updating Profiler Workflow Docs URL (#17140)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* fix playwright and cypress (#17138)

* Minor: fixed edit modal issue for sql test case (#17132)

* Minor: fixed edit modal issue for sql test case

* fixed test

* Minor: Added whats new content for 1.4.6 release (#17148)

* MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)

* fix: raise for triggering system app

* added scheduleType ScheduledOrManual

* minor: remove "service" field from required properties in createAPIEndpoint schema (#17147)

* initial commit multi ownership

* update glossary and other entities

* update owners

* fix version pages

* fix tests

* Update entity_extension to move owner to array (#17200)

* fix tests

* fix api page errors

* fix owner label design

* locales

* fix owners in elastic search source

* fix types

* fix tests

* fix tests

* Updated CustomMetric owner to entityReferenceList. (#17211)

* Fix owners field in search mappings

* fix search aggregates

* fix inherited label

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 9

* Fix QUeries

* Fix Mysql Queries

* Typo

* fix tests

* fix tests

* fix tests

* fix advanced search constants

* fix service ingestion tests

* fix tests

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: k.nakagaki <141020064+nakaken-churadata@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: harshsoni2024 <64592571+harshsoni2024@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
2024-07-30 08:06:39 +02:00
Mayur Singal
a39b59b6b4
FIX #17206: Dynaomodb pagination type fix (#17226) 2024-07-30 10:39:20 +05:30
Ayush Shah
e9f66e26b4
Bump Setuptools version (#17225) 2024-07-30 10:20:05 +05:30
Ayush Shah
34c572334e
Fixes #14945: FiveTran Improvements (#17169) 2024-07-30 10:16:47 +05:30
Ashish Gupta
be1d5a2a31
MINOR: support entity icon from classBase (#17223)
* support entity icon from classBase

* minor changes
2024-07-29 21:50:47 +05:30
Shailesh Parmar
72fd62a14b
Feat: overview tab supporting file changes (#17066)
* Feat: overview tab supporting file changes

* added unit test for profilerClassBase

* feat: Add data quality report API endpoint

The code changes in this commit add a new API endpoint for retrieving data quality reports. The `getDataQualityReport` function is added to the `testAPI.ts` file, allowing users to fetch data quality reports by providing query parameters such as `q`, `aggregationQuery`, and `index`. This feature enhances the data quality monitoring capabilities of the application.

* added unit test for tableProfiler component
2024-07-29 20:24:11 +05:30
Siddhant
f1c1615c0d
[Initial draft] Alert Destination Test Functionality (#17207)
* Implemented TemplateProvider.

* validating templatePlaceholders.

* Refactor: Update query to fetch documents for EmailTemplate type. Implemented a function that retrieves documents from doc_store for documents of type "EmailTemplate". This function returns the email template content.

* revert commit.

* revert commit.

* revert commit.

* initial draft test alert functionality.
2024-07-29 19:55:17 +05:30
Ashish Gupta
5ac45622c0
fix the ui breaking because of description feed (#17222) 2024-07-29 18:13:21 +05:30
Prajwal214
3b9362366b
Doc: Updating Airflow Service Connection Docs (#17163)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-07-29 17:10:28 +05:30
Akash Jain
92466c52f5
fix: Do not Update Docker Image Tags (3 digits) on RC Releases (#17218)
* fix: Do not Update Docker Image Tags (3 digits) on RC Releases

* chore(testing): Mark Push as `false`

* chore: Update Input Descriptions for ingestion publish workflows

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: simplify docker image tags

* fix: Do not Update Docker Image Tags (3 digits) on RC Releases

* chore(testing): Mark Push as `false`

* chore: Update Input Descriptions for ingestion publish workflows

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: Update Tags conditions

* chore: simplify docker image tags

* chore: Mark Push as `true`
2024-07-29 15:38:58 +05:30
Ayush Shah
1962ffad52
Fixes #17221: Setuptools Version Fix, Resolve Ingestion Setup Failure (#17216) 2024-07-29 15:29:25 +05:30
IceS2
c522f14178
MINOR: Refactor output_handlers to a WorkflowOutputHandler class (#17149)
* Refactor output_handlers to a WorkflowOutputHandler class

* Add old methods as deprecated to avoid breaking changes

* Extract WorkflowInitErrorHandler from workflow_output_handler

* Fix static checks

* Fix tests

* Fix tests

* Update code based on comments from PR

* Update comment
2024-07-29 09:20:34 +02:00
harshsoni2024
20754ab28a
MINOR: Athena test connection changes (#17186) 2024-07-29 12:31:47 +05:30
Prajwal214
2e32bb26ff
Doc: Updated Filter Docs (#17197) 2024-07-29 12:26:44 +05:30
Aniket Katkar
c4ab0c6191
Fix #16585: Ingestion list table revamp (#17136)
* Add new ingestion list component

* localization changes

* Add new icons

* localization changes

* Revamp the ingestion list table

* update the pipeline actions styling

* Improve the ingestion list table functionality

* localization changes

* Fix failing unit tests

* Use the new IngestionListTable component

* localization changes

* Implement new IngestionListTable component in the Services list pipeline tab

* Improve ingestion list table functionality and modify unit tests

* localization changes

* Fix the e2e tests for new ingestion changes

* changes suggested in comments

* Minor bug fixes and improvements

* Change default schedule value from hour to daily

* revert test changes

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-07-29 11:25:08 +05:30
Onkar Ravgan
c03f47118b
unify tableau datamodels (#17185) 2024-07-29 10:32:29 +05:30
Onkar Ravgan
b6745d7cf1
MINOR: Implemented SAPERP Connector feedback (#17137)
* Implemented saperp feedback

* Fixed pytest
2024-07-29 10:31:20 +05:30
Mohit Yadav
c6e7938e47
[Issue-16343]Activity Feed Improvements (#17086)
* Add entityRef in Thread_entity

* fix testCase breadcrumb, profile pic and supported entity reference

* fix sonar

* fix feed reseting on deleting comments

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-07-28 05:25:06 -07:00
Ashish Gupta
464d6cab72
MINOR: filter out glossary term option of same term in the related term (#17213)
* filter out glossary term option of same term in the related term

* fix sonar
2024-07-28 17:38:49 +05:30
sonika-shah
e93bf7024f
Fix isParent method to correctly identify FQN parent-child relationships (#17208) 2024-07-27 08:22:06 -07:00
Prajwal214
87c302ebf7
Doc: Updated Security Docs (#17179)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-07-27 08:15:18 -07:00
Sriharsha Chintalapani
79dcd20357
Minor: add bindHost to configure the host ip for OpenMetadata Server (#17153) 2024-07-27 08:13:31 -07:00
Mayur Singal
8b9d8aad91
MINOR: Fix postgres conftest import (#17210) 2024-07-27 18:08:42 +05:30
Shailesh Parmar
b9e57c71e8
Minor: fixed test case and mysql query bug (#17205) 2024-07-27 10:39:13 +05:30
Shailesh Parmar
10040a2e8d
Minor: Added Ai learning banner if data is not accurate (#17198)
* Minor: Added Ai learning banner if data is not accurate

* fixed failing test cases
2024-07-27 10:31:52 +05:30
Imri Paran
a681c5184b
tests(unit): use absolute paths (#17193)
use absolute paths when loading files in unit tests
2024-07-26 20:15:34 +05:30
Ashish Gupta
addf7ef565
fix the task aut failure (#17188) 2024-07-26 20:05:09 +05:30
Sachin Chaurasiya
b486676d1d
Minor: description code block copy button should work properly (#17194) 2024-07-26 19:00:04 +05:30
Imri Paran
f696a3603b
chore: prerequisites scripts (#17146)
added support for docker 20-29
2024-07-26 18:59:50 +05:30
Imri Paran
9132902ba1
MINOR: docs: explicit install command (#17199)
* docs: explicit install command

added `pip install openmetadata-ingestion` to the external ingestion guide

* added to all versions
2024-07-26 14:41:10 +02:00
Suman Maharana
80aa9fd80f
Fix: bigquery e2e test fix (#17192) 2024-07-26 16:14:31 +05:30
Karan Hotchandani
3bcd481453
allow dropping off pipeline as node (#17020)
* allow dropping off pipeline as node

* Return Pipeline Nodes in Response

* Fix pipeline as a node

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2024-07-26 15:54:38 +05:30
Imri Paran
cb57941b5f
MINOR: copy data to sql server container instead of using volumes (#17191)
* copy the data files to the containers instead of using volume binds

* format
2024-07-26 10:12:04 +00:00
Imri Paran
9e67d12ab5
fix: change deploy failure message (#17164) 2024-07-26 11:56:56 +02:00
Teddy
ab7b1a444c
[GEN-976] Generic Aggregation Endpoint for Data Quality Reports (#17181)
* fix: added parser for aggregation queryParams

* feat: added generic aggregation logic

* feat: added DQ generic aggregation endpoint

* fix: typo in resources description
2024-07-26 15:23:10 +05:30
Sachin Chaurasiya
0e3cf02618
feat(#10933): API service UI (#17003)
* feat(#10933): API service UI

* feat: Add support for API collections in multiple languages

* feat: add collection page

* feat: Add support for multiple languages in endpoint-plural translation

* chore: Add 'Beta' tag to API Services card, mark 'REST' service as beta, hide Pipelines tab, and update API Schemas card in settings.

* fix: api service version page to show list of collections

* feat: add api collect version page

* feat: add custom property support for api collections and endpoints

* feat: Add API Collection and API Endpoint translations in multiple languages

* Refactor proxy configuration to use '/api/' context instead of '/api/v1'

* feat: add apiEndpoint page

* feat: add APIEndpoint summary component

* feat: add APIEndpoint schema component

* chore: remove the schema type from APIEndpointSchema component

* feat: add version page component for API endpoint

* chore: add task support for api collection and api endpoint

* chore: remove schema from request and response label

* chore: don't show add ingestion button for api services

* feat: add search support for api entity

* feat: add request and response schema field translations for multiple languages

* chore: update icons

* refactor: Add null checks in EntityUtils.tsx

* feat: show deleted child entities if service is deleted

* chore: Update addApiEndpointFollower function in apiEndpointsAPI.ts

* feat: Add API collection and endpoint retrieval in EntityPopOverCard.tsx

* chore: add api endpoint in data assets widget

* feat: Add extra info link in data assets header

* chore: Add API endpoint index to DataAssetsWidget test

* feat: add api endpoint to explore tree

* test: add cypress for apiendpoint and apicollection custom property

* test: add playwright test for api service entity

* test: add playwright test for api collection entity

* test: Add ApiEndpoint playwright test

* test: fix api endpoint and api collection test

* fix: minor issues

* test: add playwright test for creating service from ui and explore page tree

* test: add playwright test for api endpoint lineage

* feat: Update API collection page to use specific fields for owner, tags, and votes

* test: remove api endpoint class from linage spec
2024-07-26 14:31:17 +05:30
Teddy
1ed279039b
fix: typo in DQ migration filter (#17183) 2024-07-26 06:19:50 +00:00
Prajwal214
4ad652a79d
Doc: Updated Teams Typo in Docs (#17172)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-07-26 11:25:13 +05:30
Shailesh Parmar
58a6751dd3
Minor: added test case graph filters (#17184) 2024-07-26 10:14:14 +05:30
Chirag Madlani
21579b13d3
minor: hide username field on signup screen (#17144)
* minor: hide username field on signup screen

* add tests

* fix cypress for owner search

* fix data quality and profiler spec
2024-07-25 21:46:40 +05:30
Suman Maharana
77529d4fa0
Minor: Fix tableau e2e changed filter count (#17180) 2024-07-25 21:01:04 +05:30
Imri Paran
012aa9b804
MINOR: fix: scheduled apps (#17167)
* fix: scheduled apps

run scheduling procedures for apps with Scheduled or ScheduledOrManual schedule type

* format
2024-07-25 15:46:01 +02:00
Aniket Katkar
70f0268e26
Fix the AdditionalRuleSearch spec flakiness for AUT (#17129) 2024-07-25 18:19:42 +05:30
Chirag Madlani
befacea384
fixed: #14435 support download option for ingestion logs (#17176)
* support download option for ingestion logs

* fix tests
2024-07-25 09:27:55 +00:00