10894 Commits

Author SHA1 Message Date
Prajwal214
e5764fbb49
Docs: Adding Connector Docs for MicroStrategy & Lightdash (#18527)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-06 11:34:37 +05:30
Suman Maharana
426ad2000b
Fix #17778 : Databricks query run optimisation (#18467)
* Fix : Databricks query run  optimization

* Fixed dialect error

* fix get columns

* py format

---------

Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-06 10:10:01 +05:30
RounakDhillon
fffd5e593e
Docs: Images updation For Managing Team in Admin Guides (#18514)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-06 10:05:12 +05:30
IceS2
dccba20101
Return s3 endpoint as str() instead of Url (#18521) 2024-11-05 17:39:50 +00:00
Sriharsha Chintalapani
e9a888fce7
Fix tests (#18494)
* Fix TestCaseResource testCaseInheritedFields

* Fix TableResourceTest

* Fix tests

* remove setInheritedFields in listing of search entities

* Fix tests

* remove unique entity name creations

* add specific names in search listing tests

* add large size for fetching from ES, as other tests adds to the table_search_index

* Fix tests

* fix tests
2024-11-05 08:55:02 -08:00
Katarzyna Kałek
47c75fe6a7
Enhanced Glue ingestion with external table features (#18511)
* added fileFormat, locationPath and external table lineage to Glue ingestion

* Improve Lineage Label

---------

Co-authored-by: Katarzyna Kałek <kkalek@olx.pl>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-05 21:48:20 +05:30
Ashish Gupta
76a257f3aa
MINOR: fix create admin page data and fields (#18458)
* fix create admin page data and fields

* fix issue around adminFlag undefined

* remove roles filed in case of admin listing game

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2024-11-05 20:11:27 +05:30
Sriharsha Chintalapani
b763091bf6
Make Export CSV Async API, websocket to push data back (#18497)
* Make Export CSV Async API, websocket to push data back

* ui: implement csvExportChannel to receive entity export data via websocket

* ui: update flow to show dialogbox with the response message and once data is available download the file

* minor: remove unused code

* ui: show inline banner for success and error message

* remove unused locale keys

* ui: clear existing csvexport job on sucess

* fix failing UserResourceTest

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-11-05 18:32:41 +05:30
RounakDhillon
a6b5fdc0c2
Docs: Images Updation for Admin Guide Ingest Metadata (#18489)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-05 07:54:43 +05:30
Imri Paran
84391e7078
MINOR: tests: fix Tuple in bigquery e2e cli (#18499)
* tests: fix Tuple in bigquery e2e cli

* tests: fix Tuple in bigquery e2e cli

* fix workflow condition
2024-11-04 09:54:10 -08:00
Teddy
3353dd3462
fix: add entityFQN to incident index (#18504) 2024-11-04 18:11:41 +01:00
Sriharsha Chintalapani
f2c9bc6108
Add LineageSettings to control Lineage Default depth, layers (#18498) 2024-11-04 08:50:43 -08:00
sonika-shah
d5497ec2ac
Set max_analyzed_offset in HighlightBuilder to Fix Highlighting Errors for Large Fields (#18495)
* Set max_analyzed_offset in HighlightBuilder to Fix Highlighting Errors for Large Fields

* fix java checkstyle

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-11-04 15:26:49 +05:30
Shailesh Parmar
7f2240698b
Feat: supporting pr for incident manager widget feature (#18488) 2024-11-04 10:41:39 +05:30
Sriharsha Chintalapani
680ace99b3
Fix #18332: Do not consolidate changes for Parent Entities (#18333)
* Fix #18332: Do not consolidate changes for Parent Entities

* Fix #18332: Do not consolidate changes for Parent Entities

* added no data placeholder when no tags there

* fix failing playwright test due to consolidation changes and added the missing services

* Fix tests

* Fix parent entity change notifications

* Fix tests

* Fix parent entity change notifications

* Fix tests

* Fix tests

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-10-31 11:48:46 -07:00
Imri Paran
2539ffa8de
MINOR: fix e2e python job (#18473)
* ci(py-cli-e2e): remove job id from link

remove job id from link. it doesn't work for matrix

* fix the condition for env.DEBUG
2024-10-31 17:14:35 +01:00
Aniket Katkar
7163f8e91a
Add the missing docs pages and images for SAP ERP connector (#18490) 2024-10-31 19:43:51 +05:30
Karan Hotchandani
68499f87d5
Prep 1.5.10 release (#18487) 2024-10-31 12:10:33 +01:00
Siddhant
4f5bfa8549
fix migration, source column NOT NULL constraint on consumer_dlq (#18485) 2024-10-31 14:10:19 +05:30
RounakDhillon
47ba305b8d
Docs: Automation Step Updation (#18407)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-31 13:56:21 +05:30
Teddy
9a685d5f19
fix: pass row and result computation for inSet test (#18466) 2024-10-31 08:15:18 +00:00
Nicola Coretti
7ebc62dca7
feat: Add support for exasol datasource (#17166)
* Add flake.nix

* Add lockfile for flake

* Update nix environment and document usage

* Add schema for exasol connector

* Add Exasol definitions to databaseService

* Fix error in exasol connector schema

* Add additional connection options/settings to exasol connector

* Add exasol-connector to ui

* Add depdencies for exasol-connector

* Update notes

* Update ingestion code

* Add Basic Documentation for Exasol Connector

* Update flake file

* Add developer notes

* Add python script which can be used as entry point for debugging in ide

* Add config file which can be used for debugging (manual execution)

* Update debug script

* Update developer notes

* Remove old developer notes

* Add .venv to gitignore

* Update dev notes

* Update development notes

* Update ExasolSource

* Establish basic connection to Exasol DB from connector

* Update exasol connector connection settings

* Add service_spec for exasol plugin

* Remove development files

* Remove unused module

* Applied code formatter

* Update exasol dependency constraint(s)

* Add unit test for exasol connection url(s)

* Fixed test expectations for exasol connection url test(s)

* Adjust the test query for the Exasol connection test
2024-10-31 08:11:30 +01:00
RounakDhillon
a2dda5b287
Docs: Adding Classification Images and Content Tweaks (#18472) 2024-10-31 12:29:02 +05:30
RounakDhillon
89323d0c23
Docs: DAta Insights image updation (#18422)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-31 10:34:40 +05:30
Akash Jain
8a165be461
docs: Add Docs for Azure Database Passwordless Backend Connection support (#18475) 2024-10-31 10:23:12 +05:30
RounakDhillon
d34d6f0c8f
Docs: Lineage Section Image Updation (#18379) 2024-10-31 10:16:02 +05:30
RounakDhillon
728c321b31
Docs: Adding Data Lineage Workflow Images (#18365) 2024-10-31 10:10:03 +05:30
Karan Hotchandani
a9ec754eca
Update whatsNewData.ts (#18483) 2024-10-31 09:29:27 +05:30
Karan Hotchandani
b27603837c
update 1.5.10 whats new data (#18482) 2024-10-31 09:02:08 +05:30
Karan Hotchandani
5c3ad966a1
fix empty rule state in query builder (#18481) 2024-10-31 09:01:26 +05:30
Karan Hotchandani
854c3d6cca
fix query encoding for team asset query (#18480) 2024-10-31 08:58:12 +05:30
Siddhant
f0fc482c46
Fixes #17718 : Notification Debuggability (#18199)
* create EventSubscriptionDiagnosticInfo

* API for failedEvents

* migrations

* add index on source

* list all failedEvents optionally filtered by source

* refactor

* refactor

* getSuccessfullySentChangeEventsForAlert API

* increase defaultValue of limit to 100

* resolve conflicts

* listEvents API with 'failed', 'successful,' and 'unprocessed' query parameters

* fix description

* eventSource as enums

* refactor name.

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2024-10-30 11:55:51 -07:00
Ashish Gupta
23f13818a1
improvement around table constraint modal and added beta tag in tabs (#18469)
* improvement around table constraint modal and added beta tag in tabs

* supported localization key

* improvement around beta tag css

* supported dataType icons for columns

* remove beta flag from the tested tabs

* change icon make as per file standard
2024-10-30 22:17:02 +05:30
Karan Hotchandani
a47235581f
add debounce on autocomplete in advanced search (#18471) 2024-10-30 20:44:37 +05:30
Prajwal214
ba4a480bf1
Docs: Fixing Ingestion Docs (#18474)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-10-30 17:16:53 +05:30
Prajwal214
939bd70e3b
Docs: Updating Airflow Supported Version (#18419) 2024-10-30 16:55:18 +05:30
sonika-shah
b42e211d29
Feat - Add import/export custom property for other entities - databaseService, database, databaseSchema level (#18385)
* Feat - Add import/export custom property for other entities - databaseService, database, databaseSchema level

* Fix java checkstyle

* Fix dbService level export

* minor: improve the inline edit of custom property

* minor: improve the number type icon

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-30 16:32:47 +05:30
IceS2
57c22b5fbe
Initial JSONSchema specification for Asset Certification (#18392)
* Initial JSONSchema specification for Asset Certification

* Add backend logic to updateCertification

* Add Tests for Asset Certification

* Update certification config and set defaults

* Fix Checkstyle

* Fix Tests

* Fix checkstyle
2024-10-30 11:40:39 +01:00
Chirag Madlani
289404748a
fix(ui): block multiple paging req while fetching data (#18436) 2024-10-30 14:05:44 +05:30
Imri Paran
4c3a784f7c
MINOR: fix debug resolution in e2e python github workflow (#18437)
* fix debug default

* fixed expression

* test inverted expression

* test inverted expression

* added description

* added logging for inputs debug, debug

* fixed debug condition

* added github ref

* added github ref
2024-10-30 08:37:56 +01:00
RounakDhillon
fe4c63c210
Docs: Clasify Data Images Updation (#18462) 2024-10-30 10:30:44 +05:30
RounakDhillon
e5f86ccd6b
Docs: Glossary term images updation (#18431)
* Docs: Glossary term images updation

* Docs: Glossary term content changes

---------

Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-30 10:25:59 +05:30
Sriharsha Chintalapani
572822e36a
Minor: add versions to maven build plugins (#18443)
Co-authored-by: Suresh Srinivas <srini30005@gmail.com>
2024-10-29 18:54:50 -07:00
Imri Paran
016a840b2f
MINOR Fix snowflake profiler by using case-insensitive strings (#18438)
* use snowflake system metrics computer instead of source

* reverted pylint

* use case-insensitive strings equality for snowflake filters
2024-10-29 18:33:36 +01:00
Pere Miquel Brull
ed7b1c7b95
DOCS - Fix release title (#18465)
* DOCS - Prep 1.5.9 release

* DOCS - Fix release title
2024-10-29 17:14:45 +01:00
Pere Miquel Brull
579469347c
DOCS - Prep 1.5.9 release (#18463) 2024-10-29 16:43:15 +01:00
Shailesh Parmar
ec3f9cf9e8
Feat: Data quality dashboard (#18146)
* Feat: Move data quality page tabs to left panel

* fixed failing unit test

* fixed failing playwright

* added support for dashboard in enum

* Add support for dashboard in enum and custom pie chart component

- Added support for dashboard in enum by creating a new file `Chart.constants.ts` and exporting the constant `CHART_BASE_SIZE`.
- Updated the `Chart.interface.ts` file to include the `CustomPieChartData` type and the `CustomPieChartProps` interface.
- Added a new file `CustomPieChart.component.tsx` to implement the custom pie chart component.
- Updated the `Color.constants.ts` file to import the `DEFAULT_THEME` from `Appearance.constants`.
- Added a new file `TestCaseStatusPieChartWidget.component.tsx` to implement the test case status pie chart widget.

Related to #18155

* Refactor: Update language translations and add initial entity health matrix

This commit refactors the language translations in the UI, specifically adding translations for "Healthy" and "Unhealthy" in multiple languages. Additionally, it introduces the initial entity health matrix, which includes the counts for healthy and unhealthy entities.

* Refactor: Update language translations and add initial entity health matrix

- Refactor the code to update language translations and add an initial entity health matrix.
- Add a new constant `INITIAL_ENTITY_HEALTH_MATRIX` to represent the initial health matrix of entities.
- Add a new constant `INITIAL_DATA_ASSETS_COVERAGE_STATES` to represent the initial coverage states of data assets.

* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget

* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget

* Refactor: Add IncidentTimeChartWidget component and related interfaces

This commit adds a new component called IncidentTimeChartWidget, which is responsible for displaying a chart widget related to incident time metrics. It also includes the necessary interfaces for the component.

The IncidentTimeChartWidget component fetches incident time metrics data from the server and displays it in a custom area chart. It calculates the average time value based on the fetched data and renders it along with the chart.

The commit also includes updates to the Chart.interface.ts and CustomAreaChart.component.tsx files to support the new component.

Issue #TBD

* Refactor: Update language translations and add resolution time and response time translations

* Refactor: Add TestCaseStatusAreaChartWidget component and related interfaces

* implemented filters for dq dashboard

* added description for menu

* move default tab view logic to classBase

* Refactor color variables and add unit test for utility function

* added unit test for dataQualityDashboardAPI

* added unit test for new component

* added unit test for new component

* updated the UI

* added unit test

* Refactor date formatting in KPIChart and DataQualityUtils

This commit refactors the date formatting in the KPIChart component and the DataQualityUtils module. In the KPIChart component, the tickFormatter function in the XAxis component is updated to use an arrow function instead of the formatDate function. In the DataQualityUtils module, the formatDate function is modified to support UTC formatting when necessary. Additionally, two functions, getStartOfDayInMillis and getEndOfDayInMillis, are added to the DateTimeUtils module to calculate the start and end of a day in milliseconds.

* fixed failing unit test

* updated icon

* refactore the code

* update the icon for sql

* fixed java checkstyle

* fixed playwright test

* minor
2024-10-29 18:18:49 +05:30
Ashish Gupta
843f8439ce
revamp table constraint modal design (#18455) 2024-10-29 18:16:30 +05:30
Kenil Shah
aea12fe4d5
fix: update settings tab with proper values (#18453)
* fix: update settings tab with proper values

* address feedback comment
2024-10-29 10:45:05 +01:00
Teddy
4f8bf05ded
GEN 1931 - Fix entity link accepted chars (#18391)
* fix: entity link accepted characters

* fix: match all characters but `<>|::`

* fix: remove unnecessary negative lookbehind

* fix the test case search not working on add ingestion page in case of special characters in FQN

* style: ran java linting

* fix: failing testst

* style: ran java linting

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-10-29 10:33:08 +01:00