11098 Commits

Author SHA1 Message Date
Shailesh Parmar
ec3f9cf9e8
Feat: Data quality dashboard (#18146)
* Feat: Move data quality page tabs to left panel

* fixed failing unit test

* fixed failing playwright

* added support for dashboard in enum

* Add support for dashboard in enum and custom pie chart component

- Added support for dashboard in enum by creating a new file `Chart.constants.ts` and exporting the constant `CHART_BASE_SIZE`.
- Updated the `Chart.interface.ts` file to include the `CustomPieChartData` type and the `CustomPieChartProps` interface.
- Added a new file `CustomPieChart.component.tsx` to implement the custom pie chart component.
- Updated the `Color.constants.ts` file to import the `DEFAULT_THEME` from `Appearance.constants`.
- Added a new file `TestCaseStatusPieChartWidget.component.tsx` to implement the test case status pie chart widget.

Related to #18155

* Refactor: Update language translations and add initial entity health matrix

This commit refactors the language translations in the UI, specifically adding translations for "Healthy" and "Unhealthy" in multiple languages. Additionally, it introduces the initial entity health matrix, which includes the counts for healthy and unhealthy entities.

* Refactor: Update language translations and add initial entity health matrix

- Refactor the code to update language translations and add an initial entity health matrix.
- Add a new constant `INITIAL_ENTITY_HEALTH_MATRIX` to represent the initial health matrix of entities.
- Add a new constant `INITIAL_DATA_ASSETS_COVERAGE_STATES` to represent the initial coverage states of data assets.

* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget

* Refactor: Update language translations and add initial entity health matrix, added open incident area chart widget

* Refactor: Add IncidentTimeChartWidget component and related interfaces

This commit adds a new component called IncidentTimeChartWidget, which is responsible for displaying a chart widget related to incident time metrics. It also includes the necessary interfaces for the component.

The IncidentTimeChartWidget component fetches incident time metrics data from the server and displays it in a custom area chart. It calculates the average time value based on the fetched data and renders it along with the chart.

The commit also includes updates to the Chart.interface.ts and CustomAreaChart.component.tsx files to support the new component.

Issue #TBD

* Refactor: Update language translations and add resolution time and response time translations

* Refactor: Add TestCaseStatusAreaChartWidget component and related interfaces

* implemented filters for dq dashboard

* added description for menu

* move default tab view logic to classBase

* Refactor color variables and add unit test for utility function

* added unit test for dataQualityDashboardAPI

* added unit test for new component

* added unit test for new component

* updated the UI

* added unit test

* Refactor date formatting in KPIChart and DataQualityUtils

This commit refactors the date formatting in the KPIChart component and the DataQualityUtils module. In the KPIChart component, the tickFormatter function in the XAxis component is updated to use an arrow function instead of the formatDate function. In the DataQualityUtils module, the formatDate function is modified to support UTC formatting when necessary. Additionally, two functions, getStartOfDayInMillis and getEndOfDayInMillis, are added to the DateTimeUtils module to calculate the start and end of a day in milliseconds.

* fixed failing unit test

* updated icon

* refactore the code

* update the icon for sql

* fixed java checkstyle

* fixed playwright test

* minor
2024-10-29 18:18:49 +05:30
Ashish Gupta
843f8439ce
revamp table constraint modal design (#18455) 2024-10-29 18:16:30 +05:30
Kenil Shah
aea12fe4d5
fix: update settings tab with proper values (#18453)
* fix: update settings tab with proper values

* address feedback comment
2024-10-29 10:45:05 +01:00
Teddy
4f8bf05ded
GEN 1931 - Fix entity link accepted chars (#18391)
* fix: entity link accepted characters

* fix: match all characters but `<>|::`

* fix: remove unnecessary negative lookbehind

* fix the test case search not working on add ingestion page in case of special characters in FQN

* style: ran java linting

* fix: failing testst

* style: ran java linting

---------

Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2024-10-29 10:33:08 +01:00
Suman Maharana
67a9e63439
Minor: Fixed dbtcloud test connection and improved docs (#18408) 2024-10-29 14:39:52 +05:30
Sriharsha Chintalapani
96c3364de7
Minor: Enable Azure DatabaseTokenProvider if there is azure=true in DB_QUERYPARAMS (#18451) 2024-10-29 10:01:57 +01:00
Chirag Madlani
e197c3f3d0
fix(ui): unable to add more enum values for enum cp (#18440)
* fix(ui): unable to add more enum values for enum cp

* replicate height constraint and dropdown visibility to add cp
2024-10-29 12:18:51 +05:30
Sriharsha Chintalapani
0114007a22
Parallelize the search indexing process (#18445)
* Parallelize the indexing process

* Parallelize indexing
2024-10-28 23:10:43 -07:00
Chirag Madlani
5c550e7bc3
fix(ui): navigate to listing for deleting a service (#18428) 2024-10-29 10:56:17 +05:30
Karan Hotchandani
d82d41e00a
add whats new (#18439) 2024-10-29 04:59:06 +00:00
Sriharsha Chintalapani
eeffaee9c4
Update EntityLink.g4, remove entities from EntityLink parser (#18442) 2024-10-29 10:18:49 +05:30
sonika-shah
f7e09487b5
Fix - Consistent case handling for explore page filters (#18418) 2024-10-28 15:25:37 -07:00
Suresh Srinivas
00c38323bd
Update dependencies for release 1.6 (#18444) 2024-10-28 14:52:55 -07:00
Aniket Katkar
14760021c0
Add Galego language to the localization dropdown (#18429) 2024-10-28 21:03:29 +05:30
Ashish Gupta
5b49db2c07
MINOR: fix organization data show in teams data after search (#18427)
* fix organization data show in teams data after search

* remove unsued code
2024-10-28 21:01:56 +05:30
Pere Miquel Brull
ed9b66c5c5
MINOR - Move appName migration to 1.5.9 (#18435) 2024-10-28 16:29:56 +01:00
Onkar Ravgan
4a0c8406e9
[ER Diagrams] Add ER diagram APIs and sample data (#18021)
* Add ER diag APIs and sample data

* fix pylint

* formatting fixes2

* fixed es client return

* fixed os client return

* supported TableDetailPage tabs as classBase for supporting collate only tabs

* Added schema Apis

* change the base class to .ts and move the component in the util files

* beautify function arguments

* Added optimizations

* Ingestion changes

* svg dimension change

* supported class base tab in databaseSchema

* supported classBase action button in schema table name column

* added further keys data for constraint modal

* fix sonar issue

* remove old method to override edit action on column and shifted to DisplayNameModal for fields

* supported table right panel component to further extends on collate side

* minor fix around duplicate constraint

* added support to update table constraints and column constraints in the UI

* code optimization and minor fixes

* review comments and multi col fix

* added queryFilter option in NodeSuggestion and tableConstrainst to fetch and use only in service tables

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-10-28 20:26:19 +05:30
Mayur Singal
9d91325af8
Lineage-1: Move view lineage processing to lineage workflow (#18220)
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2024-10-28 18:18:22 +05:30
Nicola Coretti
24de281026
Fix docstring in the Doris metadata module (#18421) 2024-10-28 17:58:04 +05:30
Pere Miquel Brull
de02cee7b1
MINOR - None schedules still need Ingestion Pipelines (#18425) 2024-10-28 12:44:21 +01:00
Mohit Yadav
35d1053dc0
Add Cache-Control and Pragma Header (#18406)
* Add Cache Control and Pragma to Asset Servlet

* Add on null Or Empty
2024-10-28 15:42:37 +05:30
Prajwal214
f45c5ddf5e
Docs: Adding dbt Cloud tile in connector docs (#18423) 2024-10-28 15:32:26 +05:30
RounakDhillon
f2a0f23a05
Docs: Data Insights report images updation (#18424)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-28 15:29:17 +05:30
Karan Hotchandani
534a209845
GEN-1266: Dashboard Data Models Improvements (#18351)
* fetch all custom properties

* fix database and schema filter aggregations

* add playwright tests for custom props

* fix tests

* fix tests

* wrap in try catch
2024-10-28 14:57:29 +05:30
Prajwal214
b38610896f
Docs: updating latest release to v1.5.8 (#18420)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-10-28 13:51:38 +05:30
Pere Miquel Brull
7d01373261
MINOR - Renaming MetaPilot to CollateAI (#18393)
* MINOR - Renaming MetaPilot to CollateAI

* MINOR - Renaming MetaPilot to CollateAI

* MINOR - Renaming MetaPilot to CollateAI

* MINOR - Renaming MetaPilot to CollateAI

* fix

* moving limits migrations for 1.5.9
2024-10-28 09:21:15 +01:00
Mayur Singal
ef77535f17
GEN-1664: DI Make Horizontal Axis Configurable (#18134) 2024-10-28 11:11:15 +05:30
nicolasGutierrezGarcia1970
21c78390e9
Create gl-es.json (#18414)
Hello.
From Ednon and for Galicia, Galicians and the whole community, we want to make our small contribution to this application with the Galician translation.
Greetings.
2024-10-28 10:59:04 +05:30
Sachin Chaurasiya
09e6671f2f
fix: application support link with mailto: URI schema (#18416) 2024-10-28 10:58:23 +05:30
Sriharsha Chintalapani
c1a3206538
Add bulk reads for export CSVs (#18412)
* initial draft

* Add bulk reads for export CSVs

* get parentRef and glossaryRef in bulk read

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-10-27 08:56:43 -07:00
RounakDhillon
075a36e7b4
Docs: Fixing Images for setting up insights (#18397)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-26 10:58:18 -07:00
Ashish Gupta
b93390bb8a
MINOR: supported displayName field in User listing page (#18404)
* supported displayName field in User listing page

* change the displayName to name for the consistency around name property around ui

* fix sonar issue
2024-10-25 17:59:30 +05:30
Sriharsha Chintalapani
e07bcfa2f9
Minor: Fix custom properties API and add cache (#18401) 2024-10-24 22:24:56 -07:00
Aniket Katkar
3355dd19cb
GEN-658: Update the ingestion schedular with new design (#17990)
* Update the cron-editor form to implement new design

* localization changes

* Refactor the CronEditor component

* Improvements and bug fixes for CronEditor

* localization and license header changes

* Fix the type errors

* Move the CronEditor component logic to ScheduleInterval

* Fix schedular for the test suite ingestion

* Fix the unit tests

* Fix playwright tests

* Fix the failing playwright tests

* Fix the ingestion search issue

* worked on comments and fixed playwright tests

* Remove the unnecessary isEmpty check for the cron string

* Fix the cron values for hour and min not showing correctly

* Remove the isEmpty check for cron

* Move the cron error checks to the create ingestion logic

* Fix the failing playwright

* Add the monthly schedule option

* Fix the logic for default schedule to allow default schedule as none

* fix the unit tests
2024-10-24 22:22:04 +05:30
Aniket Katkar
4d1ebb31c1
Minor: Add name field in the advanced search fields list (#18399)
* Add name field in the advanced search fields list

* Update the search index for autocomplete for name DisplayName

* removed unnecessary array for searchIndex
2024-10-24 21:09:32 +05:30
Mayur Singal
4083838056
MINOR: Couchbase Secondary Index Fix (#18398) 2024-10-24 20:34:55 +05:30
Sachin Chaurasiya
82e71363c9
docs: update list of supported custom properties type (#18396) 2024-10-24 18:14:52 +05:30
Sachin Chaurasiya
78f19d4f84
minor: improve types in ModalWithCustomPropertyEditor component (#18395)
* minor: improve types in ModalWithCustomPropertyEditor component

* fix: formatting
2024-10-24 17:47:41 +05:30
Karan Hotchandani
c8e2ed0653
add query builder widget ui improvements (#18389)
* add query builder improvements

* fix alert flicker
2024-10-24 15:47:11 +05:30
Sriharsha Chintalapani
d8f5398efb
Add Azure Token Base Authentication (#18387)
* Add azure token based auth

* Add Azure Token Base Authentication

* Update azure-auth.md

* Update azure-auth.md

* feat: Add `azure-identity-extensions` library for passwordless database connection

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Akash-Jain <15995028+akash-jain-10@users.noreply.github.com>
2024-10-24 11:29:46 +02:00
Shailesh Parmar
3ccbde8b84
Minor: Whats new content for v1.5.8 (#18388)
* Minor: Whats new content for v1.5.8

* minor fix

* addressing comment
2024-10-24 14:22:11 +05:30
Teddy
cd63a218c7
fix: added test case domain, tags and owners field to search incident index (#18380) 2024-10-24 10:46:08 +02:00
harshsoni2024
1a8bba6058
GEN-1911: Quicksight lineage source fix (#18348) 2024-10-24 11:41:37 +05:30
Imri Paran
95982b9395
[GEN-356] Use ServiceSpec for loading sources based on connectors (#18322)
* ref(profiler): use di for system profile

- use source classes that can be overridden in system profiles
- use a manifest class instead of factory to specify which class to resolve for connectors
- example usage can be seen in redshift and snowflake

* - added manifests for all custom profilers
- used super() dependency injection in order for system metrics source
- formatting

* - implement spec for all source types
- added docs for the new specification
- added some pylint ignores in the importer module

* remove TYPE_CHECKING in core.py

* - deleted valuedispatch function
- deleted get_system_metrics_by_dialect
- implemented BigQueryProfiler with a system metrics source
- moved import_source_class to BaseSpec

* - removed tests related to the profiler factory

* - reverted start_time
- removed DML_STAT_TO_DML_STATEMENT_MAPPING
- removed unused logger

* - reverted start_time
- removed DML_STAT_TO_DML_STATEMENT_MAPPING
- removed unused logger

* fixed tests

* format

* bigquery system profile e2e tests

* fixed module docstring

* - removed import_side_effects from redshift. we still use it in postgres for the orm conversion maps.
- removed leftover methods

* - tests for BaseSpec
- moved get_class_path to importer

* - moved constructors around to get rid of useless kwargs

* - changed test_system_metric

* - added linage and usage to service_spec
- fixed postgres native lineage test

* add comments on collaborative constructors
2024-10-24 07:47:50 +02:00
Mayur Singal
913072868a
MINOR: Not Include Soft Deleted Assets in DI (#18383) 2024-10-24 11:12:50 +05:30
Ayush Shah
51347a981a
fixes: Mode test connection returns data in dict instead of json (#18386) 2024-10-24 11:11:39 +05:30
Ashish Gupta
ac98deb49d
fix tags playwright failure and user flaky test (#18382) 2024-10-23 23:45:59 +05:30
dependabot[bot]
baef8c5cd6
Chore(deps): Bump http-proxy-middleware (#18376)
Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware) from 2.0.6 to 2.0.7.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases)
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/v2.0.7/CHANGELOG.md)
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.6...v2.0.7)

---
updated-dependencies:
- dependency-name: http-proxy-middleware
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-23 22:44:45 +05:30
RounakDhillon
6a845fe56b
Docs: Basic Auth Removal from Collate Menu (#18373)
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-10-23 09:37:52 -07:00
Karan Hotchandani
ef0b03d4a9
query builder improvements (#18377) 2024-10-23 18:05:17 +05:30