* Implement the workflow status based placeholders for PlatformInsights widget
* Add the workflow status banner
* feat(ui): enhance ingestion components with collate agent functionality
- Added support for loading and displaying collate agents in the Ingestion component.
- Updated Ingestion interface to include new props for collate agent management.
- Implemented loading state for ingestion runs and collate agents in IngestionListTable and IngestionRecentRuns components.
- Integrated pagination handling for collate agents in ServiceDetailsPage.
- Improved rendering of pipeline types in IngestionListTable utility functions.
* feat(ui): enhance Ingestion component with agent counts display
- Added agentCounts prop to Ingestion component to display counts for collate agents and metadata.
- Updated Ingestion interface to include agentCounts.
- Modified ServiceDetailsPage to compute and pass agentCounts to Ingestion.
- Improved rendering of sub-tab options in Ingestion component to utilize agent counts.
* feat(ui): update SVG assets and enhance error handling in Service Insights
- Modified existing SVG assets for improved rendering and added new icons: key-hand, no-tier, and security-safe.
- Enhanced AssetsTabs component to utilize updated placeholder icons for no data scenarios.
- Updated TotalDataAssetsWidget to display a custom error placeholder when no records are found.
- Introduced a new utility function to determine the appropriate placeholder icon based on chart type.
- Added a new CSS class for text color styling.
* feat(ui): add refresh functionality to Ingestion component
- Introduced a refresh button in the Ingestion component to reload the agents list.
- Updated Ingestion interface to include a new prop for the refresh function.
- Enhanced ServiceDetailsPage to implement the refresh logic for different agent types.
- Added styling for the refresh button icon in the associated LESS file.
* localization changes
* feat(ui): refactor ingestion components for improved status handling and styling
- Moved query parameter definitions into relevant functions for better encapsulation in IngestionListTable and IngestionRecentRuns components.
- Updated styling for ingestion status badges to enhance visual clarity and consistency.
- Introduced new color variables for improved theming in LESS files.
- Added a delay mechanism for fetching pipeline status in MetadataAgentsWidget to account for service response times.
* Fix the duplicate variables
* Fix the less variable
* Add large table icon and update placeholder icons in Service Insights
- Introduced a new SVG icon for large tables.
- Updated placeholder icons in AssetsTabs and TotalDataAssetsWidget components to use the new icon.
- Changed the color class for placeholder icons from 'text-grey-8' to 'text-grey-14'.
- Refactored the getServiceInsightsWidgetPlaceholderIcon function to accept additional parameters for customization.
* Implement the placeholder messages for service insight widgets
* add the remaining widget descriptions for service insights
* Fix the unit tests
* localization changes
* Fix the app status not showing properly on the external apps logs page
* add createdBy field in test case results
* Fixed sonar issues
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
* Fix#20200: Import/Export recursively at Database Service, Database, Schema
* Recursive import/ export - Fixed errors
* Recursive import - Column not getting updated fixed
* Bug fix - Error message when data length not given for varchar
* Recursive import: Flag added, parsing errors solved
* recursive import: fixed bugs and tests
* added recursive flag for bulk/edit import/export and created entity type filter for easy access
* dismiss the loading state if, dry run fails and websocket doesn't have error in it
* Recursive false for bulk edit
* Recursive import: db service level
* Recursive import: fixed tests
* Recursive import: bug fix
* Recursive import: fixed bug
* support recursive validation and skip bulkImport playright spec and fix some bulk edit playwright test
* Recursive import: bugs
* Recursive import: nested entity bug
* Data type made mandatory for column
---------
Co-authored-by: aji-aju <ajithprasad770@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* fix: use current change summary
Use change summary whenever capturing an update even for non-tracked fields
* added another assertion for good measure
* Search issues: Revert to using queryStringBuilder
* Search issues: Revert to using queryStringBuilder
* Search issues: Revert to using queryStringBuilder
* Fix#19667: OpenSearch Connector
* Fix#19667: OpenSearch Connector
* do not ingest any system level indexes
* fix pyformat
* Add AWS auth
* Use common schema and fix ssl config in client
* Add openseach connector docs and update schema
* Remove api key auth type and complete docs checklist
* Remove unnecessary httpx dependency and pyformat
* Add compatible version of httpx for elasticsearch
* Fix pylint fails and py-tests validation error
---------
Co-authored-by: Mohit Tilala <tilalamohit123@gmail.com>
Co-authored-by: Mohit Tilala <63147650+mohittilala@users.noreply.github.com>
* update the service data insights charts to give percentage data
* fix the quey_cost_record_search_index not found error
* Fix java checkstyle
* Refactor Service Insights Tab and Widgets for Enhanced Data Visualization
- Updated ServiceInsightsTab to utilize new date utility functions for fetching chart data.
- Modified chart data structure to include percentage changes and current percentages.
- Enhanced PlatformInsightsWidget to display percentage values and improved tooltip functionality.
- Added new styles for better layout and responsiveness in TotalDataAssetsWidget.
- Removed unused SERVICE_INSIGHTS_CHART constant and integrated its logic directly into the fetching process.
- Introduced new enums for additional chart types in DataInsight.
This refactor aims to improve the clarity and usability of the service insights data presentation.
* Localization changes
* Fix the platform insights chart colors
* Make the insights tab as default for service details page
* Enhance Ingestion Component and List Table
- Added logic to conditionally render search dropdowns based on the selected sub-tab in the Ingestion component.
- Increased column widths for 'type', 'count', and 'action' in the IngestionListTable for better visibility.
- Adjusted scroll width in the IngestionListTable to accommodate new column sizes.
- Updated styles in metadata-agents-widget.less to ensure vertical alignment of table cells.
- Modified applicationAPI to include agentType in the application list parameters.
- Enhanced router utility to support sub-tab routing.
These changes aim to improve the user experience and layout of the Ingestion settings.
* Fix the playwright failures
* Fix the playwright tests
* fix notification alert flakiness
* Fix metadata agents table header styling
* localization changes
* Fix the flaky test
* MINOR - Add AgentType to apps
* MINOR - Add AgentType to apps
* update the types according to the schema
* Fix the search lineage request schema
* Add pipelineStatuses field in the ingestionPipelineIndex
* Add MetadataAgentsListWidget
* Localization changes
* added list for app runs by service id
* use `$.services` path
* propogate services field
* Fix the ci type errors
* java format
* use `getJobDetail().getJobDataMap()` instead of `getMergedJobDataMap()`
* Fix the playwright and unit tests
* Fix the service version page playwright failures
* Fix sonarcloud
* Fix the unit tests
* Fix the errors
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: sushi30 <imri.paran@gmail.com>
* apply database defaults
* apply filter patterns for other db connectors
* defaults for dashboard connectors
* defaults for api, messaging service
* mlmodel, pipeline service defaults
* search, storage service defaults
* metadata connectors
* Add Default filters step in add service form
* localization changes
* Add the Default filter step in edit connection form
* Fix unit tests
* Fix generated types
* Update the types according to new json changes
* Fix the superset connector form issue
* localization changes
* Fix the filter pattern not showing properly on edit ingestion page
* Fix the playwright tests
* Fix the playwright tests
* Fix the unit test
* Add Default Filters to Create Ingestion Pipeline
* Fix the playwright tests
* merge "origin/main" into collate-issue-1047
* Update the add service flow to trigger the day 1 app on service creation
* Fix the entity type
* Fix the playwright and unit tests
* Fix sonarcloud issues
* Fix ApiServiceRest playwright test
---------
Co-authored-by: harshsoni2024 <harshsoni2024@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* fix: revert param logic in search/list and introduce raw query param
* unskip the playwright test related to DQ
---------
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* Expose Workflow Stage Status and Bring OneDayApp to OSS
* Fix Migrations
* Change Bot and add comment
* Fix checkstyle
* Initial idea for triggering app manually
* Remove merge conflics rows
* Remove merge conflics rows
* Allow to Trigger DayOneApp Manually. Change its Trigger to NoOp
* add docs
* back to main
* Actually take into account the active status
* Fix the generated types
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
