* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name
* Change GET APIs to PUT apis #8687
* change request type for registration
* Data Insight Index should be created on the server start, if not exist
* checkstyle fix
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Services sensitive passwords fields are stored in secrets store
* Update services on application startup in case of changes in the JSON Schema
* Minor changes after manual test
* Bots sensitive passwords fields are stored in secrets store
* Ingestion pipeline sensitive passwords fields are stored in secrets store
* Fix Java style
* Add update for ingestion pipelines on start up
* Add pylint exception
* Fix broken test
* Update UI references
* Services sensitive passwords fields are stored in secrets store
* Update services on application startup in case of changes in the JSON Schema
* Minor changes after manual test
* Bots sensitive passwords fields are stored in secrets store
* Fix Java style
* Mapping from kpi to dichart(One to one)
* Mapping from kpi to dichart(One to one)
* Removed second tests creating KPI
* Fix some ui improve as well
* review comment changed function name
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name
* Change GET APIs to PUT apis #8687
* change request type for registration
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* Services sensitive passwords fields are stored in secrets store
* Update services on application startup in case of changes in the JSON Schema
* Minor changes after manual test
* Removed part of the secrets manager implementation in the server side
* Removed part of the secrets manager implementation in the openmetadata python library side
* Remove deprecated test
* Address pylint checks
* Address new pylint checks
* Address PR comments
* Fix import on airflows apis
* Clear singleton instances for running Ometa secrets manager test
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config
* Add Amundsen config
* Changed SystemService to MetadataService
* Change to MetadataConnection
* Fixed failing test
* Fixed Failing test
* Added Metadata Service Test
* Bootstrapped Openmetadat service
* checkstyle fix
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* added domo to test subpackage
* cleaned up branch by removing commit from issue-8353 that were not merged in main
* Added web analytics data refinement
* Added get_status function
* Added from __futur__ for typing
* Added dailyActiveUsers aggregation
* Added page views entities aggregation and active users aggregation
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* Fix pageViewEvent import issue
* Changed dataType to PERCENTAGE and NUMBER
* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#6141: Ingestion Pipeline Status Updates
* List Pipeline Status API & Improvements
* Rename State field to PipelineState in UI
* Convert Pipeline Status array to single object
* fix braking UI
* Rebase Fixes
* Profiler, TestStuite & DataInsigts Pipeline
* py_format
* fix logs page not loading
add pipelineStatus endpoint
* fix recent run changes
* Fix Tests
* address review comments for ui
* fix failing checks
* fix unit tests
* fix cypress test
* remove loader test as not using it
* wait for API when we click on the tab
* fix cypress waitFor api
* fix failed cypress tests
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fixed#8239: Query mismatch while searching for - and _ makes data overlap
* Fixed#8239: Query mismatch while searching for - and _ makes data overlap
* Fixed#8354: Support Login For User from multiple devices with different refresh tokens
* Fixed#8354: Support Login For User from multiple devices with different refresh tokens
* Add logical query builder and Explore page refactor
* Add file headers
* Change search aggreagation keys
* Move query builder utils, remove comments
* Add comments
* Rename AdvancesSearch.constants.ts
* Add review changes
* Handle deleted elements correctly in Explore
The `deleted` field needs special handling because `showDeleted === false` should return only documents where `deleted` is false, but `showDeleted === true` should return documents regardless of their `deleted` field.
* Fix facet filter issue
Issue was the following: the user set a facet filter on `aggregationKey` and `value`. Then user changes the query builder so that in the new result there is no bucket in `aggregationKey` with `value`. The facet filter would still be used, but not visible to the user and not removable.
* Fix facetFilter tests
* Move isFilterObject type guard
* Use antd tabs for Explore component
* fix cypress failure
* miner fix in cypress
* fix typo
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
* added data insight module to refine and ingest data
* Added json schema for data insight workflow
* Added mixin for data insight
* Added tests for data insight workflow and methods
* Fixed python style
* Fixed python linting
* Fixed unit test
* Added data insight worflow + workflow logging
* Fix python style
* Renamed analytic -> data_insight + added test to make + fixed style
* Fixed java style
* Fixed code smells + python style
* Ignore ES linting for now
* Fixed comments from review
* fix python formatting
* Fixe PipelineType attribute for data insight
* Fixes#8326 Add roles to system bots during initialization and use policy based authorization for bots
* Remove var usage and instead use specific types for variables
* Fix bot can't create entities
