* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* added domo to test subpackage
* cleaned up branch by removing commit from issue-8353 that were not merged in main
* Added web analytics data refinement
* Added get_status function
* Added from __futur__ for typing
* Added dailyActiveUsers aggregation
* Added page views entities aggregation and active users aggregation
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* added domo to test subpackage
* cleaned up branch by removing commit from issue-8353 that were not merged in main
* Added web analytics data refinement
* Added get_status function
* Added from __futur__ for typing
* Fixed typos brought up during reviews
* Fix Json Schema filename
* Remove formatting
* FIx required property and change data type from array to object
* added items to array type
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Fixed: dagster to connect to cloud
* Fixed: changed test_cases
* Fixed: lineage between the assets and jobs
* Changes as per comments
* Fix python checkstyle
* Fix as per comments
* Fix added migration scripts
* minor fixes
* Moved webanalytics type in its own folder
* Added data insight chart api endpoint
* Jave formatting
* Added resource descriptor
* Added metadata entity endpoint
* Added aggregation endpoint for dataInsight
* Fix tag name
* Added logic to ingestion pipeline resource to add ES config info if pipeline type is dataInsight
* Fix pageViewEvent import issue
* Changed dataType to PERCENTAGE and NUMBER
* Cleaned up PR by removing metadata resource and ingestionPipeline sink logic
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByTier.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Update openmetadata-service/src/main/resources/json/data/dataInsight/totalEntitiesByType.json
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
* Fix#6141: Ingestion Pipeline Status Updates
* List Pipeline Status API & Improvements
* Rename State field to PipelineState in UI
* Convert Pipeline Status array to single object
* fix braking UI
* Rebase Fixes
* Profiler, TestStuite & DataInsigts Pipeline
* py_format
* fix logs page not loading
add pipelineStatus endpoint
* fix recent run changes
* Fix Tests
* address review comments for ui
* fix failing checks
* fix unit tests
* fix cypress test
* remove loader test as not using it
* wait for API when we click on the tab
* fix cypress waitFor api
* fix failed cypress tests
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* added data insight module to refine and ingest data
* Added json schema for data insight workflow
* Added mixin for data insight
* Added tests for data insight workflow and methods
* Fixed python style
* Fixed python linting
* Fixed unit test
* Added data insight worflow + workflow logging
* Fix python style
* Renamed analytic -> data_insight + added test to make + fixed style
* Fixed java style
* Fixed code smells + python style
* Ignore ES linting for now
* Fixed comments from review
* fix python formatting
* Fixe PipelineType attribute for data insight
* Fixes#8326 Add roles to system bots during initialization and use policy based authorization for bots
* Remove var usage and instead use specific types for variables
* Fix bot can't create entities
* Initial implementation of report endpoint
* Modified model files
* Added migration
* Added tests for analytics/report endpoint
* Finalized implementation of the reports endpoint
* Fixed maven test failure
* Fixed java style
* Added policy for reportDefinition
* Fixed minor typos in code
* Added database migration for web analytic event type
* Added logic for collect endpoint
* Added JSON Schema for collect endpoint
* Added index on table columns + added resource description for web event entities
* Fixed policy tests
* Updated add web analytic function to return the body of the request + updated test
* Added referer URL to PageView event
* Changed collection name to align with API endpoint
* updated initSeed method to initializeEntity
* cleaned up PR by removing unused filed from branch
* Fixed requested changes from review
* Clean up names
* Fixed comma in SQL statement
* [ES Reindex] Added ES Reindexing from API
* [ES Reindex] checkstyle
* [ES Reindex] return complete record for status info
* fixes
* added limit param to get no of records
* Review Comments + Stream mode
* Review Comments
* Fix for failing tests
* Global ES monitoring with Stream + batch mode to allow Reindexing
* Updated Status Message + Status update on ESIndexDefinition Create and Delete
Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
* Fix bot creation and edition logic
* Fix minor error creating user
* Fix failing test
* Minor fixes
* Add missing tests for new flows
* Fix put_failIfBotHasARelationshipToAnotherUser test
* Changes after manual testing
* Move where auth_provider is retrieved in the secret manager
* [Basic Auth] Updated messages , and added changepasswor
* checkstyleFix
* Added ChangePassword feature in user page
* unpushed file
* changes as per comments
* unpushed file
* close the modal on save
* Added Admin Create User Password + Logout
* revert test
* revert yaml
* Fix failing test
* Remove token on logout
* fix for test
* added api for random pwd
* update error messages as per UI
* Added password generator in user creation
* Fix issue with CP
* Fix issue with CP
* [Basic Auth] Added Brute forcing check , blocks user login for 10 mins + send update on mail
* Review Comments updated
Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* [ES Reindex] Added ES Reindexing from API
* [ES Reindex] checkstyle
* [ES Reindex] return complete record for status info
* fixes
* added limit param to get no of records
* Review Comments + Stream mode
* Review Comments
* Fix for failing tests
* Global ES monitoring with Stream + batch mode to allow Reindexing
* [Basic Auth] Updated messages , and added changepasswor
* checkstyleFix
* Added ChangePassword feature in user page
* unpushed file
* changes as per comments
* unpushed file
* close the modal on save
* Added Admin Create User Password + Logout
* revert test
* revert yaml
* Fix failing test
* Remove token on logout
* fix for test
* added api for random pwd
* update error messages as per UI
* Added password generator in user creation
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
* [ES Reindex] Added ES Reindexing from API
* [ES Reindex] checkstyle
* [ES Reindex] return complete record for status info
* fixes
* added limit param to get no of records
* Review Comments + Stream mode
* Review Comments
* Fix for failing tests
* Update JSON schemas
* Update create and update endpoint and remove /generateToken endpoint
* Add AuthMechanism and Token Expiry Field on the Add bot page
* Remove unwanted tests
* Add logic to show authMechanism based on auth provider
* Add authConfig to bots details page
* Backend implementation with secret manager
* Fix invalid date issue
* Add support for update bot token details
* Add logic for SSO auth
* Add fields for google sso auth client
* Add Edit Option.
* Updated ingestion CLI and secret manager issues
* Updated tests with errors
* Removed unused method
* Removed test files
* Fix broken JSON schema
* Fix typescript error
* Pass the bot permissions from the bot details page
* Minor errors related to the secret manager
* Restore Airflow configuration for retrocompability
* Add support for all SsoServiceType client config
* Fix Unit test
* Update tests
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
