* feat: add global metric configuration for the profiler
* style: ran java linting
* fix: renamed disable to disabled
* style: ran java linting
* feat: ometa sdk for profiler setting
* test: ingestion profiler global config tests
* fix: update metric name to use MetricType Enum
* fix: allow bot to retrieve settings
* fix: exclude GX artifacts
* feat: implement global profiler setting logic for ingestion side
* fix: exclude metrics if Metric is empty
* style: ran python linting
* style: ran python linting
* fix: skip empty metrics
* style: ran python linting
* fix: moved GET profiler config to seperate endpoint in system resource
* fix: moved compute metric filter to MetricFilter + renamed container
* fix: test failures
* fix: profiler test case
* feat(nosql-profiler): row count
1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.
* added profiler support for mongodb connection
* doc
* use int_admin_ometa in test setup
* - fixed linting issue in gx
- removed unused inheritance
* moved the nosql function into the metric class
* feat(profiler): add dynamodb row count
* feat(profiler): add dynamodb row count
* formatting
* validate_compose: raise exception for bad status code.
* fixed import
* format
* feat(nosql-profiler): added sample data
1. Implemented the NoSQL sampler.
2. Some naming changes to the NoSQL adaptor to avoid fixing names with the profiler interface.
3. Tests.
* added default sample limit
* formatting
* fixed import
* feat(profiler): dynamodb sample data
* tests for dynamo db sample data
* format
* format
* use service connection for nosql adaptor factory
* fixed tests
* format
* fixed after merge
* Changed the MLModelStore storage type to string
* fix checkstyle
* remove unused files
* Update requirements
* fix checkstyle
* Skipping MLFlow intergration on python 3.8
* Hack to allow pytest to parse the mlflow integrations test on python 3.8
* Fix checkstyle
* feat(nosql-profiler): row count
1. Implemented the NoSQLProfilerInterface as an entrypoint for the nosql profiler.
2. Added the NoSQLMetric as an abstract class.
3. Implemented the interface for the MongoDB database source.
4. Implemented an e2e test using testcontainers.
* added profiler support for mongodb connection
* doc
* use int_admin_ometa in test setup
* - fixed linting issue in gx
- removed unused inheritance
* moved the nosql function into the metric class
* feat(profiler): add dynamodb row count
* feat(profiler): add dynamodb row count
* formatting
* fixed import
* format
* dded dynamodb row count
* format
* removed unused factory file
* removed "validate"
* migrations
* removed validations
* format
* linting
* fixed: test_amundsen.py
* Update schemaChanges.sql
* MINOR - Metadata Actions schemas
* add type for left side menu bar items
* fix the required fields in automatorAppConfig.json schema
* update constants
* mixin
* create new styled component to show in alerts form card
* Add new translations for ingestion pipeline and location
* Fix import statement in AlertDetailsPage.tsx
* Update automatorAppConfig.json schema to use an array for the 'type' property
* config
* move the advanced search configs to a new classBase for better customization
* Update automatorAppConfig.json schema to add "name" and "description" fields
* Update automatorAppConfig.json schema to remove "name" and "description" fields
* Add new translations for description-plural in multiple language files
* filter Automator
* revert remove
* Update pipeline actions interface and component to handle edit click event
* Update select type for advanced search fields in AdvancedSearchClassBase.ts
* Update ErrorPlaceHolderIngestion component to accept cardClassName prop
* Update FormCardSection component to accept className prop
* Update TagsContainerV2 component to include state property in tag data
* Update TagsContainerV2 component to include defaultState and defaultLabelType properties
* Update ingestionPipelineAPI.ts to include applicationType parameter in getIngestionPipelines function
* Update AdvanceSearchProvider.test.tsx to include pathname in useLocation mock
* work on comments
* fix sonar lint errors
* format
* Update useLocation mock in AdvanceSearchProvider.test.tsx to include pathname
* revert remove
* Update LogsViewerPage interfaces and component to include application_task in IngestionPipelineLogByIdInterface
* Update LeftSidebar component to import LeftSidebarItem interface and fix type annotation in children map function
* fix observability alert test
* revert the form list add method change
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
* Added dbt glossary and tier ingestion
* changed elif to if condition:pylint
* Added dbtMeta model for glossary and tier
* removed source
* Optimization: Reused the dtb_tags
* pylint format
* py_format
* Removed unnecessary models and minor changes
* Removed empty string assignment
* WIP - MINOR - Clean ingestion dependencies
* test
* test
* Clean imports
* add pyiceberg for test
* Revert "add pyiceberg for test"
This reverts commit ab26942736586f089a57a644ffd727aca200db62.
* add pyiceberg for test
* Remove docker dep
* clean local docker sh
* MINOR - AKS Airflow troubleshooting docs
* Fix action
* clean local docker sh
* add failed sample data
* format
* fixed masking pii data in test failed rows sample
* format
* failedRowsSamples -> failedRowsSample
* failedRowsSamples -> failedRowsSample
* fixed tests
* format
* wip
* added computePassedFailedRowCount to python client
* comment for loggerLevel
* format
* fixed tests
* tests for putting / deleting failed samples
* format
* format
* added test case for pii test
* changed method name to deleteTestCaseFailedRowsSample
* added getComputePassedFailedRowCount
* Mantain the OperationType Order when considering the dividing groups
* Remove reordering the jsonpatch operations from the backend
* Fix checkstyle
* Fix UnitTests to comply with no reordering
* Initial idea on how to fix our current jsonpatch builder from python
* fix(JsonUtils): Change JSONPatch library used
When creating a JSONPatch by using the 'createDiff' method, the library
we are using is not returning a correct JSONPatch when removing multiple
items from an array.
Since the library doesn't provide good ways to override this behavior
and fix it, we decided to move away from it and use the json-patch
library only for this specific operation.
* Fix linters
* Add docstrings
* Refactor patch updated on ingestion framework
* Add UnitTests
* Fix linters
* fix: update antlr regex for entity fqn
* fix: update antlr rule to allow single character
* style: ran python linting
* fix: updated antlr token for NAME_OR_FQN
* Fix#12964: filter draft dashboards from config
* Fix#12964: add unit test for qlik_sense
* Fix#12964: added UI and doc code
* Fix#12964: move includedraftdashboard flag from source_connection to source_config
* Fix#12964: filter draft dashboards in qlikcloud
* Fix#12964: add unit test for qlik cloud
* Fix#12964: remove unnecessary comments, code clean
* Fix#12964: pylint changes
