* Mask sensitive info from API responses
* Rename converter classes
* Add missing Java classes from JSON schemas and class converters
* Update test service connection schema
* Update datalakeConnection JSON schema and fix some tests
* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh
* Fix Pipeline and Database service tests
* Minor refactor
* Fix CsvUtilTest
* Fix EventMonitorFactoryTest
* Fix CloudWatchEventMonitorTest
* Update datalake metadata
* Update bigquery metadata
* Fix test connection functionality
* Fix OMeta service api test
* Update gcsValues title and revert changes in GH actions
* Mask sensitive enabled by default for local docker
* Add missing tests
* Address PR comments
* Address PR comments
* fix ui breaks on gcsValues.json
* Address PR comments
* Minor refactor
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* WIP: pii tagging using spacy
* added test cases and changes as per comment
* fix python checkstyle
* fix python checkstyle
* added score, test_cases and docs update
* solved merge conflict
* fix python checkstyle
* remove pii tagging using regex
* fix python test
* lib changes and added some test case
* changed as per comment
* fix: python test
* fix: changes to get source_config
* fix: changes as per comment
* fix(dataInsight): handle cases where entity would be deleted from OM
* Update ingestion/src/metadata/data_insight/processor/web_analytic_report_data_processor.py
Added explanation in code comments
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* fix(dataInsight): tests failure
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Update test connection
* Update test connection
* Update test connection with Tags
* Change based on comments
* Fix Pytest
* Service connectin arg in all connecter
* Fix pytest and conflict
* feat(profiler): renamed module to
* feat(profiler): added dbt-artifacts-parser to test setup.py
* feat(profiler): refactor workflow and interface
* feat(profiler): linting
* feat(profiler): removed old profiler modules
* feat(profiler): added support for value and integer range partition
* feat(profiler): fixed linting
* feat(profiler): added partitionning support for datalake profiler
* feat(profiler): removed `ProfilerInterfaceArgs` class
* feat(profiler): address comments
* feat(profiler): Added `OTHER` as an `IntervalType` for UI type generation
* feat(testSuite): extracted out column test for SQA type
* refactor(testSuite): extracted SQA column and table tests into their own classes
* refactor(testSuite): Added pkutil namespace package style for test suite classes
* refactor(testSuite): added dynamic importer function for test cases
* refactor(testSuite): black formatting
* refactor(testSuite): fixed linting issues
* refactor(testSuite): refactor metrics for dataframe
* refactor(testSuite): Added Mixins and base methods
* refactor(testSuite): extrcated out get bound for floats
* refactor(testSuite): Added pandas column test cases
* refactor(testSuite): Deleted old column tests
* refactor(testSuite): Added table tests for datalake
* refactor(testSuite): Removed old tests definition
* refactor(testSuite): changed registry to dynamic class inport
* refactor(testSuite): renamed dl_fn to df_fn
* refactor(testSuite): updated registry unit test
* refactor(testSuite): updated import path to sqa like column
* refactor(testSuite): cleaned up imports in old files
* refactor(testSuite): harmonzied SQALikeColumn object to replicate SQA Column object
* refactor(testSuite): linting
* refactor(testSuite): linting
* refactor(testSuite): raise expection on DQ exception
* refactor(testSuite): linting
* refactor(testSuite): removed pandas from base requirements
* refactor(testSuite): Added __futur__ for py3.7 type hint
* refactor(testSuite): added `df` to good-names
* refactor(testSuite): renamed Handler to Validator
* refactor(testSuite): Added test inheritance for column tests
* refactor(testSuite): cleaned up column type check
* refactor(testSuite): cleaned up typo
* refactor(testSuite): extracted main table test logic into parent class
* refactor(testSuite): linting
* refactor(testSuite): linting fixes
* refactor(testSuite): address doc string and linting issues
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
* Fix: added changes for pii sensitive
* Fix: removed comments
* Fix: python checkstyle
* differtiate between sensitive and non sensitive tag
* fix: python test
* fix: added tests
* fix: maven CI
* staging commit
* staging commit
* refactor: partitioning logic
* refactor (tests): move to parametrized tests for test validations
* refactor: local variables into global
* (feat): Added logic for table row inserted test
* (feat): fix python checkstyle
* feature: extracted get_query_filter logic into its own function
* Update airflow loggers and rename ometa loggers
* ANSI print to logger
* Remove colored logging from tests
* Merge ometa_logger into the one used in loggers class
* linting
* linting
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
* Replace sqllineage with openmetadata-sqllineage
* Fix checkstyle and failing test
* Move logic to retrieve dialect of a service type into a class
* Improve py-check message when it fails
* Updated mapper
* Update code after merge
* Added base files
* dbt e2e tests
* Added tag condition based on UI feedback
* Added owner and lineage tests
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
* Fixes#9618 Allow apostrophe in entity names
* Add support for space in entity names (with exception) and column names
* Add regex checks to entity names, table column names to allow only required characters
* fix: allowed characters in entityName
* Add all the allowed special characters in the entity name in tests
* Allow '&', '/', ':' only for the table
* Override basic entityName by defining entity specific entityName for Python code gen
* fix: dagster migration + json schema path
* fix: python style check
* Fix test failure
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
* Fix: added test case for atlas
* Fix: resolved conflict
* Fix: changing back neo4j to old version
* Fix: changing back neo4j to old version
* Fix: changes as per comment
* Fix: changes as per comment
* Fix: python checkstyle
