Pere Menal-Ferrer e1b7e93fe0 feature/pii-processor-improvement (#21248) ...

* Add PII Tag and Sensitivity Level enums.

* Add feature-extraction for PII classification tasks

* Add faker as test dependency

* Add unit tests for presidio tag extractor

* Add PIISensitivityTags enum and update sensitivity mapping logic

* Add Presidio utility functions for PII analysis

* Extend column name regexs for PII

* Add tests for PAN, NIF, SSN entities

* Fix version of faker to prevent flaky tests. Fix failing tests.

* Add Generated to State enum

* Integrate PIISensitive classifier to PIIProcessor

2025-05-20 09:28:30 +02:00

..

airflow

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

connections

MINOR: add test for sqla compiler (#15275)

2024-02-22 14:45:47 +01:00

data_quality

Fix #19147 - Executable Test Suites (#19221)

2025-01-07 17:59:54 +01:00

great_expectations

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

metadata

Fix #20902: Fix duplicate constraints error (#21037)

2025-04-30 06:05:45 +00:00

models

MINOR: Transform Reserved keywords like quotes to OM compatible (#20459)

2025-03-27 13:02:07 +05:30

pii

feature/pii-processor-improvement (#21248)

2025-05-20 09:28:30 +02:00

profiler

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

readers

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

resources

feat: use table_id instead of table_name for fetching Superset dataset columns (#19618)

2025-02-03 10:30:42 +05:30

test_suite

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

topology

bugfix: powerbi lineage source parameter usecase fix, last active user ingestion fix (#21272)

2025-05-19 13:52:13 +00:00

utils

issue-20737: datalake parquet different extensions (#21048)

2025-05-15 10:43:23 +05:30

workflow

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

__init__.py

…

conftest.py

moved int_admin_ometa to a dedicated module (#16768)

2024-06-25 11:21:22 +05:30

test_avro_parser.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_azure_credentials.py

Fixes 14370: Add Azure Client, support Default Creds (#15554)

2024-03-22 14:28:42 +05:30

test_build_connection_url.py

Fixes 14370: Add Azure Client, support Default Creds (#15554)

2024-03-22 14:28:42 +05:30

test_column_type_parser.csv

Datalake: Add manifest file support, fix profiler metrics, add array and json column type support (#13017)

2023-09-13 15:15:49 +05:30

test_column_type_parser.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_config.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_connection_builders.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_credentials.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_databricks_lineage.py

Fixes: Databricks httpPath Required (#20611)

2025-04-07 13:33:55 +05:30

test_datatypes.py

…

test_dbt.py

Fix - switch to collate-dbt-artifacts-parser (#19647)

2025-02-04 11:57:39 +05:30

test_entity_link.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_filter_pattern.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_fqn.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_handle_partitions.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_helpers.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_importer.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_incremental_extraction.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_json_schema_parser.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_logger.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_ometa_endpoints.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_ometa_mlmodel.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_ometa_to_dataframe.parquet

…

test_ometa_to_dataframe.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_ometa_utils.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_partition.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_pgspider_lineage_unit.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_powerbi_filter_query.py

Fixes #15696: Added Powerbi filter query (#19912)

2025-03-06 18:24:57 +05:30

test_powerbi_table_measures.py

Fixes #19891 : Added measures in powerbi (#19990)

2025-03-17 14:43:22 +05:30

test_protobuf_parser.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_pydantic_v2.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_query_parser.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_sample_usage.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_source_connection.py

Fixes: Databricks httpPath Required (#20611)

2025-04-07 13:33:55 +05:30

test_source_parsing.py

Chore Ingestion Tableau library change (#21076)

2025-05-15 12:19:49 +00:00

test_source_url.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_sql_lineage.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_ssl_manager.py

Feature: Cassandra SSL (#19226)

2025-01-10 11:25:43 +05:30

test_time_utils.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_trino_complex_types.py

…

test_ttl_cache.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_usage_filter.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_usage_log.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_version.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30

test_workflow_parse_example_config.py

#15243 - Pydantic V2 & Airflow 2.9 (#16480)

2024-06-05 21:18:37 +02:00

test_workflow_parse.py

MINOR: Change ingestion licence header (#20549)

2025-04-03 10:39:47 +05:30