mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-12 11:07:20 +00:00
a7e2f33adc
* Add PII Tag and Sensitivity Level enums. * Add feature-extraction for PII classification tasks * Add faker as test dependency * Add unit tests for presidio tag extractor * Add PIISensitivityTags enum and update sensitivity mapping logic * Add Presidio utility functions for PII analysis * Extend column name regexs for PII * Add colum name split * Move pii algorithms to dedicated package * Add tests for PAN, NIF, SSN entities * Fix linting * Add comment on why we need to set specific lanaguage to Presidio recognizers, as per PR suggestion. * Fix version of faker to prevent flaky tests. Fix failing tests. * Fix wrong import --------- Co-authored-by: Pere Menal <pere.menal@getcollate.io>