3 Commits

Author	SHA1	Message	Date
Pere Menal-Ferrer	44e09e41a2	Revert "FIX #1464 (#21520)" (#21726) ... This reverts commit 1e86f9870fd663122b9bbb64f3cf17cf32619c7f.	2025-06-13 17:27:32 +02:00
Pere Menal-Ferrer	1e86f9870f	FIX #1464 (#21520) ... * Add PIICategoryTags and some utilities on top of them. * Fix static-check * Add test for fqn representation * Add NEREntityGeneralTags.json from Collate * Add test to check PIICategoryTags agree with the ones used by OM server * Add LabelExtractor * Fix style * Add ignore superflous-parens for pylint * Ass comment as per PR review * Fix not-updated PII-IT * Remove duplicated IT test for PII --------- Co-authored-by: Pere Menal <pere.menal@getcollate.io> Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>	2025-06-09 16:05:35 -07:00
Pere Menal-Ferrer	5d2dfa712a	feature/pii-processor-improvement (#21248) ... * Add PII Tag and Sensitivity Level enums. * Add feature-extraction for PII classification tasks * Add faker as test dependency * Add unit tests for presidio tag extractor * Add PIISensitivityTags enum and update sensitivity mapping logic * Add Presidio utility functions for PII analysis * Extend column name regexs for PII * Add tests for PAN, NIF, SSN entities * Fix version of faker to prevent flaky tests. Fix failing tests. * Add Generated to State enum * Integrate PIISensitive classifier to PIIProcessor	2025-05-19 17:52:17 +00:00