12 Commits

Author SHA1 Message Date
Pere Menal-Ferrer
5d2dfa712a
feature/pii-processor-improvement (#21248)
* Add PII Tag and Sensitivity Level enums.

* Add feature-extraction for PII classification tasks

* Add faker as test dependency

* Add unit tests for presidio tag extractor

* Add PIISensitivityTags enum and update sensitivity mapping logic

* Add Presidio utility functions for PII analysis

* Extend column name regexs for PII

* Add tests for PAN, NIF, SSN entities

* Fix version of faker to prevent flaky tests. Fix failing tests.

* Add Generated to State enum

* Integrate PIISensitive classifier to PIIProcessor
2025-05-19 17:52:17 +00:00
Imri Paran
b8dc12b30b
aligned pre-commit with Makefile. added check json (#15295)
* aligned pre-commit with Makefile. added check json

* add check for json/yaml files

* add path checks for json/yaml validation
2024-04-18 15:32:38 +02:00
Artiom Darie
7d2f8dc2bb
Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913)
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Changed intial implementation accordingly. Added better flexibility for different auth prodvider impl

* ISSUE-11740: Clean up unnecessary classes

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Code formatting

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Moved docs to 1.2 version

---------

Co-authored-by: artiom.darie <artiom.darie@adswizz.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-27 09:59:24 -07:00
Yu Ishikawa
40f8a527ab
Upgrade isort pre-commit (#10154)
Signed-off-by: Yu ISHIKAWA <yuu.ishikawa+github@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-02-12 18:13:24 -08:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Milan Bariya
591517a487
Fix: Align pre-commit isort (#7380) 2022-09-14 15:10:06 +02:00
Nahuel
65260263fc
Fix #5915: Implementation of AWS Secret Manager (#5925)
* Implement Secrets Manager abstraction + refactor service repositories

* Rename secrets manager factory method for consistency

* Fix typo in openmetadata conf yaml file

* Bump version

* Fix SonarCloud code smells

* Add secrets manager provider as an Enum + send it in the server configuration in the ingestion pipeline

* Apply suggestions from code review

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

* Change secret manager implementations to be singleton

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-07-13 20:49:27 +02:00
Pere Miquel Brull
130bbb0c5c
Fix #3104 - Remove unused imports with pycln (#3370)
Fix #3104 - Remove unused imports with pycln (#3370)
2022-03-14 06:59:15 +01:00
Robert Pack
67a1c23482
Fix #2348: Harmonize request titles in json schemas 2022-01-31 16:29:56 -08:00
Alberto Miorin
34a9d31240
Fix #2052: Revert the reverted pre-commit (#2053) 2022-01-07 03:53:21 +01:00
Sriharsha Chintalapani
bb847bc004
Revert "Use defaults of google java format action (#1845)" (#1912)
This reverts commit 782209ead58f4cd82882872e9f8f40779d8b6e54.
2021-12-23 19:22:47 -08:00
Alberto Miorin
782209ead5
Use defaults of google java format action (#1845)
* Use defaults of google java format action

* Fix the first Java file

* Add lint-staged

* Remove husky
2021-12-21 17:51:18 +01:00