Roman Isecke 7ad8e88a95

feat: leverage logger to hide sensitive data in ingest logs (#2175) ...

### Description
Modify the logger being used by ingest to leverage a new class
implemented inheriting `logging.Formatter` which adds in some middleware
to update the message being logged to omit any sensitive content. It
does this by dynamically pulled out any valid json from the string being
logged and runs that through a `hide_sensitive_fields` method which
updated any values that are considered sensitive. Replaces the original
json strings with the `json.dumps` version of the new dictionary.

2023-11-29 18:16:23 +00:00

..

test_cli.py

Add check for duplicate click options (#1775)

2023-10-20 14:00:19 +00:00

test_error.py

Roman/downstream connector cli subcommand (#1302)

2023-09-11 11:40:56 -04:00

test_interfaces.py

feat: support both single and batch ingest docs (#2105)

2023-11-27 19:25:30 +00:00

test_logger.py

feat: leverage logger to hide sensitive data in ingest logs (#2175)

2023-11-29 18:16:23 +00:00

test_paths.py

bug: fsspec output filepath including base directory (#2146)

2023-11-28 14:19:42 +00:00

test_serialization.py

update ingest pipeline to share ingest docs via multiprocessing.manager.dict (#1814)

2023-10-25 22:04:27 +00:00