15 Commits

Author SHA1 Message Date
Harshal Sheth
9790f3cefa
feat(ingest): infer aspectName from aspect type in MCP (#5566) 2022-08-07 07:52:58 -07:00
Harshal Sheth
480fb2e770
test(ingestion): change class names to avoid unittest warnings (#5005) 2022-05-26 22:09:40 +05:30
Gabe Lyons
a8079ca163
feat(transformers): add transformers to provide tags & terms to schema fields based on regex patterns (#4936)
* add tag & term transformers for schemas

* added documentation

* lint fixes

* add clarification that only first set of matching terms is applied
2022-05-18 16:03:34 -07:00
Swaroop Jagadish
35b187a8d4
feat(ingest): transformers - add support for processing MCP-s (#4337) 2022-03-07 13:14:29 -08:00
Sergio Gómez Villamor
3fa22e1138
feat(transform): adds simple add dataset properties transform (#3778) 2021-12-22 08:51:38 -08:00
ecooklin
1a5121a5ae
feat(ingest): adds glossary terms transformer (#3657) 2021-12-07 21:54:15 -08:00
Noé López
cde1ce043d
feat(ingest): add transformer to add properties (#3480) 2021-11-09 20:03:21 -08:00
Swaroop Jagadish
ec406c7928
feat(ingest): read-modify-write capabilities during ingestion, adding ownership patch transformer (#3506) 2021-11-03 21:39:52 -07:00
Sergio Gómez Villamor
696ad2ccc4
feat(ingest): adds replace_existing config to browse path transformer (#3313) 2021-10-01 12:35:16 -07:00
Sergio Gómez Villamor
9e28423c6d
feat(ingest): add optional config for ownership type in ownership transformers (#3159)
Co-authored-by: Sergio Gómez <sergio.gomez.villamor@adevinta.com>
2021-09-01 22:44:03 -07:00
Rahul Jain
0e0198f385
feat(ingest): Added support for "add dataset ownership by regex match" (#2990) 2021-08-10 11:03:16 -07:00
aseembansal-gogo
9ee091f518
feat(ingest): add transformers to clear dataset ownership, mark status, add browse paths (#2986) 2021-08-09 09:43:46 -07:00
Harshal Sheth
220dfe728c
feat(ingest): support dynamic imports for transfomer methods (#2858) 2021-07-12 11:03:53 -07:00
Harshal Sheth
2f921d15e8
fix(ingest): avoid setting timestamps unless source system provides it (#2843) 2021-07-08 12:11:06 -07:00
Harshal Sheth
1d4bcbe4fb
feat(ingest): add dataset tag transformer (#2580) 2021-05-18 14:43:43 -07:00