yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-09-25 17:15:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(docs): fix transformer doc example (#3469)

Browse Source
This commit is contained in:
aseembansal-gogo 2021-10-28 00:13:35 +05:30 committed by GitHub
parent 8a60020579
commit d27ae61f15
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
metadata-ingestion/transformers.md
View File

@ -154,7 +154,7 @@ transformers:
- type: "set_dataset_browse_path" - type: "set_dataset_browse_path"
config: config:
path_templates: path_templates:
- /ENV/PLATFORM/DATASET_PARTS/ - /ENV/PLATFORM/DATASET_PARTS
``` ```
If you don't want the environment but wanted to add something static in the browse path like the database instance name you can use this. If you don't want the environment but wanted to add something static in the browse path like the database instance name you can use this.
@ -163,7 +163,7 @@ transformers:
- type: "set_dataset_browse_path" - type: "set_dataset_browse_path"
config: config:
path_templates: path_templates:
- /PLATFORM/marketing_db/DATASET_PARTS/ - /PLATFORM/marketing_db/DATASET_PARTS
``` ```
It will create browse path like `/mysql/marketing_db/sales/orders` for a table `sales.orders` in `mysql` database instance. It will create browse path like `/mysql/marketing_db/sales/orders` for a table `sales.orders` in `mysql` database instance.
@ -173,8 +173,8 @@ transformers:
- type: "set_dataset_browse_path" - type: "set_dataset_browse_path"
config: config:
path_templates: path_templates:
- /PLATFORM/marketing_db/DATASET_PARTS/ - /PLATFORM/marketing_db/DATASET_PARTS
- /data_warehouse/DATASET_PARTS/ - /data_warehouse/DATASET_PARTS
``` ```
This will add 2 browse paths like `/mysql/marketing_db/sales/orders` and `/data_warehouse/sales/orders` for a table `sales.orders` in `mysql` database instance. This will add 2 browse paths like `/mysql/marketing_db/sales/orders` and `/data_warehouse/sales/orders` for a table `sales.orders` in `mysql` database instance.
@ -186,7 +186,7 @@ transformers:
config: config:
replace_existing: True replace_existing: True
path_templates: path_templates:
- /ENV/PLATFORM/DATASET_PARTS/ - /ENV/PLATFORM/DATASET_PARTS
``` ```
In this case, the resulting dataset will have only 1 browse path, the one from the transform. In this case, the resulting dataset will have only 1 browse path, the one from the transform.