Mayuri Nehate 3e727c5e9c
docs(glue): fix broken link (#8135)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-05-26 09:25:59 -05:00

17 lines
1.3 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

### Concept Mapping
| Source Concept | DataHub Concept | Notes |
| -------------------- | --------------------------------------------------------- | ------------------ |
| `"glue"` | [Data Platform](../../metamodel/entities/dataPlatform.md) | |
| Glue Database | [Container](../../metamodel/entities/container.md) | Subtype `Database` |
| Glue Table | [Dataset](../../metamodel/entities/dataset.md) | Subtype `Table` |
| Glue Job | [Data Flow](../../metamodel/entities/dataFlow.md) | |
| Glue Job Transform | [Data Job](../../metamodel/entities/dataJob.md) | |
| Glue Job Data source | [Dataset](../../metamodel/entities/dataset.md) | |
| Glue Job Data sink | [Dataset](../../metamodel/entities/dataset.md) | |
### Compatibility
To capture lineage across Glue jobs and databases, a requirements must be met otherwise the AWS API is unable to report any lineage. The job must be created in Glue Studio with the "Generate classic script" option turned on (this option can be accessed in the "Script" tab). Any custom scripts that do not have the proper annotations will not have reported lineage.