yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-12-25 00:48:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(ingest/glue): Profiling breaks for non-partitioned tables due to absent Table.PartitionKeys (#9591)

Browse Source
This commit is contained in:
Dmytro Kulyk 2024-01-26 20:54:06 +02:00 committed by GitHub
parent f7f0b14f37
commit fc27ab2fb5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
metadata-ingestion/src/datahub/ingestion/source/aws/glue.py
View File

@ -833,9 +833,8 @@ class GlueSource(StatefulIngestionSourceBase):
**{k: v for k, v in kwargs.items() if v}
)
partition_keys = response["Table"]["PartitionKeys"]
# check if this table is partitioned
partition_keys = response["Table"].get("PartitionKeys")
if partition_keys:
# ingest data profile with partitions
# for cross-account ingestion