yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-06 16:18:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

[FIX] 21910: Update amundsen ingest (#22201)

Browse Source 
Addresses: #21910

Removed 'Either' that currently wraps the generators being yieded from
in the amundsen `metadata.py` from the `AmundsenSource` class. I think
these are not necessary and causing the issue since the objects being
yielded inside those methods (`self.create_table_entity`, etc) are all
yielding `Either` objects.

Tested on my local instance and this resolved the issue with the service
not being able to ingest.

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
This commit is contained in:
Mike Kutzma 2025-07-08 08:13:55 -04:00 committed by GitHub
parent 1cbf4cf67b
commit 2cfabf6017
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
ingestion/src/metadata/ingestion/source/metadata/amundsen/metadata.py
View File

@ -147,18 +147,18 @@ class AmundsenSource(Source):
def _iter(self, *_, **__) -> Iterable[Either[Entity]]:
table_entities = self.client.execute_query(NEO4J_AMUNDSEN_TABLE_QUERY)
for table in table_entities:
yield from Either(right=self.create_table_entity(table))
yield from self.create_table_entity(table)
user_entities = self.client.execute_query(NEO4J_AMUNDSEN_USER_QUERY)
for user in user_entities:
yield from Either(right=self.create_user_entity(user))
yield from Either(right=self.add_owner_to_entity(user))
yield from self.create_user_entity(user)
yield from self.add_owner_to_entity(user)
dashboard_entities = self.client.execute_query(NEO4J_AMUNDSEN_DASHBOARD_QUERY)
for dashboard in dashboard_entities:
yield from Either(right=self.create_dashboard_service(dashboard))
yield from Either(right=self.create_chart_entity(dashboard))
yield from Either(right=self.create_dashboard_entity(dashboard))
yield from self.create_dashboard_service(dashboard)
yield from self.create_chart_entity(dashboard)
yield from self.create_dashboard_entity(dashboard)
def create_user_entity(self, user) -> Iterable[Either[OMetaUserProfile]]:
try: