yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-10-14 18:27:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

Added logic to allow profile data to be ingested when sample data fetch fails (#7088)

Browse Source 
* Added logic to allow profile data to be ingested when sample data fetching faisl

* Update ingestion/src/metadata/orm_profiler/profiler/core.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
This commit is contained in:
Teddy 2022-08-31 18:29:56 +02:00 committed by GitHub
parent 26489a00bf
commit 01309249c8
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 10 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

14
ingestion/src/metadata/orm_profiler/profiler/core.py
View File

@ -375,10 +375,16 @@ class Profiler(Generic[TMetric]):
self.compute_metrics()
if generate_sample_data:
logger.info(
f"Fetching sample data for {self.profiler_interface.table_entity.fullyQualifiedName.__root__}..."
)
sample_data = self.profiler_interface.fetch_sample_data()
try:
logger.info(
f"Fetching sample data for {self.profiler_interface.table_entity.fullyQualifiedName.__root__}..."
)
sample_data = self.profiler_interface.fetch_sample_data()
except Exception as err:
logger.debug(traceback.format_exc())
logger.warning(f"Error fetching sample data: {err}")
sample_data = None
else:
sample_data = None