mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2025-08-05 15:48:03 +00:00

* updated metadata to work with the impala query engine. Uses the describe function to grab column names, data types, and comments. * added the ordinalPosition data point into the Column constructor. * renamed variable to better describe its usage. * updated profile errors. Hive connections now comment columns by default. * removed print statements * Cleaned up code by pulling check into its own function * Updated median function to return null when it is being used for first and third quartiles. * updated metadata to work with the impala query engine. Uses the describe function to grab column names, data types, and comments. * added the ordinalPosition data point into the Column constructor. * renamed variable to better describe its usage. * updated profile errors. Hive connections now comment columns by default. * removed print statements * Cleaned up code by pulling check into its own function * Updated median function to return null when it is being used for first and third quartiles. * removed print statements and ran make py_format * updated to fix some pylint errors. imported Dialects to remove string compare to "impala" engine * moved huge comment into function docstring. This comment shows us the sql to get quartiles in Impala * added cast to decimal for column when running average in mean.py * fixed lint error * fixed ui ordering of precision and scale. Precision should be ordred in front of scale since the precision is set first in decimal data types * first pass for impala connector * updated default auth_mechanism to be one of the enum values. * updated UI documentation to match fields for the impalaconneciton. refined impalaConnection to bring use_ssl to a boolean instead or relying on an extra connection option being manually added. Removed reference to hive for type mapping added impala to the pip setup * py_format updates * removed print statement * Lints and fixes * Updated database documentation to follow new style * Flag as BETA * Remove tests --------- Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com> Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
18 lines
646 B
Markdown
18 lines
646 B
Markdown
---
|
|
title: Impala Connector Troubleshooting
|
|
slug: /connectors/database/impala/troubleshooting
|
|
---
|
|
|
|
# Troubleshooting
|
|
|
|
Learn how to resolve the most common problems people encounter in the Impala connector.
|
|
|
|
## Connection Timeout
|
|
|
|
You might be getting `thrift.transport.TTransport.TTransportException: TSocket read 0 bytes`.
|
|
|
|
Make sure that if there is a Load Balancer in between OpenMetadata and Impala, the LB timeout
|
|
is not impacting the ingestion. For example, when extracting data with a lot of partitions the `DESCRIBE`
|
|
command might take more than 60 seconds, so a Load Balancer with `Idle Timeout` at 60 seconds would
|
|
kill the connection.
|