mirror of
https://github.com/open-metadata/OpenMetadata.git
synced 2026-01-07 21:16:45 +00:00
a9d6b5760d
* Refactor SQL column processing and enhance BigQuery project ID handling * Introduced a new `process_column` function in `sql_column_handler.py` to streamline column processing logic. * Updated `BigquerySource` to improve project ID retrieval from service connections, ensuring compatibility with various credential types. * Added handling for nested columns in BigQuery schema processing. * Enhanced error handling and logging for better debugging during project ID setup. * Add support for GCP Application Default Credentials in BigQuery ingestion * Enhanced `BigquerySource` to include handling for GCP Application Default Credentials (ADC). * Updated JSON schema for GCP credentials to define `gcpADC` and its properties. * Improved logging for credential setup in `set_google_credentials` function. * Added comments and TODOs for future enhancements related to project ID fetching from the resource manager. * Update .gitignore to include cursor rules files * Added .cursorrules and .cursor/ to the .gitignore to prevent tracking of cursor rule files in the repository. * This change helps maintain a cleaner repository by excluding unnecessary files from version control. * refactor: Bigquery Credentials to allow multiple project ids * fix: Handle unknown array data types in SQL column processing