* Fix cross db changes of service_names to missed methods
* Handle string value passed to service_names
(cherry picked from commit 9b2b4d2452732c4efb5cf03632eeabbb1d85fe1c)
* MINOR: Improve UDF Lineage Processing & Better Logging Time & MultiProcessing (#20848)
* Fix multiprocessing with better memory management and Airflow 2+ compatibility
* Add support for both multiprocessing and multithreading for relevant platforms
* Handle conflicting cross-db lineage changes of service_name parameter change
* Handle stored proc queries without caching all and increase the thread timeout times to cover 100% lineage
* Fix `get_table_query` inheritance and pylint
* Remove mocks from db_utils tests
* Better db_utils test and fix the service_names parameter in case of schema_fallback
---------
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
(cherry picked from commit 04a3639e47cacf68cc6732913b2c0c1cb15e495c)
* Add ssl support to hive
* Added missing ts files
* Added version to pure transport
* Added Tests
* fix tests add missing files
(cherry picked from commit 20e18d4f9f8fb6187a4a9610a793ff8ff5c134f8)
* Refactor BigQuery client type hinting in bigquery_utils.py
- Updated type hint for the BigQuery client to use forward declaration for better compatibility with type checking.
- Moved import statement for google.cloud.bigquery inside TYPE_CHECKING block to optimize imports during runtime.
* Refactor BigQuery client import structure in bigquery_utils.py
- Moved the import statement for google.cloud.bigquery inside the TYPE_CHECKING block to enhance type hinting compatibility.
- Adjusted the import location for better runtime performance and adherence to best practices.
* Fix Oracle DataDiff and Change Oracle Connection to BaseConnection
* Add small unittest
* Fix Test
* Fix logic, to void other engines to denormalize table/schema names
(cherry picked from commit a696fe0111171c3079c5840c28a00073fae25003)
* Add calculated view columns' formula parsing logic with correct source reference
* Handle top level column formula parsing and pass formula expression in column lineage detail
---------
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
(cherry picked from commit 744494968e0e4d0266b42ea9a93a54ebb7ea6718)
* fix: ingestion fails for Iceberg tables with nested partition column
* test: added test to cover nested partition column for iceberg
* refactor: used if-else in tablePartition check
* fix: partition_column_name & column_partition_type typo
(cherry picked from commit 2f655daedc1bb82fbb97bec0e42fca15a8bb7863)
* Add schema-level tags and tag inheritance support for snowflake
* Add tests for schema tag inheritance
* Lint fixes
(cherry picked from commit 26fedbaf0eccb774837791df6b3337643c72014d)
* feat: added nifi execution history
* doc: added pipeline status in available features
(cherry picked from commit f39f57ddcd44f0b2079f9363469f1d2e0112bc3b)
* Add lineage to Exasol connector
* Update test_connection to return TestConnectionResult
* Add exasol tests & dependencies to tests in setup.py
* Opensearch is required for testing, so add it there
* Modify metadata
* Update documentation for lineage
* Apply formatting changes to code
* Apply make py_format
* Introduced CreateDriveServiceRequest to handle drive service creation
* Updated routes.py to include DriveService entity
This enhancement expands the ingestion framework's capabilities to support drive services, aligning with the project's goal of comprehensive metadata management.
