IceS2 e7c9d6aa7f

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130) ...

* Implement Initial MultiThread suggestion

* Update all the ingestion sources to use the new ContextManager

* Fix missing wraps on decorator

* Fix Unittests

* Fix linters

* Fix linters

* Fix BigQuery UnitTests

* Add UnitTests to the newly created code

* Fix unittest

* change the threads from table to schemas

* Update README.md

* Small change suggested by Sonar

* Slight change to test a different way to multithread over tables

* Debug changes

* More multithread tests

* Remove uneeded wait time

* Testing

* refactor code based on removal of time.sleep

* Fix wrong paste

* Improve ExecutionTimeContextManager

* Fix missing .get() and unit tests

* Fix conflicting changes

* Update Multithread logic with the incremental extraction

* Fix linters

* Fix unittest

* Remove commented code

* Fix Unittests

* Fix checkstyle

* Change default to threads = 1

2024-03-25 18:20:40 +01:00

..

__init__.py

Fix #6280 - Bump DeltaLake version, tests and docs (#6307)

2022-07-24 18:49:15 +02:00

test_bigquery.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_bigtable.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_couchbase.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_databricks.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_datalake.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_deltalake.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_domodatabase.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_glue.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_hive.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_iceberg.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_mongodb.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_mssql.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_oracle.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_postgres.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_redshift_incremental_table_processor.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_redshift.py

Issue #14765 - Preparatory Work (#15312)

2024-02-28 07:11:00 +01:00

test_salesforce.py

FIXES 15215: Implement initial Multithreading approach for the Metadata Ingestion on Databases (#15130)

2024-03-25 18:20:40 +01:00

test_sas.py

MINOR - update docs & added unit test for SAS Connector (#14743)

2024-01-23 14:55:29 -08:00

test_snowflake.py

FIXES 15215: First draft implementation on extracting metadata incrementally. Done for Snowflake, BigQuery and Redshift (#15201)

2024-03-15 14:00:49 +01:00