Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff ( #12373 )
2025-01-17 21:38:29 +05:30
Harshal Sheth
3755731f0e
chore(ingest): improve code formatting ( #11326 )
2024-09-11 10:48:57 -07:00
Andrew Sikowitz
806f09ae23
test(ingest/unity): Unity catalog data generation ( #8949 )
2023-12-05 12:33:00 -05:00
Andrew Sikowitz
301d3e6b1c
test(ingest/unity): Add Unity Catalog memory performance testing ( #8932 )
2023-10-04 10:23:13 -04:00
Andrew Sikowitz
1ac1ccf26e
perf(ingest/bigquery): Improve bigquery usage disk usage and speed ( #7825 )
2023-04-14 18:09:43 -07:00
Andrew Sikowitz
087855f374
fix(ingest/bigquery): Support cross project usage using FileBackedDict ( #7663 )
...
Includes major refactor of bigquery usage ingestion, minor refactor of the source as a whole, and reporting cleanup.
Includes bigquery performance testing changes.
2023-04-07 12:18:26 -07:00
Andrew Sikowitz
54a372795b
test(ingest/bigquery): Add performance testing framework for bigquery usage ( #7690 )
...
- Creates metadata-ingestion/tests/performance directory
- Excludes metadata-ingestion/tests from docs generation
- Updates bigquery reporting around project state
2023-03-29 14:13:43 -07:00