560 Commits

Author SHA1 Message Date
Harshal Sheth
6d05971073
fix(ingest): add missing dep for gcs (#12505) 2025-01-31 18:35:57 +05:30
david-leifker
f527c5ed55
feat(iceberg-rest): implement iceberg REST catalog api (#12500)
Co-authored-by: ksrinath <ksrinath@users.noreply.github.com>
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-01-30 15:38:15 +05:30
cccs-cat001
bc09b28a64
refactor(operation_config): change logging on is_profiling_enabled (#12416)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-29 21:56:35 -08:00
Aseem Bansal
cc0d43f5a8
feat(ingest): add datahub apply source (#12482) 2025-01-29 21:37:17 +05:30
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Pedro Silva
3030f90aaf
fix(ingest/slack): Add retries (#12401) 2025-01-23 16:10:26 +05:30
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Aseem Bansal
436b74cd3a
dev: move from flake8,isort to ruff (#12375) 2025-01-17 23:50:13 +05:30
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30
Harshal Sheth
a06a229499
feat(ingest/datahub): use stream_results with mysql (#12278) 2025-01-06 15:29:51 -08:00
skrydal
b76db335a2
fix(ingestion/redshift): Bumped redshift-connector dependency due to CVE-2024-12745 (#12265) 2025-01-03 13:33:45 +01:00
Harshal Sheth
4e3103e266
fix(ingest): use typing_extensions.Self (#12230) 2024-12-27 10:50:43 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Mayuri Nehate
953893cf2e
refactor(ingest/kafka-connect): define interface for new connector impl (#12149) 2024-12-19 12:39:47 +05:30
Mayuri Nehate
01a2c0c779
fix(ingest/kafka): update dependency, tests (#12159) 2024-12-18 19:02:44 +05:30
Andrew Sikowitz
ff385edbb1
build(ingest/sqlglot): Bump pin to support snowflake CREATE ... WITH TAG (#12003) 2024-12-17 03:49:47 -08:00
sagar-salvi-apptware
57b12bd9cb
fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020) 2024-12-10 08:36:01 -08:00
Harshal Sheth
65f44efbad
fix(ingest): avoid bad IPython version (#12035) 2024-12-04 14:50:56 -08:00
k-bartlett
dc87b51369
feat(ingest): connector for Neo4j (#11526)
Co-authored-by: kbartlett <keith.bartlett@fullsight.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Jay Feldman <8128360+feldjay@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: deepgarg-visa <149145061+deepgarg-visa@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
2024-12-02 14:53:28 +05:30
Harshal Sheth
0476bf1e32
feat(ingest): bump typing_extensions dep (#11965) 2024-11-28 21:41:53 -05:00
skrydal
816fd3dba7
fix(ingestion/iceberg): Improvements to iceberg source (#11987) 2024-11-28 15:34:20 +00:00
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Harshal Sheth
5519a330e2
chore(ingest): bump black (#11898) 2024-11-20 13:33:54 -08:00
mikeburke24
4601aacfad
fix(ingest): upgrade msal (#11883) 2024-11-19 15:59:37 +05:30
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
Andrew Sikowitz
5ff6295b0f
fix(ingest/partition-executor): Fix deadlock by recomputing ready items (#11853) 2024-11-14 08:48:30 +01:00
sagar-salvi-apptware
5d17ecb290
feat(ingest/dremio): Dremio Source Ingestion (#11598)
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-05 22:06:35 +05:30
Harshal Sheth
e609ff810d
feat(ingest/powerbi): improve reporting around m-query parser (#11763) 2024-10-31 16:27:45 -07:00
chriscc2
9329916239
feat(ingest): unpin looker-sdk dependency (#11755)
Co-authored-by: Chris Chan <chriscchan@google.com>
2024-10-31 15:50:41 -07:00
Harshal Sheth
143fc011fa
feat(ingest/powerbi): add timeouts for m-query parsing (#11753) 2024-10-30 19:40:45 +01:00
Harshal Sheth
93f76def1f
fix(ingest): pin teradata dep (#11760) 2024-10-30 10:38:33 -07:00
Harshal Sheth
c8704509a4
fix(ingest/bigquery): add missing path spec deps (#11748) 2024-10-30 11:13:15 +01:00
Harshal Sheth
b26da57928
feat(ingest): remove dep on termcolor (#11733) 2024-10-29 17:48:55 +01:00
Harshal Sheth
bea253a064
feat(ingest): unpin traitlets (#11731) 2024-10-29 09:21:20 +01:00
Jonny Dixon
8b062eb8bd
feat(ingest/oracle): retire deprecated cx_oracle library (#11607)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-23 14:39:57 -07:00
Harshal Sheth
35f30b7d3c
feat(ingest): use mainline sqlglot (#11693) 2024-10-22 19:57:46 -07:00
Harshal Sheth
7ba77a959c
fix(ingest): cache sql is_profiling_enabled method (#11665)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-10-22 11:49:57 -07:00
Harshal Sheth
6e3724b2da
perf(ingest): streamline CLL generation (#11645) 2024-10-17 17:50:59 -07:00
Harshal Sheth
58f5b4a0cb
fix(ingest): add preset deps (#11637) 2024-10-16 17:23:01 +05:30
Shuixi Li
f147b51fc8
feat(ingest): add preset source (#10954)
Co-authored-by: MARK CHENG <hcheng@wealthsimple.com>
Co-authored-by: hwmarkcheng <94201005+hwmarkcheng@users.noreply.github.com>
2024-10-09 20:27:31 -07:00
Andrew Sikowitz
3c1dcf99b0
fix(ingest/sqlglot): Make detach_ctes more robust (#11449) 2024-09-23 11:42:55 -07:00
Harshal Sheth
f4033707d4
chore(ingest): bump acryl-sqlglot (#11331) 2024-09-09 21:09:44 -07:00
sid-acryl
3150d90bd1
fix(ingestion/tableau): restructure the tableau graphql datasource query (#11230)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-09 10:45:06 -07:00
Harshal Sheth
5467481f16
fix(py): fix issues with AvroException (#11311) 2024-09-09 09:02:05 +02:00
Mayuri Nehate
1f3688a1ed
feat(ingest/databricks): include metadata for browse only tables (#10766)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-02 19:09:45 +05:30
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
Felix Lüdin
ce99bc4f22
feat(ingest): add ingestion source for SAP Analytics Cloud (#10958)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 11:29:15 -07:00
david-leifker
94e7706e3b
chore(bump): bump azure-identity (#11235)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 09:44:08 -05:00