588 Commits

Author SHA1 Message Date
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Harshal Sheth
5519a330e2
chore(ingest): bump black (#11898) 2024-11-20 13:33:54 -08:00
mikeburke24
4601aacfad
fix(ingest): upgrade msal (#11883) 2024-11-19 15:59:37 +05:30
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
Andrew Sikowitz
5ff6295b0f
fix(ingest/partition-executor): Fix deadlock by recomputing ready items (#11853) 2024-11-14 08:48:30 +01:00
sagar-salvi-apptware
5d17ecb290
feat(ingest/dremio): Dremio Source Ingestion (#11598)
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-05 22:06:35 +05:30
Harshal Sheth
e609ff810d
feat(ingest/powerbi): improve reporting around m-query parser (#11763) 2024-10-31 16:27:45 -07:00
chriscc2
9329916239
feat(ingest): unpin looker-sdk dependency (#11755)
Co-authored-by: Chris Chan <chriscchan@google.com>
2024-10-31 15:50:41 -07:00
Harshal Sheth
143fc011fa
feat(ingest/powerbi): add timeouts for m-query parsing (#11753) 2024-10-30 19:40:45 +01:00
Harshal Sheth
93f76def1f
fix(ingest): pin teradata dep (#11760) 2024-10-30 10:38:33 -07:00
Harshal Sheth
c8704509a4
fix(ingest/bigquery): add missing path spec deps (#11748) 2024-10-30 11:13:15 +01:00
Harshal Sheth
b26da57928
feat(ingest): remove dep on termcolor (#11733) 2024-10-29 17:48:55 +01:00
Harshal Sheth
bea253a064
feat(ingest): unpin traitlets (#11731) 2024-10-29 09:21:20 +01:00
Jonny Dixon
8b062eb8bd
feat(ingest/oracle): retire deprecated cx_oracle library (#11607)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-23 14:39:57 -07:00
Harshal Sheth
35f30b7d3c
feat(ingest): use mainline sqlglot (#11693) 2024-10-22 19:57:46 -07:00
Harshal Sheth
7ba77a959c
fix(ingest): cache sql is_profiling_enabled method (#11665)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-10-22 11:49:57 -07:00
Harshal Sheth
6e3724b2da
perf(ingest): streamline CLL generation (#11645) 2024-10-17 17:50:59 -07:00
Harshal Sheth
58f5b4a0cb
fix(ingest): add preset deps (#11637) 2024-10-16 17:23:01 +05:30
Shuixi Li
f147b51fc8
feat(ingest): add preset source (#10954)
Co-authored-by: MARK CHENG <hcheng@wealthsimple.com>
Co-authored-by: hwmarkcheng <94201005+hwmarkcheng@users.noreply.github.com>
2024-10-09 20:27:31 -07:00
Andrew Sikowitz
3c1dcf99b0
fix(ingest/sqlglot): Make detach_ctes more robust (#11449) 2024-09-23 11:42:55 -07:00
Harshal Sheth
f4033707d4
chore(ingest): bump acryl-sqlglot (#11331) 2024-09-09 21:09:44 -07:00
sid-acryl
3150d90bd1
fix(ingestion/tableau): restructure the tableau graphql datasource query (#11230)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-09 10:45:06 -07:00
Harshal Sheth
5467481f16
fix(py): fix issues with AvroException (#11311) 2024-09-09 09:02:05 +02:00
Mayuri Nehate
1f3688a1ed
feat(ingest/databricks): include metadata for browse only tables (#10766)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-09-02 19:09:45 +05:30
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
Felix Lüdin
ce99bc4f22
feat(ingest): add ingestion source for SAP Analytics Cloud (#10958)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 11:29:15 -07:00
david-leifker
94e7706e3b
chore(bump): bump azure-identity (#11235)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 09:44:08 -05:00
Mayuri Nehate
223650dd7a
feat(ingest): add bigquery-queries source (#10994)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-25 22:51:00 -07:00
Mayuri Nehate
9568a4254d
feat: separate great-expectations action package (#11096)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 12:13:36 -04:00
sid-acryl
627c5abfd6
feat(ingestion/bigquery): Add ability to filter GCP project ingestion based on project labels (#11169)
Co-authored-by: Alice Naghshineh <alice.naghshineh@nytimes.com>
Co-authored-by: Alice Naghshineh <45885699+anaghshineh@users.noreply.github.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-08-20 14:42:00 -04:00
skrydal
b46a9632cb
fix(tests): Bump databricks-sdk dependency to >=0.30.0 (#11209) 2024-08-20 15:07:30 +01:00
sid-acryl
cb33c0fef7
feat(ingestion/lookml): support looker -- if comments (#11113) 2024-08-16 15:27:59 -04:00
Tamas Nemeth
5e9188ca2c
fix(ingest/databricks): Updating code to work with Databricks sdk 0.30 (#11158) 2024-08-13 16:57:31 +02:00
sid-acryl
b1f16f9b11
fix(ingestion/lookml): fix for sql parsing error (#11079)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-09 15:06:42 -07:00
Harshal Sheth
f78b6c08fb
fix(py): remove dep on types-pkg_resources (#11076) 2024-08-02 17:27:54 +05:30
Harshal Sheth
e83550ba35
feat(ingest/tableau): add retry on timeout (#10995) 2024-07-31 12:20:48 -07:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container (#11013) 2024-07-30 15:17:04 +05:30
Harshal Sheth
1fa7998ed3
feat(ingest): support domains in meta -> "datahub" section (#10967) 2024-07-25 09:31:19 -07:00
Tamas Nemeth
20574cf1c6
feat(ingest/athena): Add option for Athena partitioned profiling (#10723) 2024-07-20 00:00:40 +02:00
Tamas Nemeth
4fe5f280b3
fix(ingest/setup): feast and abs source setup (#10951) 2024-07-19 19:00:43 +05:30
Joel Pinto Mata (KPN-DSH-DEX team)
13b6febce9
feat(ingest/abs): Adding azure blob storage ingestion source (#10813) 2024-07-17 11:06:05 +02:00
Aseem Bansal
437bacb0e6
feat(ingest): grafana connector (#10891)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-15 14:12:18 -07:00
Harshal Sheth
a4bce6af1c
feat(ingest): add snowflake-queries source (#10835) 2024-07-12 15:08:51 -07:00
Harshal Sheth
89bda5bdd9
fix(ingest/redshift): handle multiline alter table commands (#10727) 2024-07-11 16:32:37 -07:00
Harshal Sheth
44930dfd1e
fix(ingest/looker): add missing dependency (#10876) 2024-07-11 13:25:13 -07:00
sid-acryl
609847fa59
fix(ingestion/looker): Add sqlglot dependency and remove unused sqlparser (#10874) 2024-07-09 12:51:08 -07:00
Tamas Nemeth
1c8e8c32b5
chore(ingest): Mypy 1.10.1 pin (#10867) 2024-07-08 19:43:45 +02:00
sid-acryl
43bac365bc
fix(ingestion/lookml): liquid template resolution and view-to-view cll (#10542) 2024-07-08 09:26:39 -07:00
Mayuri Nehate
54b9d98177
ci(ingest): pin dask dependency for feast (#10865) 2024-07-08 18:52:11 +05:30