578 Commits

Author SHA1 Message Date
Hyejin Yoon
f986315582
doc: Acryl to DataHub, datahubproject.io to datahub.com (#13252)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2025-04-28 10:34:33 -04:00
Aseem Bansal
49ee849382
chore: update lint dependencies (#13316)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
2025-04-25 20:29:11 +05:30
Aseem Bansal
64829a3279
chore(build): upgrade dependencies (#13286) 2025-04-23 14:49:40 +05:30
Hyejin Yoon
6cc3fff57f
fix(ingest/mlflow): pin mlflow-skinny version (#13208) 2025-04-16 08:27:31 +09:00
Andrew Sikowitz
3e37f76428
feat(ingest/tableau): Allow specifying asset types for ingest_hidden_assets (#13190) 2025-04-11 20:07:37 -07:00
Aseem Bansal
2a75a981ca
chore(ci): upgrade ruff version (#13125) 2025-04-09 11:24:07 +05:30
Pedro Silva
a4b343cc82
fix(ingest/delta-lake): Bump delta-lake dependency (#12766)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
2025-04-04 12:19:13 -07:00
Harshal Sheth
1d22c58e13
chore(ingest): use typing-aware deprecation type (#12982) 2025-03-26 11:32:46 -07:00
Sergio Gómez Villamor
5c58dbacce
feat(ingest): new hex connector - part 1 (#12915) 2025-03-25 19:47:11 +01:00
ryota-cloud
9f8753bcb2
feat(ingestion) Adding vertexAI ingestion source (v2 - experiment and experiment run) (#12836) 2025-03-21 14:06:17 -07:00
Harshal Sheth
85a5b5cea1
fix(ingest): pin lookml liquid dep (#12896) 2025-03-17 13:51:04 -07:00
Harshal Sheth
8fbc4d125f
fix(ingest): fix superset declared deps (#12889) 2025-03-17 10:29:02 -07:00
ryota-cloud
0e62e8c77a
feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) (#12632) 2025-03-13 11:02:15 -07:00
Sergio Gómez Villamor
aed2433c4c
fix: fixes mypy complaints about pkgresources (#12790) 2025-03-05 12:41:03 +01:00
Harshal Sheth
61d4992cc9
chore(ci): avoid dep on confluent-kafka 2.8.1 (#12753) 2025-02-28 10:14:07 -08:00
Harshal Sheth
a5af1a8b7e
fix(ingest): bump avro dep (#12729) 2025-02-26 09:24:38 -08:00
Aseem Bansal
d1494c2252
dev: upgrade ruff, remove 2 ruff ignore rules (#12702) 2025-02-24 14:07:57 +05:30
Harshal Sheth
389a404bf1
chore(ingest): bump sqlglot version to latest (#12696) 2025-02-22 11:35:43 -08:00
Harshal Sheth
6d05971073
fix(ingest): add missing dep for gcs (#12505) 2025-01-31 18:35:57 +05:30
david-leifker
f527c5ed55
feat(iceberg-rest): implement iceberg REST catalog api (#12500)
Co-authored-by: ksrinath <ksrinath@users.noreply.github.com>
Co-authored-by: Chakravarthy Racharla <chakru.racharla@acryl.io>
2025-01-30 15:38:15 +05:30
cccs-cat001
bc09b28a64
refactor(operation_config): change logging on is_profiling_enabled (#12416)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2025-01-29 21:56:35 -08:00
Aseem Bansal
cc0d43f5a8
feat(ingest): add datahub apply source (#12482) 2025-01-29 21:37:17 +05:30
Harshal Sheth
a8d6c54965
feat(sdk): move version info to dedicated file (#12456) 2025-01-24 11:35:39 -08:00
Pedro Silva
3030f90aaf
fix(ingest/slack): Add retries (#12401) 2025-01-23 16:10:26 +05:30
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Aseem Bansal
436b74cd3a
dev: move from flake8,isort to ruff (#12375) 2025-01-17 23:50:13 +05:30
Aseem Bansal
765bf80282
dev(ingest): move from isort to ruff (#12364) 2025-01-16 16:48:21 +05:30
Aseem Bansal
2226820ad1
dev(ingest): use ruff instead of flake8 (#12359) 2025-01-16 08:19:07 +05:30
Harshal Sheth
a06a229499
feat(ingest/datahub): use stream_results with mysql (#12278) 2025-01-06 15:29:51 -08:00
skrydal
b76db335a2
fix(ingestion/redshift): Bumped redshift-connector dependency due to CVE-2024-12745 (#12265) 2025-01-03 13:33:45 +01:00
Harshal Sheth
4e3103e266
fix(ingest): use typing_extensions.Self (#12230) 2024-12-27 10:50:43 -08:00
Harshal Sheth
ed8639e401
chore(python): test with python 3.11 (#11280)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-12-27 10:46:49 -08:00
Mayuri Nehate
953893cf2e
refactor(ingest/kafka-connect): define interface for new connector impl (#12149) 2024-12-19 12:39:47 +05:30
Mayuri Nehate
01a2c0c779
fix(ingest/kafka): update dependency, tests (#12159) 2024-12-18 19:02:44 +05:30
Andrew Sikowitz
ff385edbb1
build(ingest/sqlglot): Bump pin to support snowflake CREATE ... WITH TAG (#12003) 2024-12-17 03:49:47 -08:00
sagar-salvi-apptware
57b12bd9cb
fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020) 2024-12-10 08:36:01 -08:00
Harshal Sheth
65f44efbad
fix(ingest): avoid bad IPython version (#12035) 2024-12-04 14:50:56 -08:00
k-bartlett
dc87b51369
feat(ingest): connector for Neo4j (#11526)
Co-authored-by: kbartlett <keith.bartlett@fullsight.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Jay Feldman <8128360+feldjay@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: deepgarg-visa <149145061+deepgarg-visa@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
2024-12-02 14:53:28 +05:30
Harshal Sheth
0476bf1e32
feat(ingest): bump typing_extensions dep (#11965) 2024-11-28 21:41:53 -05:00
skrydal
816fd3dba7
fix(ingestion/iceberg): Improvements to iceberg source (#11987) 2024-11-28 15:34:20 +00:00
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Harshal Sheth
5519a330e2
chore(ingest): bump black (#11898) 2024-11-20 13:33:54 -08:00
mikeburke24
4601aacfad
fix(ingest): upgrade msal (#11883) 2024-11-19 15:59:37 +05:30
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
Andrew Sikowitz
5ff6295b0f
fix(ingest/partition-executor): Fix deadlock by recomputing ready items (#11853) 2024-11-14 08:48:30 +01:00
sagar-salvi-apptware
5d17ecb290
feat(ingest/dremio): Dremio Source Ingestion (#11598)
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-05 22:06:35 +05:30
Harshal Sheth
e609ff810d
feat(ingest/powerbi): improve reporting around m-query parser (#11763) 2024-10-31 16:27:45 -07:00
chriscc2
9329916239
feat(ingest): unpin looker-sdk dependency (#11755)
Co-authored-by: Chris Chan <chriscchan@google.com>
2024-10-31 15:50:41 -07:00
Harshal Sheth
143fc011fa
feat(ingest/powerbi): add timeouts for m-query parsing (#11753) 2024-10-30 19:40:45 +01:00