74 Commits

Author SHA1 Message Date
Sergio Gómez Villamor
8cae980286
tests(ingestion): moving some tests so they are available for sdk users (#13540) 2025-05-19 08:39:53 +02:00
Michael Minichino
0b105395e9
feat(ingest/powerbi): Support ODBC Data Source (#13090) 2025-04-10 08:57:37 -05:00
Sergio Gómez Villamor
b37fa03846
chore: fixes SIM118 ruff rule (#13069) 2025-04-04 11:59:43 +02:00
Sergio Gómez Villamor
c6acce9906
feat(powerbi): capture dataset report lineage (#12993) 2025-04-01 11:12:47 +02:00
Michael Minichino
8757a0e01a
feat(ingest/powerbi): PowerBI source updates (#12857) 2025-03-28 13:22:25 -05:00
Sergio Gómez Villamor
2aba2e3ed8
fix(powerbi): fixes direction of the dashboard-report lineage (#12881) 2025-03-19 12:25:42 +01:00
Aseem Bansal
9c3bd34995
dev: enable ruff rule (#12749) 2025-02-28 17:49:52 +05:30
Aseem Bansal
2101a50e83
dev: immutable args remove (#12735) 2025-02-27 15:38:47 +05:30
Sergio Gómez Villamor
32b654ce20
feat(powerbi): Report to Dashboard lineage (#12451) 2025-02-05 11:27:48 +01:00
Sergio Gómez Villamor
3471857893
refactor(powerbi): dashboards, reports and independent_datasets accessed by id (#12431) 2025-01-23 08:41:46 +01:00
Aseem Bansal
262dd76518
dev: remove black in favor of ruff for formatting (#12378) 2025-01-18 15:06:20 +05:30
Aseem Bansal
76e46b89db
dev(ingest): move modules from isort,flake8 to ruff (#12373) 2025-01-17 21:38:29 +05:30
Harshal Sheth
e1998dd371
chore(ingest): remove enable_logging helper (#12222) 2024-12-26 12:34:00 -08:00
sid-acryl
0b4d96e95c
fix(ingest/powerbi): support comments in m-query grammar (#12177) 2024-12-21 12:07:53 +05:30
sid-acryl
7bf7673735
refactor(ingest/powerbi): organize code within the module based on responsibilities (#11924) 2024-11-27 09:32:24 -08:00
Harshal Sheth
1bfd4ee1d4
feat(ingest): handle mssql casing issues in lineage (#11920) 2024-11-21 17:16:04 -08:00
Harshal Sheth
5519a330e2
chore(ingest): bump black (#11898) 2024-11-20 13:33:54 -08:00
sid-acryl
3f267afc97
fix(ingest/powerbi): m-query fixes (#11906)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-11-20 11:31:54 -08:00
sid-acryl
6454ff30ab
feat(ingest/powerbi): DatabricksMultiCloud native query support (#11756)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-11-12 19:26:06 +05:30
Harshal Sheth
d5d4810457
fix(ingest/powerbi): change default for use_powerbi_email (#11742)
Co-authored-by: sid-acryl <155424659+sid-acryl@users.noreply.github.com>
2024-11-06 14:28:47 +05:30
Harshal Sheth
143fc011fa
feat(ingest/powerbi): add timeouts for m-query parsing (#11753) 2024-10-30 19:40:45 +01:00
sid-acryl
0e62c699fc
fix(ingestion/powerbi): handle double quotes in M-query (#11743) 2024-10-29 21:47:19 -07:00
sid-acryl
8c53c54081
feat(ingestion/powerbi): ingest powerbi app (#11629) 2024-10-29 09:19:37 +01:00
sid-acryl
ce909c8b8b
feat(ingest/powerbi): link cross workspace dataset into assets (#11560) 2024-10-16 08:28:05 -07:00
sid-acryl
59a2f70858
feat(ingest/powerbi): fix subTypes and add workspace_type_filter (#11523)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-11 08:54:50 -07:00
sid-acryl
6b961133e9
fix(ingestion/powerbi): fix for databricks lineage m-query pattern (#11462) 2024-10-07 14:42:44 -07:00
sid-acryl
2755cf3559
fix(ingest/powerbi): fix broken lineage between chart and dataset (#11080) 2024-08-06 21:02:21 -07:00
sid-acryl
dffdef2eaa
fix(ingestion/powerbi): fix issue with broken report lineage (#10910) 2024-07-31 11:40:09 -07:00
Shubham Jagtap
b6c7fe8267
refactor(ingestion): remove company domain for security reason (#10839) 2024-07-08 21:15:20 -07:00
Teppo Naakka
b223281305
feat(ingest/powerbi): powerbi dataset profiling (#9355) 2024-06-28 14:50:08 -07:00
Harshal Sheth
7a519ac73c
fix(ingest/dbt): resolve more dbt ephemeral node lineage gaps (#10553) 2024-05-22 12:44:54 -07:00
sid-acryl
666de9e4e6
fix(ingestion/powerbi): Databricks support for table lineage (#10416) 2024-05-22 18:57:45 +05:30
sid-acryl
40d2ae3b78
fix(ingestion/powerbi): handle special character #(tab) in native query parsing (#10520) 2024-05-20 15:20:39 +05:30
dushayntAW
5497393096
fix(ingest/powerbi): patch lineage for powerbi report (#10270) 2024-04-12 15:21:06 +05:30
Harshal Sheth
c480b59b0b
feat(ingest/powerbi): add chart subtypes (#10076) 2024-03-21 09:20:40 +01:00
Shubham Jagtap
1741c07d76
feat(ingestion): Add test_connection methods for important sources (#9334) 2023-12-14 12:31:51 -05:00
Aseem Bansal
b0de1dc0ce
fix(powerbi): add access token refresh (#9405)
Co-authored-by: elish7lapid <elisheva@foundational.io>
Co-authored-by: treff7es <treff7es@gmail.com>
2023-12-14 18:41:50 +05:30
Harshal Sheth
08a9b9b6de
fix(ingest): bug fixes and docs updates (#9422) 2023-12-08 16:18:34 -05:00
Teppo Naakka
0e40d38f4c
fix(ingest/powerbi): fix powerbi chart input handling (#9415) 2023-12-08 13:02:03 +01:00
Teppo Naakka
107713846f
fix(ingest/powerbi): use dataset workspace id as key for parent container (#8994) 2023-11-09 16:48:06 -08:00
Harshal Sheth
84bba4dc44
feat(ingest): add output schema inference for sql parser (#8989) 2023-10-11 22:31:17 -07:00
Aseem Bansal
2bc685d3b9
ci: tweak ci to decrease wait time of devs (#8945) 2023-10-05 09:31:32 +05:30
siddiquebagwan-gslab
c415d63dda
feat(ingestion/powerbi): column level lineage extraction for M-Query (#8796) 2023-10-04 16:22:51 +05:30
Harshal Sheth
9deb7be3fc
fix(ingest): refactor test markers + fix disk space issues in CI (#8938) 2023-10-03 20:17:49 -07:00
siddiquebagwan-gslab
8ee58af0c2
feat(ingestion/powerbi): support multiple tables as upstream in native SQL parsing (#8592) 2023-08-23 14:38:58 +05:30
Andrew Sikowitz
bf9f380350
fix(ingest): Generate browse paths v2 for more sources; properly pass platform_instance (#8501) 2023-07-25 11:35:34 +05:30
Andrew Sikowitz
3a21c27f06
feat(ingest): Turn on browse path v2 creation (#8342)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-07-06 16:43:42 -04:00
mohdsiddique
e7e07a73b4
feat(ingestion/powerbi): Ingest datasets not used in PowerBI visualization(tiles/pages) (#8212)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
2023-06-15 14:04:40 -07:00
Andrew Sikowitz
fdbc4de695
refactor(ingest): Call source_helpers via new WorkUnitProcessors in base Source (#8101) 2023-05-24 13:36:19 -07:00
Harshal Sheth
b0f8c3de1e
refactor(ingest): simplify stateful ingestion provider interface (#8104)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-05-23 12:57:57 -07:00