945 Commits

Author SHA1 Message Date
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
Mayuri Nehate
77df9ec926
feat(ingest/databricks): view upstream lineage for hive metastore (#9657) 2024-01-22 18:07:43 +05:30
Quentin FLEURENT NAMBOT
20ad83d0b1
feat(superset): add some custom properties for dashboards (#9670) 2024-01-20 14:54:10 +05:30
Mayuri Nehate
f2e78db92e
feat(ingest/databricks): ingest hive metastore by default, more docs (#9601)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-18 14:26:33 -08:00
Harshal Sheth
98e3da42f5
feat(ingest/looker): add backpressure-aware executor (#9615)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-01-12 18:54:08 +01:00
Harshal Sheth
b926a3ede6
feat(ingest/looker): add retries to API calls (#9606) 2024-01-12 13:42:52 +01:00
Harshal Sheth
990bb65fec
feat(ingest/tableau): include platform_instance in browse v1 path (#9607) 2024-01-11 11:32:00 +05:30
Shubham Jagtap
0486319bc8
feat(ingestion/fivetran): Add fivetran bigquery destination support (#9531)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-10 14:18:36 -05:00
Shubham Jagtap
3f9b90158f
fix(ingestion/starburst-trino): Fix validation errors in TrinoJoinedAccessEvent (#9580)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-10 12:56:04 -05:00
Harshal Sheth
c9613043c8
fix(ingest): improve kafka-connect test stability (#9519) 2024-01-03 11:28:22 -08:00
Mayuri Nehate
29f2142a2c
feat(databricks): add hive metastore analyze profiling (#9511) 2024-01-02 23:18:43 -05:00
Diego Reiriz Cores
60347d6735
fix(ingest/mongodb): support disabling schemaSamplingSize (#9295)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-28 16:39:10 +05:30
Harshal Sheth
0d8568e087
fix(ingest): update dbt type inference (#9512) 2023-12-22 14:59:14 -05:00
Harshal Sheth
b80d2f471c
fix(ingest/fivetran): only materialize upstream lineage (#9490) 2023-12-21 13:35:34 -05:00
Harshal Sheth
ecda3e6187
feat(ingest): pydantic v2 compatibility (#9434) 2023-12-18 18:26:33 -05:00
Tamas Nemeth
03590a1948
fix(ingest/snowflake) - Fixing snowflake url with default region (#9443) 2023-12-18 13:54:31 -05:00
Harshal Sheth
9d386fbd6f
feat(ingest): enable CLL for dbt by default (#9466) 2023-12-18 11:38:16 +01:00
Harshal Sheth
caef6771b8
feat(ingest/redshift): drop repeated operations (#9440) 2023-12-15 15:07:56 -05:00
Tamas Nemeth
0ea6145a9d
fix(ingest/profiling): Add option to enable external table profiling (#9463) 2023-12-15 00:12:45 +01:00
Shubham Jagtap
1741c07d76
feat(ingestion): Add test_connection methods for important sources (#9334) 2023-12-14 12:31:51 -05:00
Mayuri Nehate
aac1c55a14
feat(ingest/unity): enable hive metastore ingestion (#9416) 2023-12-14 10:35:06 -05:00
Aseem Bansal
b0de1dc0ce
fix(powerbi): add access token refresh (#9405)
Co-authored-by: elish7lapid <elisheva@foundational.io>
Co-authored-by: treff7es <treff7es@gmail.com>
2023-12-14 18:41:50 +05:30
Harshal Sheth
08a9b9b6de
fix(ingest): bug fixes and docs updates (#9422) 2023-12-08 16:18:34 -05:00
Teppo Naakka
0e40d38f4c
fix(ingest/powerbi): fix powerbi chart input handling (#9415) 2023-12-08 13:02:03 +01:00
Harshal Sheth
f03c66ca1f
fix(ingest/lookml): make deploy key optional (#9378) 2023-12-07 17:18:16 -05:00
Andrew Sikowitz
16fe22aafa
feat(ui/last-updated): Calculate last updated time as max(properties time, operation time) (#9242) 2023-12-06 15:21:56 -05:00
Andrew Sikowitz
27f23ecdd5
feat(ingest/unity): GE Profiling (#8951) 2023-12-06 13:59:23 -05:00
Mayuri Nehate
08fb730676
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-28 15:49:49 -05:00
terratrue-daniel
ff9876f5a2
fix(ingest/mssql): Add MONEY and SMALLMONEY data types as Number (#9313) 2023-11-28 14:43:52 -05:00
Mayuri Nehate
a34fdfd8b7
fix(ingest/lookml): emit all views with same name and different file path (#9279) 2023-11-24 17:59:24 -05:00
Tamas Nemeth
f794a90515
fix(ingest/snowflake): Apply email filter on all usage metrics (#9269) 2023-11-23 09:45:25 +01:00
Andrew Sikowitz
5cb04981b2
test(ingest/unity): Update goldens (#9254) 2023-11-16 17:18:17 -05:00
Harshal Sheth
19aa215068
feat(ingest/dbt): dbt column-level lineage (#8991) 2023-11-13 19:00:30 -05:00
Shubham Jagtap
a187127ac5
feat(ingestion): file-based state checkpoint provider (#9029) 2023-11-10 14:36:00 -08:00
Teppo Naakka
107713846f
fix(ingest/powerbi): use dataset workspace id as key for parent container (#8994) 2023-11-09 16:48:06 -08:00
Shubham Jagtap
e73e926999
feat(integration/fivetran): Fivetran connector integration (#9018)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-07 23:02:41 -08:00
Harshal Sheth
ec9725026d
chore(ingest): remove legacy memory_leak_detector (#9158) 2023-11-02 09:39:08 -07:00
Tony Ouyang
876de214c9
feat(ingest/mongodb): support stateful ingestion (#9118) 2023-11-01 12:43:17 +05:30
Harshal Sheth
73514ad9c5
fix(ingest): cleanup large images in CI (#9153) 2023-10-31 21:28:38 -07:00
Mayuri Nehate
e02b9096bd
fix(ingest/snowflake): missing view downstream cll if platform instance is set (#8966) 2023-10-27 12:03:43 -07:00
Mayuri Nehate
5166d90433
fix(ingest/sql-server): update queries to use escaped procedure name (#9127) 2023-10-27 10:19:51 -07:00
nicholas.fwang
852267972c
refactor(ingestion/mongodb): Add platform_instance to mongodb (#8663)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-26 09:57:43 -07:00
Mayuri Nehate
f402090c1e
feat(ingest): support view lineage for all sqlalchemy sources (#9039) 2023-10-26 09:14:32 -07:00
Andrew Sikowitz
35d7770462
test(ingest/delta-lake): Fix integration tests (#9056) 2023-10-20 01:40:23 -04:00
VISHAL KUMAR
5937937819
feat(ingestion/Vertica): Fixed vertica integration test Updated vertica dialect (#9011) 2023-10-18 14:52:07 +05:30
Harshal Sheth
84bba4dc44
feat(ingest): add output schema inference for sql parser (#8989) 2023-10-11 22:31:17 -07:00
Sergio Gómez Villamor
245c5c0008
fix(ingest/looker): stop emitting tag owner (#8942) 2023-10-11 17:06:19 -07:00
Andrew Sikowitz
1a72fa499c
feat(ingest/tableau): Allow parsing of database name from fullName (#8981) 2023-10-10 17:34:06 -04:00
Mayuri Nehate
8d175ef7ef
feat(ingest): incremental lineage source helper (#8941)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-09 13:34:25 -07:00
Aseem Bansal
2bc685d3b9
ci: tweak ci to decrease wait time of devs (#8945) 2023-10-05 09:31:32 +05:30