927 Commits

Author SHA1 Message Date
Harshal Sheth
1f9ce9d7d8
feat(ingest/dbt): point dbt assertions at dbt nodes (#10055) 2024-03-18 18:13:01 -07:00
Harshal Sheth
05930560cc
feat(ingest/s3): set default spark version (#10057) 2024-03-18 14:27:01 -07:00
dushayntAW
3a4bdef44a
fix(ingest/unity): generate sibling and lineage (#9894) 2024-03-18 20:22:17 +05:30
Mayuri Nehate
77c72dad01
feat(ingest): add classification to bigquery, redshift (#10031) 2024-03-13 22:45:28 -07:00
Harshal Sheth
b0163c4885
feat(ingest): utilities for query logs (#10036) 2024-03-12 23:20:46 -07:00
Harshal Sheth
4155a621a6
feat(ingest/dbt): capture both raw and compiled code (#10026) 2024-03-12 12:54:03 -07:00
Mayuri Nehate
2de0e62ac4
feat(ingest): add classification for sql sources (#10013)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-12 09:23:20 -07:00
Harshal Sheth
7e2076e852
feat(ingest): add query formatting to sql aggregator (#10025) 2024-03-11 15:34:44 -07:00
Mayuri Nehate
8047d0b514
feat(ingest/snowflake): generate query nodes for snowflake (#9966)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-03-06 15:11:37 -08:00
dushayntAW
68a26b47b2
fix(ingest/delta-lake): support parsing nested types correctly (#9862) 2024-03-06 19:22:01 +05:30
Harshal Sheth
4189ca9532
feat(ingest/dbt): generate CLL for all node types (#9964) 2024-03-05 10:07:03 -08:00
Shubham Jagtap
4d053f1ad3
fix(ingestion/fivetran): Fix fivetran get connector jobs bug (#9975) 2024-03-05 17:31:28 +01:00
AvaniSiddhapuraAPT
782d33db99
fix(ingest/bigquery): escape special characters for table descriptions (#9932) 2024-03-05 21:00:09 +05:30
Harshal Sheth
5bee25fa20
feat(ingest): add Looks subtype + stop reemitting browsePathV2 (#9978) 2024-03-05 14:27:41 +01:00
Tamas Nemeth
f561efee83
fix(ingest/mysql): Adding support for bit type (#9950) 2024-02-28 15:00:14 +01:00
Tamas Nemeth
d2d9661a1e
fix(ingest/patch): Adding proper json patch path quoting (#9872) 2024-02-26 18:46:21 -08:00
Harshal Sheth
ca613ba0e2
feat(ingest/tableau): add non-embedded custom sql to project container (#9875) 2024-02-26 15:08:17 -08:00
Shubham Jagtap
a1f2216da7
feat(ingest/qlik): Qlik cloud connector integration (#9682)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-26 11:27:37 -08:00
Shubham Jagtap
5921a334d3
feat(ingestion/trino): Add sibling support in ingestion (#9853) 2024-02-26 13:55:11 +05:30
Tony Ouyang
943edc3462
feat(ingest/mongodb): improve sorting when downsampling collection schema (#9856) 2024-02-21 15:25:29 -08:00
Jay Feldman
cda34b50fc
fix(ingest/looker): update for Looker query API breaking change (#9865) 2024-02-15 16:08:01 -08:00
Tony Ouyang
ae1806fefa
feat(ingest/dynamoDB): flatten struct fields (#9852)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-02-15 13:40:03 -08:00
sleeperdeep
7d73c41989
feat(ingest/oracle): support changing data dictionary (ALL_ or DBA_) (#8873)
Co-authored-by: sleeperdeep <--global>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-09 18:56:52 -05:00
Sergio Gómez Villamor
93a7afbf0f
feat(ingest/glossary): handle ownership type in business glossary connector (#9805) 2024-02-09 16:30:51 -05:00
Harshal Sheth
0d780e5f8f
feat(ingest): sql parsing aggregator (#9786) 2024-02-09 16:27:45 -05:00
Tamas Nemeth
3bfc1e46a7
fix(ingest/fivetran): Fixing issue when connector user is empty (#9774) 2024-02-05 11:51:57 -08:00
Ellie O'Neil
d1604b39cc
feat(ingestion/tableau) Ingest tags from datasource (#9730)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-29 17:17:07 -08:00
Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 (#9731) 2024-01-29 10:50:47 -08:00
tom
f7f0b14f37
fix(ingestion/metabase): Fetch Dashboards through Collections (#9631)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-25 17:51:41 -08:00
Andrew Sikowitz
53c7790f9a
feat(ingest/metabase): Use new sql parser; reduce error reporting levels (#9714) 2024-01-25 10:36:59 +01:00
sleeperdeep
720296ea46
fix(ingestion/mssql): use platform_instance for mssql dataflow/datajob (#9527)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: sleeperdeep <--global>
2024-01-22 20:25:01 -08:00
Harshal Sheth
b94d463fe0
feat(ingest/lookml): support complex lookml manifests (#9688) 2024-01-22 16:23:56 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
Mayuri Nehate
77df9ec926
feat(ingest/databricks): view upstream lineage for hive metastore (#9657) 2024-01-22 18:07:43 +05:30
Quentin FLEURENT NAMBOT
20ad83d0b1
feat(superset): add some custom properties for dashboards (#9670) 2024-01-20 14:54:10 +05:30
Mayuri Nehate
f2e78db92e
feat(ingest/databricks): ingest hive metastore by default, more docs (#9601)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-18 14:26:33 -08:00
Harshal Sheth
98e3da42f5
feat(ingest/looker): add backpressure-aware executor (#9615)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-01-12 18:54:08 +01:00
Harshal Sheth
b926a3ede6
feat(ingest/looker): add retries to API calls (#9606) 2024-01-12 13:42:52 +01:00
Harshal Sheth
990bb65fec
feat(ingest/tableau): include platform_instance in browse v1 path (#9607) 2024-01-11 11:32:00 +05:30
Shubham Jagtap
0486319bc8
feat(ingestion/fivetran): Add fivetran bigquery destination support (#9531)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-10 14:18:36 -05:00
Shubham Jagtap
3f9b90158f
fix(ingestion/starburst-trino): Fix validation errors in TrinoJoinedAccessEvent (#9580)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-10 12:56:04 -05:00
Harshal Sheth
c9613043c8
fix(ingest): improve kafka-connect test stability (#9519) 2024-01-03 11:28:22 -08:00
Mayuri Nehate
29f2142a2c
feat(databricks): add hive metastore analyze profiling (#9511) 2024-01-02 23:18:43 -05:00
Diego Reiriz Cores
60347d6735
fix(ingest/mongodb): support disabling schemaSamplingSize (#9295)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-12-28 16:39:10 +05:30
Harshal Sheth
0d8568e087
fix(ingest): update dbt type inference (#9512) 2023-12-22 14:59:14 -05:00
Harshal Sheth
b80d2f471c
fix(ingest/fivetran): only materialize upstream lineage (#9490) 2023-12-21 13:35:34 -05:00
Harshal Sheth
ecda3e6187
feat(ingest): pydantic v2 compatibility (#9434) 2023-12-18 18:26:33 -05:00
Tamas Nemeth
03590a1948
fix(ingest/snowflake) - Fixing snowflake url with default region (#9443) 2023-12-18 13:54:31 -05:00
Harshal Sheth
9d386fbd6f
feat(ingest): enable CLL for dbt by default (#9466) 2023-12-18 11:38:16 +01:00
Harshal Sheth
caef6771b8
feat(ingest/redshift): drop repeated operations (#9440) 2023-12-15 15:07:56 -05:00