1093 Commits

Author SHA1 Message Date
Jonny Dixon
97add039c7 Update test_tableau_virtual_connections.py 2025-10-26 20:16:31 +00:00
Jonny Dixon
438321b58f readying for PR 2025-10-26 11:31:39 +00:00
Jonny Dixon
bd96b1bad3 clean up 2025-10-23 17:53:17 +01:00
Jonny Dixon
9381898611 fixes to standard non vc path 2025-10-23 17:33:13 +01:00
Jonny Dixon
d03254ac8c updates 2025-10-23 00:45:50 +01:00
Jonny Dixon
c2a6ea3263 fixes 2025-10-22 20:32:01 +01:00
Jonny Dixon
14e1c30e12 Merge master into implement-tableau-virtual-connections
- Successfully merged all latest changes from master
- Resolved conflict in tableau.py by keeping virtual connections imports
- All Tableau virtual connections functionality preserved
- Applied automatic linting fixes
- Branch now includes all latest upstream improvements
2025-10-22 18:54:57 +01:00
kyungsoo-datahub
eecc2e922c
fix(ingest): Handle empty column names in SQL parsing column lineage (#15013)
Co-authored-by: Kyungsoo Lee <kyungsl@Kyungsoos-MacBook-Pro.local>
2025-10-22 16:09:32 +00:00
Tamas Nemeth
e9becdd11c
feat(ingest/snowfle,bigquery): Stateful time window ingestion for queries v2 with bucket alignment (#15040) 2025-10-22 11:16:50 +02:00
Tamas Nemeth
22c602dcaf
feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899) 2025-10-21 08:33:39 +02:00
skrydal
46b5ce0d14
fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026) 2025-10-17 18:49:05 +02:00
Aseem Bansal
45dda5e33a
feat(cli): add user add command (#15011) 2025-10-16 20:36:59 +05:30
Aseem Bansal
6610883fe1
refactor(sdk): extract env variables into a single file (#15021) 2025-10-16 19:04:43 +05:30
Chaiwon Hyun
afc6b138b7
fix(mongo-source): Add failing test for complex topic name parsing (#15002)
Co-authored-by: Winnie <winnie@wrtn.io>
2025-10-16 18:48:02 +05:30
Tamas Nemeth
f02ef04e6d
fix(ingest/teradata): Fix Teradata lineage URN generation to prevent extra database prefixes (#14715) 2025-10-15 12:29:26 +02:00
Tamas Nemeth
18d3eec8d7
feat(ingest/unity): Use sql to extract query history for usage (#14953) 2025-10-15 10:46:59 +02:00
Tamas Nemeth
60f0abb72a
choir(ingestion/sqlparser): Bump sqlglot to v27.27.0 (#15008) 2025-10-15 10:46:30 +02:00
Shirshanka Das
f9913cd944
feat(cli): graphql command (#14781) 2025-10-14 21:04:44 -07:00
Sergio Gómez Villamor
0f71cf0ebf
chore(iceberg): bump dependency (#15001) 2025-10-14 14:33:31 +00:00
Sergio Gómez Villamor
c4e104eba2
feat(dataproduct): output ports (#15000) 2025-10-14 15:49:04 +02:00
Aseem Bansal
7ee4085316
fix(ingest/grafana): filter out invalid input field workunits (#14972) 2025-10-14 14:06:47 +05:30
Tamas Nemeth
e8c144362e
fix(ingest/dremio): Dremio sql parsing fix (#14974) 2025-10-13 11:03:19 +02:00
Aseem Bansal
7b5680efbc
fix(ingest): serialisation of structured report (#14973) 2025-10-10 19:29:56 +05:30
Sergio Gómez Villamor
e847b58472
feat(ingest): ensure payload size constraints for queryProperties, querySubjects and upstreamLineage aspects (#14919)
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-06 18:10:59 +00:00
Anush Kumar
40b51ac2da
feat(ingestion): Added Databricks support to Fivetran source (#14897) 2025-10-06 10:06:37 -07:00
Aseem Bansal
cecb91b615
feat(ingest): add high level stage for ingestion (#14862) 2025-10-03 18:29:04 +05:30
Tamas Nemeth
78d258383f
fix(ingest/snowflake): Skip sql parsing if all the features disable in config where it is needed (#14908) 2025-10-03 11:08:26 +02:00
Tamas Nemeth
5b4a082c03
fix(ingest/snowflake): Fixed the Snowflake external URL generation issue for privatelink connections. (#14905) 2025-10-02 17:49:59 +02:00
Michael Maltese
5da54bf14d
feat(s3/ingest): performance improvements for get_dir_to_process and get_folder_info (#14709) 2025-10-02 15:51:02 +02:00
Anush Kumar
00caa38adf
feat(ingestion/sqlglot): preserve CTEs when extracting SELECT from INSERT statements and add corresponding unit test (#14898) 2025-10-01 13:52:35 +02:00
Sergio Gómez Villamor
e9e18e4705
feat(secret): FileSecretStore and EnvironmentSecretStore (#14882) 2025-09-30 07:30:56 +00:00
Mayuri Nehate
e698f0bf1d
feat(sdk/search): add tags, glossary terms filter (#14873)
Co-authored-by: Mayuri N <mayuri.nehate@datahub.com>
2025-09-29 06:31:39 +00:00
Mayuri Nehate
8d13b03e85
feat(sdk/search): add owner filter (#14649)
Co-authored-by: Mayuri N <mayuri.nehate@datahub.com>
2025-09-29 04:35:29 +00:00
Anush Kumar
c18b125a05
feat(ingestion): Enhanced column lineage extraction for Looker/LookML (#14826) 2025-09-26 09:27:18 -07:00
Tamas Nemeth
7e9c525448
fix(ingestion): Fix for module level variable caching in sqllite check (#14861) 2025-09-26 14:24:51 +02:00
Michael Maltese
55d714e0cd
fix(ingest/mssql): don't split_statements on keywords inside bracketed identifiers (#14863) 2025-09-25 12:29:38 -04:00
skrydal
b0c9662be7
feature(transformers): Introduce Set browsePathsV2 transformer (#14825) 2025-09-23 19:20:01 +00:00
Anush Kumar
0f69e96078
feat(sdk): Added support for Change Audit Stamps in Dashboard and Chart entities (#14815) 2025-09-23 07:07:52 -07:00
Harshal Sheth
a17fc4e0a8
chore(python): drop pydantic v1 support (#14014)
Co-authored-by: Sergio Gómez Villamor <sgomezvillamor@gmail.com>
Co-authored-by: Piotr Skrydalewicz <piotr.skrydalewicz@acryl.io>
2025-09-23 07:40:29 +00:00
Anush Kumar
7c1200c704
refactor(ingestion): looker source migration to use SDKv2 entities (#14693) 2025-09-18 13:26:50 -07:00
Jonny Dixon
5be17c6444
feat(ingestion/tableau): parameter to have entity owners as email address of owner (#14724) 2025-09-18 15:25:14 +00:00
Kevin Karch
002cc398d0
fix(ingest): change redash sql parse error to warnining (#14785) 2025-09-17 08:06:15 -04:00
skrydal
667b7cb12c
fix(sdk_v2/lineage): Fix handling of null platform (#14784) 2025-09-17 09:11:03 +02:00
Sergio Gómez Villamor
d82ae8014e
feat(bigquery): add created and modified timestamps to dataset containers (#14716)
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-15 18:24:58 +02:00
Sergio Gómez Villamor
492e28a938
feat(ingest/neo4j): migrate Neo4j source to DataHub Python SDK v2 (#14591)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Claude <noreply@anthropic.com>
2025-09-15 08:42:54 +00:00
Tamas Nemeth
01932d3f87
fix(ingest/pipeline): Fix for slow ingestion and incomplete ingestion report metrics (#14735) 2025-09-11 16:07:47 +02:00
Aseem Bansal
137ffb7d48
fix(ingest): only add to samples where platform match (#14722) 2025-09-11 13:26:39 +05:30
skrydal
5f23652fd3
fix(ingestion/iceberg): Improve iceberg source resiliency to server errors (#14731) 2025-09-11 00:57:03 +02:00
Tamas Nemeth
a82d4e0647
fix(ingest/athena): Fix Athena partition extraction and CONCAT function type issues (#14712) 2025-09-10 12:33:54 +02:00
Tamas Nemeth
4ea758da19
chore(ingest/sqlparser): Bump sqlglot to 27.12.0 (#14673) 2025-09-09 19:57:52 +02:00