4343 Commits

Author SHA1 Message Date
Jonny Dixon
f05f3e40f2
fix(ingestion/dremio): handle dremio oom errors when ingesting large amount of metadata (#14883) 2025-10-27 15:52:51 +00:00
Sergio Gómez Villamor
6af5182e9b
fix(mssql): replace permission-based RDS detection with server name analysis and fix SQLAlchemy 1.4+ compatibility (#14975)
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-27 10:11:49 +00:00
Shirshanka Das
9016a4446f
feat(docs): generate DataHub-optimized entity documentation variant (#15111) 2025-10-27 14:52:03 +05:30
Sergio Gómez Villamor
f844ea7b2d
chore(metabase): use non deprecated fields in ChartInfo and DashboardInfo aspects (#15102) 2025-10-27 09:17:08 +00:00
Tamas Nemeth
a865b6ba63
fix(ingest/dremio): Fix platform_instance URN generation (#15076) 2025-10-24 14:32:21 +02:00
Shirshanka Das
5a1569743a
feat(docs): add structured property for search field names in metadata model (#15097) 2025-10-23 17:43:35 -07:00
Anush Kumar
114186b01b
feat(fivetran/google_sheets): add Google Sheets support and API client integration (#15007) 2025-10-23 14:32:49 -07:00
Shirshanka Das
b1b68b42fb
feat(docs): enhance metadata model entity documentation with field tables and SDK examples (#15095) 2025-10-23 14:01:45 -07:00
Sergio Gómez Villamor
0d91067feb
chore: udpate ingestion support status (#15053) 2025-10-23 15:11:34 +00:00
Chakru
695fb4904e
fix(quickstart): handle potential wrapping of df cmd output in disk space check (#15083) 2025-10-23 16:44:54 +05:30
Sergio Gómez Villamor
12cf28186c
fix(druid): fixes docker setup for postgres in druid integration tests (#15090) 2025-10-23 10:28:12 +00:00
Sergio Gómez Villamor
605ce5e5ce
fix(mongodb): fixes missing deps for unit testing (#15077) 2025-10-22 17:44:12 +00:00
kyungsoo-datahub
eecc2e922c
fix(ingest): Handle empty column names in SQL parsing column lineage (#15013)
Co-authored-by: Kyungsoo Lee <kyungsl@Kyungsoos-MacBook-Pro.local>
2025-10-22 16:09:32 +00:00
Tamas Nemeth
e9becdd11c
feat(ingest/snowfle,bigquery): Stateful time window ingestion for queries v2 with bucket alignment (#15040) 2025-10-22 11:16:50 +02:00
Sergio Gómez Villamor
7628ab3fa4
fix(redsfhit): fix closed cursor (#15065) 2025-10-21 14:26:10 +00:00
Jonny Dixon
0b5616208f
docs(ingestion/bigquery): update docs to cover bigquery.tables.getData for use_tables_list_query_v2 parameter (#14728) 2025-10-21 15:42:41 +02:00
Sergio Gómez Villamor
0f63e6d367
chore(redshift): log time taken queries (#15054) 2025-10-21 07:31:38 +00:00
Tamas Nemeth
22c602dcaf
feat(ingest/postgres,mysql): Add iam auth support for MySql and Postgresql source (#14899) 2025-10-21 08:33:39 +02:00
Michael Maltese
b4b96ab8f9
feat(ui/ingest): unity-catalog => databricks (#14636) 2025-10-20 07:49:30 -07:00
skrydal
46b5ce0d14
fix(ingestion/mongodb): Fix handling of arrays containing complex structures (#15026) 2025-10-17 18:49:05 +02:00
Aseem Bansal
45dda5e33a
feat(cli): add user add command (#15011) 2025-10-16 20:36:59 +05:30
Sergio Gómez Villamor
b3d354bf89
chore: migrate Unity catalog from deprecated SqlParsingBuilder to SqlParsingAggregator and remove SqlParsingBuilder (#15005) 2025-10-16 14:27:23 +00:00
Aseem Bansal
6610883fe1
refactor(sdk): extract env variables into a single file (#15021) 2025-10-16 19:04:43 +05:30
Chaiwon Hyun
afc6b138b7
fix(mongo-source): Add failing test for complex topic name parsing (#15002)
Co-authored-by: Winnie <winnie@wrtn.io>
2025-10-16 18:48:02 +05:30
Neha Gslab
1934ed45e8
feat(ingestion): add ability to exclude archived mode reports. (#14978)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2025-10-16 11:58:58 +01:00
Tamas Nemeth
f02ef04e6d
fix(ingest/teradata): Fix Teradata lineage URN generation to prevent extra database prefixes (#14715) 2025-10-15 12:29:26 +02:00
Tamas Nemeth
18d3eec8d7
feat(ingest/unity): Use sql to extract query history for usage (#14953) 2025-10-15 10:46:59 +02:00
Tamas Nemeth
60f0abb72a
choir(ingestion/sqlparser): Bump sqlglot to v27.27.0 (#15008) 2025-10-15 10:46:30 +02:00
Shirshanka Das
f9913cd944
feat(cli): graphql command (#14781) 2025-10-14 21:04:44 -07:00
Sergio Gómez Villamor
0f71cf0ebf
chore(iceberg): bump dependency (#15001) 2025-10-14 14:33:31 +00:00
Sergio Gómez Villamor
c4e104eba2
feat(dataproduct): output ports (#15000) 2025-10-14 15:49:04 +02:00
Michael Maltese
4ce4718729
fix(ingest/mssql): ODBC connection always needs a database name (#14994) 2025-10-14 09:18:07 -04:00
Sergio Gómez Villamor
6e5b3580d8
fix(python): skip pydantic_core 2.41.3 (#14997) 2025-10-14 10:57:56 +00:00
Aseem Bansal
7ee4085316
fix(ingest/grafana): filter out invalid input field workunits (#14972) 2025-10-14 14:06:47 +05:30
alplatonov
9fb82a73ad
fix(ingest/deltalake) Deltalake ingestor doesn't delete metadata if the table is deleted. (#14763) 2025-10-13 13:51:17 +00:00
Pedro Silva
6a167da408
fix(build): Add --copies flag to Python venv creation for better compatibility (#14120) 2025-10-13 12:45:02 +01:00
Aseem Bansal
c20d2eb49e
fix(cli): remove pydantic warning (#14987) 2025-10-13 15:57:01 +05:30
Tamas Nemeth
e8c144362e
fix(ingest/dremio): Dremio sql parsing fix (#14974) 2025-10-13 11:03:19 +02:00
Aseem Bansal
7b5680efbc
fix(ingest): serialisation of structured report (#14973) 2025-10-10 19:29:56 +05:30
Túlio Lima
602f40d01d
fix: change deprecated filename key to path in example recipe (#14950)
Co-authored-by: acryl-hyejin <130044278+acryl-hyejin@users.noreply.github.com>
Co-authored-by: Hyejin Yoon <0327jane@gmail.com>
2025-10-10 09:26:45 +00:00
Anush Kumar
4803e9e9b6
fix(fivetran/setup): updated fivetran databricks dependencies (#14962) 2025-10-09 08:47:09 +00:00
Sergio Gómez Villamor
cfda03cf6f
docs(snowflake): use_queries_v2 + some minor fixes (#14944) 2025-10-09 08:28:14 +00:00
Anush Kumar
2a4f57791b
bugfix(fivetran/unity): move UnityCatalogConnectionConfig import to avoid circular deps with ge_profiler (#14956) 2025-10-08 23:45:56 -07:00
Anush Kumar
b6ff38d1c3
bugfix(setup): pin pydantic version due to incompatibility with pyiceberg (#14959) 2025-10-08 22:55:31 -07:00
Sergio Gómez Villamor
335290dfec
feat: RelationshipChangeEvent model + attribution action graph + kafka msk iam (all from SaaS) (#14938) 2025-10-07 09:10:05 +00:00
Sergio Gómez Villamor
e847b58472
feat(ingest): ensure payload size constraints for queryProperties, querySubjects and upstreamLineage aspects (#14919)
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-06 18:10:59 +00:00
Anush Kumar
40b51ac2da
feat(ingestion): Added Databricks support to Fivetran source (#14897) 2025-10-06 10:06:37 -07:00
Deepak Garg
0613f8d471
feat(quickstart): bump min docker req and add validation (#14927) 2025-10-06 15:35:46 +05:30
skrydal
eea46700f6
chore(doc): Fix json schema generation after pydantic v2 move (#14926) 2025-10-04 13:32:45 +00:00
Aseem Bansal
1d0e3778a5
fix(ingest/grafana): add exception handling (#14921) 2025-10-03 20:30:59 +05:30