Harshal Sheth
d3174e75b7
fix(ingest): dbt - disable incremental lineage by default ( #6467 )
2022-11-17 09:41:43 +01:00
mohdsiddique
73bf7a81a9
feat(ingestion): powerbi - support for report ( #6339 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2022-11-16 22:52:23 -08:00
Harshal Sheth
29c6c43cb3
feat(ingest): detect old or missing docker compose ( #6466 )
2022-11-16 22:38:00 -08:00
Harshal Sheth
8c322ede35
feat(ingest): allow specific profiler config fields to override profile_table_level_only ( #6366 )
2022-11-16 23:49:31 +01:00
Harshal Sheth
a3aec72c3d
fix(ingest): handle missing schema in transformer ( #6445 )
2022-11-16 23:37:43 +01:00
Harshal Sheth
cf6fb91f8d
fix(ingest): mssql - lowercase db name in mssql ingestion ( #6448 )
2022-11-16 23:34:08 +01:00
Dmytro Kulyk
ba7fc3a685
deps(jinja): loose jinja2 dependency in Superset ( #6388 ) ( #6433 )
2022-11-16 14:13:14 -08:00
david-leifker
8902404e11
fix(python): Fix python dependencies for doc generation ( #6460 )
2022-11-16 12:29:24 -06:00
Harshal Sheth
e530faf865
fix(ingest): add cli info to ingestion reporter ( #6451 )
2022-11-16 12:16:23 -05:00
Harshal Sheth
1ffd24131e
chore(ingest): fix mssql lint ( #6453 )
2022-11-15 23:11:57 -05:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
Tamas Nemeth
94d2672ebe
fix(snowflake): Fixing top query trimming in snowflake ( #6447 )
2022-11-15 15:27:55 -08:00
Pavel Klammert
9862eff95a
fix(ingestion): add output converters for ODBC unsuported datatype in… ( #6134 )
...
Co-authored-by: Pavel Klammert | LOGEX <Pavel.Klammert@logex.com>
2022-11-15 17:11:00 -05:00
Mayuri Nehate
e78b03762a
docs(ingest): move prerequisite section before the ingestion recipe example ( #6341 )
2022-11-15 14:24:35 -05:00
Harshal Sheth
d87dcfae75
fix(ingest): correctly compute entity change percentage ( #6438 )
...
Reported https://datahubspace.slack.com/archives/C02FKQAGRG9/p1668487704332469 .
2022-11-15 14:37:58 +05:30
Harshal Sheth
f75bb470c3
fix(ingest): init dataset props if missing in transformer ( #6429 )
2022-11-14 15:36:03 -05:00
Mayuri Nehate
198c86a620
feat(ingest): support incremental lineage to dbt node from external platform ( #6392 )
2022-11-14 13:16:38 -05:00
Mayuri Nehate
443d15f346
fix(ingest): mysql - fix native data type for mysql set type ( #6407 )
2022-11-14 14:33:26 +01:00
Harshal Sheth
fd518cdf58
fix(ingest): snowflake - loosen snowflake connector version requirement ( #6418 )
...
Related to https://github.com/datahub-project/datahub/pull/6204 .
2022-11-14 13:44:57 +01:00
Mayuri Nehate
e79b4e8c2b
feat(ingest): s3 - add status aspect for detected s3 datasets ( #6402 )
2022-11-13 17:29:42 -08:00
Harshal Sheth
3e907ab0d1
feat(ingest): loosen sqlalchemy dep & support airflow 2.3+ ( #6204 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-11 15:04:36 -05:00
Mayuri Nehate
6c42064332
fix(ingest): snowflake - fix missing snowflake lineage when table_pattern is set ( #6410 )
2022-11-11 16:47:09 +01:00
Mayuri Nehate
1b739319f0
fix(ingest/snowflake): fix TypeError when columns are returned as None in snowflake query ( #6404 )
2022-11-10 12:02:49 -08:00
Harshal Sheth
ae2ea524a4
fix(ingest): use profiler config settings correctly ( #6354 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-09 19:03:22 -08:00
Harshal Sheth
96f782730e
feat(ingest/tableau): re-authenticate if the token expires ( #6380 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-09 18:55:24 -08:00
Tamas Nemeth
ef5c7128da
fix(ingest): unity - Removing unneeded dependency for sqlalchemy from unity-catalog to fix connector setup ( #6379 )
2022-11-09 15:57:17 +01:00
Marcin Szymański
44cfc29af0
fix(ingest): unity - add missing date type ( #6385 )
2022-11-09 15:56:22 +01:00
Harshal Sheth
bfb682ace7
build(ingest): pin mypy version ( #6391 )
2022-11-09 11:38:42 +01:00
wangsaisai
92192d2410
feat(ingest): enable container stateful ingestion ( #6343 )
2022-11-08 12:34:43 +01:00
Harshal Sheth
1a81d8de6a
feat(ingest): supports MCEs in domain transformer ( #6364 )
2022-11-05 11:41:43 -07:00
Tamas Nemeth
07a0e86470
fix(ingest): bigquery - Sending lineage aspects as patch ( #6313 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-11-04 09:52:34 -07:00
Harshal Sheth
3080b9e3ee
fix(ingest): only log vars if requested ( #6362 )
2022-11-03 20:16:07 -07:00
Chris Collins
f24f74598b
fix(ui): Handle encoded schemaField urns on the frontend ( #6321 )
2022-11-03 13:43:10 -07:00
cburroughs
39c84c2f5b
feat(ingest): upgrade feast ( #6186 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-11-03 11:23:19 -07:00
Harshal Sheth
ab904cdd37
fix(ingest): fix log line interpolation ( #6349 )
2022-11-03 10:56:56 -07:00
Harshal Sheth
0ca3383d30
feat(ingest): support reserved keywords in model codegen ( #6351 )
2022-11-02 22:26:56 -07:00
Harshal Sheth
e0c235a0c1
doc(ingest): clarify that redshift-usage does not support column-level usage ( #6347 )
2022-11-02 16:27:58 -07:00
Mayuri Nehate
c01aa53aa7
fix(ingest): fix schema field urns with empty field path ( #6338 )
2022-11-02 15:02:13 +01:00
Harshal Sheth
b4687ffceb
feat(ingest): drop plugin support for airflow 1.x ( #6331 )
2022-11-01 21:12:34 -07:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server ( #5369 )
2022-11-01 16:05:42 -07:00
mohdsiddique
fbb1b7271c
feat(ingestion): business-glossary - Add values and relatedTerms support ( #6148 )
...
* WIP
* updated snapshot
* merge
* while creating BusinessGlossaryConfig object, the version field always get set to None
* WIP
* lint fix
* remove field
* doc update
* rename the fields
* review comments
* lintFix
* Fix the business glossary example link
* small fixes to examples and docs
* some small tweaks to the model annotations
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2022-11-01 15:17:30 -07:00
John Joyce
3ff49d4499
refactor(bootstrap): Adding assertions data to bootstrap ( #6324 )
2022-11-01 12:46:04 -07:00
Mayuri Nehate
8e1deb6853
fix(ingest): looker - fix exception logging ( #6319 )
2022-10-31 09:42:06 -07:00
Tamas Nemeth
0dc2d6af25
feat(ingest): databricks - Unity catalog source ( #6292 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-29 21:44:41 -07:00
Kevin Neville
3eae087a30
chore(ci): update actions versions addressing warnings in builds. ( #6308 )
2022-10-28 17:10:30 -07:00
David Schmidt
5934a0e79f
fix(docs): fix custom transformer example interface ( #6309 )
2022-10-28 17:00:18 -07:00
Harshal Sheth
ef824bd082
feat(ingest): add fallthrough support to KeyValuePattern ( #6302 )
2022-10-28 11:07:47 +02:00
Harshal Sheth
5b4f5f8d26
feat(ingest): mssql - add type mappings for BIT and SQL_VARIANT ( #6304 )
2022-10-28 11:05:06 +02:00
Harshal Sheth
d986a044fb
fix(ingest): tableau - add extra debug info for lineage failure ( #6285 )
2022-10-26 20:01:55 -07:00
Harshal Sheth
e27b017427
fix(ingest): dbt - lowercase external urns + cleanup config ( #6289 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-26 19:46:51 -07:00
