david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests ( #6269 )
2022-11-15 18:03:11 -08:00
Harshal Sheth
fd518cdf58
fix(ingest): snowflake - loosen snowflake connector version requirement ( #6418 )
...
Related to https://github.com/datahub-project/datahub/pull/6204 .
2022-11-14 13:44:57 +01:00
Harshal Sheth
3e907ab0d1
feat(ingest): loosen sqlalchemy dep & support airflow 2.3+ ( #6204 )
...
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-11 15:04:36 -05:00
Harshal Sheth
bfb682ace7
build(ingest): pin mypy version ( #6391 )
2022-11-09 11:38:42 +01:00
cburroughs
39c84c2f5b
feat(ingest): upgrade feast ( #6186 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-11-03 11:23:19 -07:00
Harshal Sheth
0ca3383d30
feat(ingest): support reserved keywords in model codegen ( #6351 )
2022-11-02 22:26:56 -07:00
Harshal Sheth
b4687ffceb
feat(ingest): drop plugin support for airflow 1.x ( #6331 )
2022-11-01 21:12:34 -07:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server ( #5369 )
2022-11-01 16:05:42 -07:00
Tamas Nemeth
0dc2d6af25
feat(ingest): databricks - Unity catalog source ( #6292 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-29 21:44:41 -07:00
Tamas Nemeth
94fae0a464
feat(ingest): bigquery - Promoting bigquery-beta to bigquery source ( #6222 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-26 11:15:44 -07:00
Shirshanka Das
c5fc2ea798
fix(ingest): looker - deps, column level lineage fixes ( #6271 )
2022-10-24 08:31:48 +02:00
Harshal Sheth
73fd35888b
build(ingest): remove markupsafe dep and bump pytest-docker ( #6201 )
2022-10-14 18:59:40 -07:00
Harshal Sheth
fbe4b7278a
fix(ingest): only restrict GE version for hive ( #6170 )
2022-10-14 17:17:56 -07:00
Harshal Sheth
43f7b568e3
build: upgrade gradle wrapper ( #6203 )
2022-10-14 17:04:11 -07:00
Harshal Sheth
380d0e86cc
fix(ingest): add lower bound for ujson dep version ( #6189 )
2022-10-13 12:48:05 -07:00
Harshal Sheth
3f84a2050a
fix(ingest): trino - add trino package max version restriction ( #6137 )
2022-10-06 13:30:28 -07:00
Harshal Sheth
446b10dcc3
fix(ingest): bump lkml version ( #6091 )
2022-09-29 20:46:03 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 ( #6056 )
2022-09-27 17:34:57 +02:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta ( #6051 )
2022-09-26 14:08:09 -07:00
Harshal Sheth
0c63178a71
fix(ingest): support snowflake-beta extra compatibility ( #6032 )
2022-09-22 22:07:44 -07:00
Harshal Sheth
3a6d1d2bf1
feat(ingest): aws - support extra args to role config ( #6031 )
2022-09-22 17:43:32 -07:00
Mayuri Nehate
4062385d6b
fix(ingest): pin great-expectations dependency to fix profiling error ( #5980 )
2022-09-19 12:45:22 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source ( #5923 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:53:54 -07:00
Harshal Sheth
d5d8a38caa
fix(ingest): move git requirement into lookml deps ( #5932 )
2022-09-14 14:47:07 +05:30
Shirshanka Das
15a33fadc8
feat(ingest): lookml - support for git checkout ( #5924 )
2022-09-13 16:40:59 -07:00
Harshal Sheth
6063484714
fix(ingest): avrogen handling for missing fields with default values ( #5844 )
2022-09-08 14:05:28 -07:00
Tamas Nemeth
c91e29b052
fix(ingest): bigquery-beta - Fixing dependencies ( #5814 )
...
* Fixing bigquery beta dependencies
* Removing unneded comment
2022-09-02 13:47:14 +05:30
Shirshanka Das
134ca67369
feat(cli): add spinner to indicate progress ( #5769 )
2022-08-30 13:25:03 -07:00
Harshal Sheth
138846acca
fix(ingest): add pydantic version upper bound ( #5775 )
2022-08-30 11:07:23 -07:00
mohdsiddique
1f1056d7cf
feat(ingestion): looker - chart usage statistics ( #5652 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-30 00:21:31 -07:00
Tamas Nemeth
4572c96d60
feat(ingestion): bigquery - Bigquery beta connector - first cut ( #5663 )
2022-08-30 07:33:24 +02:00
Harshal Sheth
80edf7c8ed
fix(ingest): add databricks dep for hive ( #5764 )
2022-08-29 19:14:04 -07:00
Harshal Sheth
eb87db9813
fix(ingest): proper null skip logic in serialization ( #5749 )
2022-08-29 16:34:58 -07:00
Shirshanka Das
c979349c65
fix(deps): remove tdigest dependency and associated code ( #5729 )
2022-08-25 17:08:38 -07:00
Harshal Sheth
fcdb8a2226
fix(ingest): mongodb - add pymongo srv extra ( #5701 )
2022-08-22 23:42:09 -07:00
Shirshanka Das
647de906f2
feat(ingest): rest-sink - stability improvements to handle large inpu… ( #5693 )
2022-08-21 12:30:19 -07:00
Shirshanka Das
bb788ac317
feat(ingest): file - add support for folders, large files, improve co… ( #5692 )
2022-08-21 14:18:22 +05:30
Ravindra Lanka
228f3b50ea
feat(ingestion): send reports of ingestion runs to datahub ( #5639 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-19 09:08:17 -07:00
Harshal Sheth
ad57fb9dbb
chore(ingest): set min stackprinter version ( #5666 )
2022-08-18 11:47:49 -07:00
Aezo
8d6a9e08c9
feat(ingest): GE profiler Trino support ( #5361 )
...
* feat(ingest): GE Profile/Action Trino support
* bumping GE version
* updated golden test files
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-16 09:46:52 -07:00
Harshal Sheth
680c4a8f81
chore(ingest): drop data-lake source in favor of s3 source ( #5628 )
2022-08-15 22:30:40 -07:00
Mayuri Nehate
dc08bedd6e
feat(ingest): snowflake - add snowflake-beta connector ( #5517 )
2022-08-15 20:54:02 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support ( #5521 )
2022-08-10 15:00:31 -07:00
Harshal Sheth
b46a6cd63f
feat(ingest): remove orderedset dependency ( #5591 )
2022-08-09 22:07:20 +05:30
Shirshanka Das
da0258c6ad
fix(ingest): moving delta-lake connector to be 3.7+ only ( #5584 )
2022-08-07 09:32:18 -07:00
Harshal Sheth
3c2a9c585b
fix(ingest): activate mypy support for ParamSpec typing annotation ( #5551 )
2022-08-04 17:05:52 +05:30
Harshal Sheth
97d508fa2e
fix(ingest): loosen confluent-kafka dep requirement ( #5489 )
2022-07-26 14:43:33 -07:00
Shirshanka Das
b010efa6cf
fix(ingest): kafka - revert deps back to < 1.9.0 ( #5476 )
2022-07-24 15:04:24 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation ( #5196 )
2022-07-13 10:17:38 -07:00
