578 Commits

Author SHA1 Message Date
Harshal Sheth
44cfd21a65
chore(ingest): bump and pin mypy (#6584) 2022-12-02 19:53:28 +01:00
Mayuri Nehate
f63c3e5222
fix(ingest): restrict snowflake-connector-python dependency (#6594) 2022-12-01 10:33:03 +01:00
Harshal Sheth
1366724097
fix(ingest): restrict snowflake's sqlalchemy dep (#6579) 2022-11-30 08:14:45 +01:00
Mayuri Nehate
ec056211a8
fix(ingest): snowflake - graceful error handling in snowflake classification (#6568) 2022-11-29 12:24:24 +01:00
Harshal Sheth
880d04246d
fix(ingest): handle docker-compose version v prefix (#6561) 2022-11-28 16:55:15 -05:00
Tamas Nemeth
278c38cae4
fix(ingest): bigquery - Fixing querying non-date partition columns in profiling (#6554) 2022-11-26 18:48:33 +01:00
Tamas Nemeth
d424edde41
fix(ingest): bigquery - missing sqlalchemy dep and row count fix (#6553) 2022-11-25 22:33:14 +01:00
Mayuri Nehate
7a8e36d57d
feat(ingest): refactor classification mixin interface, support new info types (#6545) 2022-11-25 18:48:42 +05:30
Mayuri Nehate
22847a987a
feat(ingest): automated term classification for snowflake (#6376) 2022-11-23 00:43:30 -05:00
Mayuri Nehate
e085a9e7dc
feat(ingest): add config for ingesting delta table without files (#6403)
Closes undefined
2022-11-22 14:15:40 -05:00
Harshal Sheth
490097e532
fix(ingest): remove redundant types (#6486)
Possible since https://github.com/python/typeshed/pull/9220 was merged.

Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-21 23:08:05 +01:00
Harshal Sheth
05a0f3e2a6
feat(ingest): dbt cloud integration (#6323) 2022-11-21 14:14:33 -05:00
Tamas Nemeth
250f7ce1a8
feat(ingest): presto - Adding presto source (#6459) 2022-11-18 12:02:48 +01:00
Dmytro Kulyk
496f61b608
build: remove Jinja2 dependency from superset (#6476) 2022-11-17 13:46:42 -05:00
Dmytro Kulyk
ba7fc3a685
deps(jinja): loose jinja2 dependency in Superset (#6388) (#6433) 2022-11-16 14:13:14 -08:00
david-leifker
8902404e11
fix(python): Fix python dependencies for doc generation (#6460) 2022-11-16 12:29:24 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Harshal Sheth
fd518cdf58
fix(ingest): snowflake - loosen snowflake connector version requirement (#6418)
Related to https://github.com/datahub-project/datahub/pull/6204.
2022-11-14 13:44:57 +01:00
Harshal Sheth
3e907ab0d1
feat(ingest): loosen sqlalchemy dep & support airflow 2.3+ (#6204)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-11 15:04:36 -05:00
Harshal Sheth
bfb682ace7
build(ingest): pin mypy version (#6391) 2022-11-09 11:38:42 +01:00
cburroughs
39c84c2f5b
feat(ingest): upgrade feast (#6186)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-11-03 11:23:19 -07:00
Harshal Sheth
0ca3383d30
feat(ingest): support reserved keywords in model codegen (#6351) 2022-11-02 22:26:56 -07:00
Harshal Sheth
b4687ffceb
feat(ingest): drop plugin support for airflow 1.x (#6331) 2022-11-01 21:12:34 -07:00
Oleksandr
0a0cf70b6f
feat(ingest): power-bi - add support for on-prem PowerBI Report Server (#5369) 2022-11-01 16:05:42 -07:00
Tamas Nemeth
0dc2d6af25
feat(ingest): databricks - Unity catalog source (#6292)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-29 21:44:41 -07:00
Tamas Nemeth
94fae0a464
feat(ingest): bigquery - Promoting bigquery-beta to bigquery source (#6222)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-26 11:15:44 -07:00
Shirshanka Das
c5fc2ea798
fix(ingest): looker - deps, column level lineage fixes (#6271) 2022-10-24 08:31:48 +02:00
Harshal Sheth
73fd35888b
build(ingest): remove markupsafe dep and bump pytest-docker (#6201) 2022-10-14 18:59:40 -07:00
Harshal Sheth
fbe4b7278a
fix(ingest): only restrict GE version for hive (#6170) 2022-10-14 17:17:56 -07:00
Harshal Sheth
43f7b568e3
build: upgrade gradle wrapper (#6203) 2022-10-14 17:04:11 -07:00
Harshal Sheth
380d0e86cc
fix(ingest): add lower bound for ujson dep version (#6189) 2022-10-13 12:48:05 -07:00
Harshal Sheth
3f84a2050a
fix(ingest): trino - add trino package max version restriction (#6137) 2022-10-06 13:30:28 -07:00
Harshal Sheth
446b10dcc3
fix(ingest): bump lkml version (#6091) 2022-09-29 20:46:03 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 (#6056) 2022-09-27 17:34:57 +02:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta (#6051) 2022-09-26 14:08:09 -07:00
Harshal Sheth
0c63178a71
fix(ingest): support snowflake-beta extra compatibility (#6032) 2022-09-22 22:07:44 -07:00
Harshal Sheth
3a6d1d2bf1
feat(ingest): aws - support extra args to role config (#6031) 2022-09-22 17:43:32 -07:00
Mayuri Nehate
4062385d6b
fix(ingest): pin great-expectations dependency to fix profiling error (#5980) 2022-09-19 12:45:22 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source (#5923)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:53:54 -07:00
Harshal Sheth
d5d8a38caa
fix(ingest): move git requirement into lookml deps (#5932) 2022-09-14 14:47:07 +05:30
Shirshanka Das
15a33fadc8
feat(ingest): lookml - support for git checkout (#5924) 2022-09-13 16:40:59 -07:00
Harshal Sheth
6063484714
fix(ingest): avrogen handling for missing fields with default values (#5844) 2022-09-08 14:05:28 -07:00
Tamas Nemeth
c91e29b052
fix(ingest): bigquery-beta - Fixing dependencies (#5814)
* Fixing bigquery beta dependencies

* Removing unneded comment
2022-09-02 13:47:14 +05:30
Shirshanka Das
134ca67369
feat(cli): add spinner to indicate progress (#5769) 2022-08-30 13:25:03 -07:00
Harshal Sheth
138846acca
fix(ingest): add pydantic version upper bound (#5775) 2022-08-30 11:07:23 -07:00
mohdsiddique
1f1056d7cf
feat(ingestion): looker - chart usage statistics (#5652)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-30 00:21:31 -07:00
Tamas Nemeth
4572c96d60
feat(ingestion): bigquery - Bigquery beta connector - first cut (#5663) 2022-08-30 07:33:24 +02:00
Harshal Sheth
80edf7c8ed
fix(ingest): add databricks dep for hive (#5764) 2022-08-29 19:14:04 -07:00
Harshal Sheth
eb87db9813
fix(ingest): proper null skip logic in serialization (#5749) 2022-08-29 16:34:58 -07:00
Shirshanka Das
c979349c65
fix(deps): remove tdigest dependency and associated code (#5729) 2022-08-25 17:08:38 -07:00