Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 ( #6056 )
2022-09-27 17:34:57 +02:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta ( #6051 )
2022-09-26 14:08:09 -07:00
Harshal Sheth
0c63178a71
fix(ingest): support snowflake-beta extra compatibility ( #6032 )
2022-09-22 22:07:44 -07:00
Harshal Sheth
3a6d1d2bf1
feat(ingest): aws - support extra args to role config ( #6031 )
2022-09-22 17:43:32 -07:00
Mayuri Nehate
4062385d6b
fix(ingest): pin great-expectations dependency to fix profiling error ( #5980 )
2022-09-19 12:45:22 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source ( #5923 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:53:54 -07:00
Harshal Sheth
d5d8a38caa
fix(ingest): move git requirement into lookml deps ( #5932 )
2022-09-14 14:47:07 +05:30
Shirshanka Das
15a33fadc8
feat(ingest): lookml - support for git checkout ( #5924 )
2022-09-13 16:40:59 -07:00
Harshal Sheth
6063484714
fix(ingest): avrogen handling for missing fields with default values ( #5844 )
2022-09-08 14:05:28 -07:00
Tamas Nemeth
c91e29b052
fix(ingest): bigquery-beta - Fixing dependencies ( #5814 )
...
* Fixing bigquery beta dependencies
* Removing unneded comment
2022-09-02 13:47:14 +05:30
Shirshanka Das
134ca67369
feat(cli): add spinner to indicate progress ( #5769 )
2022-08-30 13:25:03 -07:00
Harshal Sheth
138846acca
fix(ingest): add pydantic version upper bound ( #5775 )
2022-08-30 11:07:23 -07:00
mohdsiddique
1f1056d7cf
feat(ingestion): looker - chart usage statistics ( #5652 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-30 00:21:31 -07:00
Tamas Nemeth
4572c96d60
feat(ingestion): bigquery - Bigquery beta connector - first cut ( #5663 )
2022-08-30 07:33:24 +02:00
Harshal Sheth
80edf7c8ed
fix(ingest): add databricks dep for hive ( #5764 )
2022-08-29 19:14:04 -07:00
Harshal Sheth
eb87db9813
fix(ingest): proper null skip logic in serialization ( #5749 )
2022-08-29 16:34:58 -07:00
Shirshanka Das
c979349c65
fix(deps): remove tdigest dependency and associated code ( #5729 )
2022-08-25 17:08:38 -07:00
Harshal Sheth
fcdb8a2226
fix(ingest): mongodb - add pymongo srv extra ( #5701 )
2022-08-22 23:42:09 -07:00
Shirshanka Das
647de906f2
feat(ingest): rest-sink - stability improvements to handle large inpu… ( #5693 )
2022-08-21 12:30:19 -07:00
Shirshanka Das
bb788ac317
feat(ingest): file - add support for folders, large files, improve co… ( #5692 )
2022-08-21 14:18:22 +05:30
Ravindra Lanka
228f3b50ea
feat(ingestion): send reports of ingestion runs to datahub ( #5639 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-19 09:08:17 -07:00
Harshal Sheth
ad57fb9dbb
chore(ingest): set min stackprinter version ( #5666 )
2022-08-18 11:47:49 -07:00
Aezo
8d6a9e08c9
feat(ingest): GE profiler Trino support ( #5361 )
...
* feat(ingest): GE Profile/Action Trino support
* bumping GE version
* updated golden test files
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-16 09:46:52 -07:00
Harshal Sheth
680c4a8f81
chore(ingest): drop data-lake source in favor of s3 source ( #5628 )
2022-08-15 22:30:40 -07:00
Mayuri Nehate
dc08bedd6e
feat(ingest): snowflake - add snowflake-beta connector ( #5517 )
2022-08-15 20:54:02 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support ( #5521 )
2022-08-10 15:00:31 -07:00
Harshal Sheth
b46a6cd63f
feat(ingest): remove orderedset dependency ( #5591 )
2022-08-09 22:07:20 +05:30
Shirshanka Das
da0258c6ad
fix(ingest): moving delta-lake connector to be 3.7+ only ( #5584 )
2022-08-07 09:32:18 -07:00
Harshal Sheth
3c2a9c585b
fix(ingest): activate mypy support for ParamSpec typing annotation ( #5551 )
2022-08-04 17:05:52 +05:30
Harshal Sheth
97d508fa2e
fix(ingest): loosen confluent-kafka dep requirement ( #5489 )
2022-07-26 14:43:33 -07:00
Shirshanka Das
b010efa6cf
fix(ingest): kafka - revert deps back to < 1.9.0 ( #5476 )
2022-07-24 15:04:24 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation ( #5196 )
2022-07-13 10:17:38 -07:00
Navin Sharma
f3e5afdba9
feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart ( #5353 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-11 22:33:24 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector ( #5104 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Tamas Nemeth
c1f8227693
fix(ingestion): Reverting sqlalchemy upgrade because it caused issues with mssql and redshift-usage ( #5289 )
2022-06-29 18:23:36 +02:00
Tamas Nemeth
d812fd18fa
fix(ingest) redshift: Adding missing dependencies and relaxing sqlalchemy dependency ( #5284 )
...
Relaxing sqlalchemy deps to make our plugins work with Airflow 2.3
2022-06-29 16:25:48 +02:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake ( #5259 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
Aseem Bansal
8c8f1b987a
fix(build): pin confluent kafka dependency ( #5224 )
2022-06-22 13:53:30 +05:30
Aditya Radhakrishnan
82ca92f8f9
feat(ingest): adds csv enricher ingestion source ( #5221 )
2022-06-22 12:25:39 +05:30
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits ( #5187 )
2022-06-17 18:05:10 +05:30
John Joyce
5c501fba2c
fix(cli): Bumping avro-gen3 to 0.7.4 ( #5098 )
2022-06-07 12:56:06 -07:00
Shirshanka Das
51854a768d
fix(ci): pin google-cloud-logging to avoid pip backtracking ( #5109 )
2022-06-07 23:14:00 +05:30
Aseem Bansal
596853ae1f
fix(build): remove dependencies added for compatibility ( #5108 )
2022-06-07 19:59:17 +05:30
Aseem Bansal
e567d70d37
fix(build): reduce time taken for resolution ( #5106 )
2022-06-07 17:32:33 +05:30
Shirshanka Das
7cef07490f
fix(deps): ingest - moving packaging to framework_common ( #5096 )
2022-06-06 16:34:23 -07:00
Lal Rishav
4f82e29697
feat(ingest): snowflake using oauth for Azure ( #4647 )
2022-06-06 17:49:49 +05:30
Shirshanka Das
e62c647693
feat(cli): suggest upgrades when appropriate ( #5091 )
2022-06-04 09:34:17 -07:00
Shirshanka Das
83d9f7d6e6
fix(ingest): fix build breakage due to traitlets 5.2.2 bug ( #5051 )
2022-05-31 14:42:56 -07:00
Shirshanka Das
65d96b9108
fix(build): m1 build fails to install hdb-cli ( #5040 )
2022-05-30 11:02:33 +02:00
