Harshal Sheth
fcdb8a2226
fix(ingest): mongodb - add pymongo srv extra ( #5701 )
2022-08-22 23:42:09 -07:00
Shirshanka Das
647de906f2
feat(ingest): rest-sink - stability improvements to handle large inpu… ( #5693 )
2022-08-21 12:30:19 -07:00
Shirshanka Das
bb788ac317
feat(ingest): file - add support for folders, large files, improve co… ( #5692 )
2022-08-21 14:18:22 +05:30
Ravindra Lanka
228f3b50ea
feat(ingestion): send reports of ingestion runs to datahub ( #5639 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-19 09:08:17 -07:00
Harshal Sheth
ad57fb9dbb
chore(ingest): set min stackprinter version ( #5666 )
2022-08-18 11:47:49 -07:00
Aezo
8d6a9e08c9
feat(ingest): GE profiler Trino support ( #5361 )
...
* feat(ingest): GE Profile/Action Trino support
* bumping GE version
* updated golden test files
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-16 09:46:52 -07:00
Harshal Sheth
680c4a8f81
chore(ingest): drop data-lake source in favor of s3 source ( #5628 )
2022-08-15 22:30:40 -07:00
Mayuri Nehate
dc08bedd6e
feat(ingest): snowflake - add snowflake-beta connector ( #5517 )
2022-08-15 20:54:02 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support ( #5521 )
2022-08-10 15:00:31 -07:00
Harshal Sheth
b46a6cd63f
feat(ingest): remove orderedset dependency ( #5591 )
2022-08-09 22:07:20 +05:30
Shirshanka Das
da0258c6ad
fix(ingest): moving delta-lake connector to be 3.7+ only ( #5584 )
2022-08-07 09:32:18 -07:00
Harshal Sheth
3c2a9c585b
fix(ingest): activate mypy support for ParamSpec typing annotation ( #5551 )
2022-08-04 17:05:52 +05:30
Harshal Sheth
97d508fa2e
fix(ingest): loosen confluent-kafka dep requirement ( #5489 )
2022-07-26 14:43:33 -07:00
Shirshanka Das
b010efa6cf
fix(ingest): kafka - revert deps back to < 1.9.0 ( #5476 )
2022-07-24 15:04:24 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation ( #5196 )
2022-07-13 10:17:38 -07:00
Navin Sharma
f3e5afdba9
feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart ( #5353 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-11 22:33:24 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector ( #5104 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Tamas Nemeth
c1f8227693
fix(ingestion): Reverting sqlalchemy upgrade because it caused issues with mssql and redshift-usage ( #5289 )
2022-06-29 18:23:36 +02:00
Tamas Nemeth
d812fd18fa
fix(ingest) redshift: Adding missing dependencies and relaxing sqlalchemy dependency ( #5284 )
...
Relaxing sqlalchemy deps to make our plugins work with Airflow 2.3
2022-06-29 16:25:48 +02:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake ( #5259 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
Aseem Bansal
8c8f1b987a
fix(build): pin confluent kafka dependency ( #5224 )
2022-06-22 13:53:30 +05:30
Aditya Radhakrishnan
82ca92f8f9
feat(ingest): adds csv enricher ingestion source ( #5221 )
2022-06-22 12:25:39 +05:30
Aseem Bansal
4541379024
feat(build): changes to decrease build time, cancel runs in case of multiple commits ( #5187 )
2022-06-17 18:05:10 +05:30
John Joyce
5c501fba2c
fix(cli): Bumping avro-gen3 to 0.7.4 ( #5098 )
2022-06-07 12:56:06 -07:00
Shirshanka Das
51854a768d
fix(ci): pin google-cloud-logging to avoid pip backtracking ( #5109 )
2022-06-07 23:14:00 +05:30
Aseem Bansal
596853ae1f
fix(build): remove dependencies added for compatibility ( #5108 )
2022-06-07 19:59:17 +05:30
Aseem Bansal
e567d70d37
fix(build): reduce time taken for resolution ( #5106 )
2022-06-07 17:32:33 +05:30
Shirshanka Das
7cef07490f
fix(deps): ingest - moving packaging to framework_common ( #5096 )
2022-06-06 16:34:23 -07:00
Lal Rishav
4f82e29697
feat(ingest): snowflake using oauth for Azure ( #4647 )
2022-06-06 17:49:49 +05:30
Shirshanka Das
e62c647693
feat(cli): suggest upgrades when appropriate ( #5091 )
2022-06-04 09:34:17 -07:00
Shirshanka Das
83d9f7d6e6
fix(ingest): fix build breakage due to traitlets 5.2.2 bug ( #5051 )
2022-05-31 14:42:56 -07:00
Shirshanka Das
65d96b9108
fix(build): m1 build fails to install hdb-cli ( #5040 )
2022-05-30 11:02:33 +02:00
Aseem Bansal
64bb918939
fix(parsing): improve sql parsing, some debugging redash ( #5025 )
2022-05-27 19:28:45 +05:30
Ravindra Lanka
d200103ea7
fix(ingestion): Remove hana from base_dev_requirements to unblock m1 users ( #5024 )
2022-05-27 14:20:15 +05:30
Ravindra Lanka
26c0acf786
fix(build): fix for hana build failure for aarch64. ( #5019 )
2022-05-26 15:29:21 -07:00
Ravindra Lanka
108b492ed1
feat(ingestion): Add Iceberg source ( #5010 )
...
Co-authored-by: cccs-eric <eric.ladouceur@cyber.gc.ca>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-26 08:05:57 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA ( #4376 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
Ebu (えぶ)
2911e1ed1b
feat(ingest): Add Source from Vertica ( #4555 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:26:28 -07:00
Aseem Bansal
c2bb02903c
fix(dbt): missing aws dependency ( #5008 )
2022-05-26 14:23:50 +05:30
Aseem Bansal
b976393780
fix(bigquery): restrict protobuf version ( #5007 )
2022-05-26 12:26:45 +05:30
Aseem Bansal
b5e1ed739c
fix(bigquery): add rate limiting for api calls made ( #4967 )
2022-05-23 20:14:36 +05:30
Aseem Bansal
5ac6ba58f8
fix(build): Fix breaking changes from GE 0.15.3 ( #4905 )
2022-05-12 08:46:23 -07:00
Tamas Nemeth
84f71dadf0
fix(ingestion): dependencies - Downgrading typing-extension dependency to work with Airflow 2.0.2 ( #4855 )
...
* Downgrading typing-extension dependency to work with Airflow 2.0.2 restricting typing-extension on python 3.7
2022-05-09 09:43:49 -07:00
Ravindra Lanka
842fb391eb
feat(ingestion): kafka - add protobuf schema support ( #4819 )
...
Co-authored-by: Luis Angel Vicente Sanchez <luis.vicentesanchez@aaqua.live>
2022-05-04 17:07:01 -07:00
Shirshanka Das
c15b44a1de
fix(ingest): databricks - hive ingestion should not fail on table comment ( #4787 )
2022-04-29 13:56:42 -07:00
vanmeete
74d6d35881
feat(ingestion): add Pulsar source ( #4721 )
2022-04-29 15:57:02 +05:30
Ravindra Lanka
8583f397f1
Fix breaking changes from GE 0.15.3 that are affecting our Python3.6 smoke_tests. ( #4779 )
2022-04-28 15:50:17 -07:00
Danilo Peixoto
d2a6bc06dc
feat(ingest): feast - add support for Feast 0.18, deprecate older integration ( #4094 )
2022-04-26 14:35:02 -07:00
Aseem Bansal
53d357b4eb
fix(bigquery-usage): missing dependency ( #4661 )
2022-04-13 14:29:31 +02:00
