Harshal Sheth
858b132444
fix(ingest): fix some typos and logging issues ( #5564 )
2022-08-03 21:01:45 -07:00
xiphl
16ff4aaa94
feat(ingest) Allow ingestion of Elasticsearch index template ( #5444 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-03 20:58:07 -07:00
Marcin Szymański
fa42b59d9f
fix(ingestion): correct trino datatype handling ( #5541 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-03 20:55:14 -07:00
mohdsiddique
f1abdc91ee
fix(dbt): fix issue of assertion error when stateful ingestion is used with dbt tests ( #5540 )
...
* fix(dbt): fix issue of dbt stateful ingestion with tests
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-03 13:22:04 -07:00
Aseem Bansal
0cbcaf333d
fix(quickstart): failure on a path not being present ( #5554 )
2022-08-03 09:03:36 -07:00
Dan Andreescu
865074e338
feat(ingestion): superset - add display_uri to config ( #5408 )
2022-08-03 11:42:51 +02:00
Harshal Sheth
b1ff0300e6
test(ingest): mark trino/hana tests as xfail due to flakes ( #5549 )
2022-08-03 10:30:36 +05:30
Alexey Kravtsov
c182fe7fca
feat(ingestion): add groups to ldap users ( #5470 )
2022-08-01 15:04:30 -07:00
Harshal Sheth
4f93aaa3a7
feat(ingest): add deprecation warning for Python 3.6 ( #5519 )
2022-08-01 10:20:41 -07:00
Harshal Sheth
465e2c6e9a
fix(ingest): fix unbound variable bug in cli ingest list-runs ( #5527 )
2022-07-29 17:30:35 -07:00
Vishal Shah
f11172f94c
fix(ingest): airflow: update subdag check for compatibility with older Airflow versions ( #5523 )
...
* use getattr to default None if no subdag
* add None check
* add other None check
* Apply suggestions from code review- double quotes
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
* minor tweak to fix lint
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-07-29 13:28:20 -07:00
Harshal Sheth
55cb34e5d4
test(ingest): limit GMS retries in test ( #5509 )
2022-07-29 15:11:31 +05:30
Aditya Radhakrishnan
c8fc246319
feat(identity): update azure and okta connectors to emit Origin aspects ( #5495 )
2022-07-28 16:03:57 -07:00
Harshal Sheth
9c7d4bd465
fix(ingest): respect rest emitter timeout setting ( #5508 )
2022-07-28 09:42:14 +05:30
Harshal Sheth
64e7da8a68
fix(ingest): use temp dir for file generated during test ( #5505 )
2022-07-27 14:29:11 -07:00
Aseem Bansal
9b5afcce51
feat(cli): delete - add --only-soft-deleted option, perf improvements ( #5485 )
2022-07-27 11:22:24 -07:00
Harshal Sheth
690443ce14
fix(ingest): cleanup unused flake8 noqa statements ( #5492 )
...
* fix(ingest): cleanup unused flake8 noqa statements
In the future, we can discover these using `flake8-noqa`.
* add back c901
2022-07-27 22:02:32 +05:30
Aezo
85a55ffac7
fix(ingest): dbt - add support for trino datatypes ( #5379 )
2022-07-26 17:02:00 -07:00
Harshal Sheth
6840240355
build(ingest): make gradle build less chatty ( #5491 )
2022-07-26 16:37:46 -07:00
Harshal Sheth
c294e89317
refactor(ingest): cleanup importlib.import_module calls ( #5490 )
2022-07-26 16:34:54 -07:00
Harshal Sheth
97d508fa2e
fix(ingest): loosen confluent-kafka dep requirement ( #5489 )
2022-07-26 14:43:33 -07:00
Mayuri Nehate
04de6c27b7
feat(ingest): snowflake - test_connection add support for capability report ( #5472 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 09:29:57 -07:00
Mayuri Nehate
455ec182e5
feat(model, ingest): add user email in dashboard user usage counts ( #5471 )
2022-07-25 23:06:53 -07:00
Aseem Bansal
5d71f73062
feat(cli): delete - hard delete deletes soft deleted entities ( #5478 )
2022-07-25 18:17:02 -07:00
Gabe Lyons
efc5602493
feat(ingest): dbt - updating source lineage logic ( #5414 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-24 23:55:01 -07:00
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore ( #5418 )
2022-07-24 23:52:25 -07:00
Shirshanka Das
b010efa6cf
fix(ingest): kafka - revert deps back to < 1.9.0 ( #5476 )
2022-07-24 15:04:24 -07:00
Tamas Nemeth
cb05159474
fix(ingest): bigquery: multiproject profiling fix ( #5474 )
2022-07-23 18:44:46 +02:00
Sergio Gómez Villamor
0455ae00d5
doc(bigquery): groups grants by requirements ( #5468 )
2022-07-22 18:49:37 +05:30
Tamas Nemeth
d08a8f79ab
feat(ingest): preflight - Add way to check/upgrade brew package version in preflight if needed ( #5435 )
2022-07-22 14:20:12 +05:30
Guillaume Gardey
6101759c0a
fix(ingest/trino): Avoid exception if $properties table empty or not readable ( #5447 )
...
Under some configuration of access rules in Trino, the user may not have
read access to the content of the table, which will result in an exception
(`fetchone()` returns `None`)
This commit ensures no exception are raised and the ingestion can proceed.
2022-07-22 14:17:29 +05:30
Shirshanka Das
7ed9cd2838
feat(ingest): snowflake - basic test connection capability ( #5464 )
2022-07-22 09:14:37 +02:00
Mayuri Nehate
fa46167dfe
fix(ingest): tableau - fix tableau db error, add more logs ( #5423 )
2022-07-21 08:54:16 -07:00
Shirshanka Das
14d764a26f
fix(ingest): fix serialization of report to handle nesting ( #5455 )
2022-07-20 18:25:07 -07:00
Mugdha Hardikar
1f4d3722e2
fix(ingest): hive - add column comment as a column description ( #5449 )
2022-07-20 12:32:02 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT ( #5451 )
2022-07-20 20:54:43 +05:30
Mugdha Hardikar
ced6c38239
fix(ingest): bigquery-usage - fix dataset name for sharded table ( #5412 )
2022-07-19 20:59:02 -07:00
Tim Costa
d065553958
fix(ingest/glue): handle error when generating s3 tags for virtual view tables ( #5398 )
...
Co-authored-by: Tim Costa <timcosta@amazon.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-19 20:43:09 -07:00
Shirshanka Das
76133c6f37
feat(ingest): add test source connection feature, structured report file ( #5442 )
2022-07-19 20:40:59 -07:00
Mugdha Hardikar
a6dc669891
docs(bigquery): add changelog and unittest for profiling limits ( #5407 )
2022-07-19 09:39:09 +05:30
Mayuri Nehate
65a308a4ed
fix(ingest): looker - extract usage for dashboards allowed by pattern ( #5424 )
2022-07-18 14:21:17 +02:00
Mayuri Nehate
e6ce4324c9
fix(ingest): looker - pass transport options to all api calls ( #5417 )
2022-07-17 13:55:20 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Pedro Silva
bc96cf22e7
fix(metadata-ingestion) Fix broken csv enricher test ( #5406 )
2022-07-15 19:00:36 +05:30
Harshal Sheth
fdea718e38
build: improve comprehensiveness of gradle clean ( #5003 )
2022-07-15 15:38:32 +05:30
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added ( #5397 )
2022-07-15 15:37:06 +05:30
Pedro Silva
b2edd44b6a
Adds support for Domains in CSV source ( #5372 )
2022-07-15 14:20:41 +05:30
Aseem Bansal
ef02bf4b04
fix(quickstart): use platform agnostic way to get folder ( #5400 )
2022-07-15 14:15:24 +05:30
Felix Lüdin
a0303448ba
feat(dashboards): add datasets field to DashboardInfo aspect ( #5188 )
...
Co-authored-by: John Joyce <john@acryl.io>
2022-07-14 09:54:02 -07:00
Aseem Bansal
45315ef1d4
fix(bigquery): add storage project name ( #5395 )
2022-07-14 19:52:38 +05:30
