liyuhui666
0481075705
fix(ingest): Fix ingest Clickhouse without password ( #5511 )
...
* fix(ingest): Fix ingest Clickhouse without password
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-09 10:30:56 -07:00
liyuhui666
d33eecbad5
feat(ingest): clickhouse - add metadata modification time and data size ( #5330 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-08 14:00:02 -07:00
Jordan Wolinsky
3a86ff3485
Fix profiling when using {table}. ( #5531 )
...
* profiling fix for when using {table}
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-08 13:16:59 -07:00
Jordan Wolinsky
33339e2c89
Expose catalog_name in athena.py ( #5548 )
...
* expose catalog_name to the sql alchemy uri that is passed into pyathena
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-08 11:40:05 -07:00
mohdsiddique
0a3721cab3
feat(ingest): power-bi - make ownership ingestion optional ( #5335 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-08 11:26:00 -07:00
Mugdha Hardikar
b32a0723a1
feat(ingest): delta-lake - extract table history into operation aspect ( #5277 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-07 11:35:09 -07:00
Shirshanka Das
da0258c6ad
fix(ingest): moving delta-lake connector to be 3.7+ only ( #5584 )
2022-08-07 09:32:18 -07:00
Harshal Sheth
9790f3cefa
feat(ingest): infer aspectName from aspect type in MCP ( #5566 )
2022-08-07 07:52:58 -07:00
Piotr Sierkin
828a711684
feat(ingest): dbt - control over emitting test_results, test_definitions, etc. ( #5328 )
...
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-06 21:42:53 -07:00
Marcin Szymański
fa42b59d9f
fix(ingestion): correct trino datatype handling ( #5541 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-03 20:55:14 -07:00
mohdsiddique
f1abdc91ee
fix(dbt): fix issue of assertion error when stateful ingestion is used with dbt tests ( #5540 )
...
* fix(dbt): fix issue of dbt stateful ingestion with tests
Co-authored-by: MugdhaHardikar-GSLab <mugdha.hardikar@gslab.com>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-03 13:22:04 -07:00
Harshal Sheth
b1ff0300e6
test(ingest): mark trino/hana tests as xfail due to flakes ( #5549 )
2022-08-03 10:30:36 +05:30
Alexey Kravtsov
c182fe7fca
feat(ingestion): add groups to ldap users ( #5470 )
2022-08-01 15:04:30 -07:00
Harshal Sheth
55cb34e5d4
test(ingest): limit GMS retries in test ( #5509 )
2022-07-29 15:11:31 +05:30
Aditya Radhakrishnan
c8fc246319
feat(identity): update azure and okta connectors to emit Origin aspects ( #5495 )
2022-07-28 16:03:57 -07:00
Harshal Sheth
64e7da8a68
fix(ingest): use temp dir for file generated during test ( #5505 )
2022-07-27 14:29:11 -07:00
Harshal Sheth
690443ce14
fix(ingest): cleanup unused flake8 noqa statements ( #5492 )
...
* fix(ingest): cleanup unused flake8 noqa statements
In the future, we can discover these using `flake8-noqa`.
* add back c901
2022-07-27 22:02:32 +05:30
Aezo
85a55ffac7
fix(ingest): dbt - add support for trino datatypes ( #5379 )
2022-07-26 17:02:00 -07:00
Mayuri Nehate
04de6c27b7
feat(ingest): snowflake - test_connection add support for capability report ( #5472 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 09:29:57 -07:00
Mayuri Nehate
455ec182e5
feat(model, ingest): add user email in dashboard user usage counts ( #5471 )
2022-07-25 23:06:53 -07:00
Gabe Lyons
efc5602493
feat(ingest): dbt - updating source lineage logic ( #5414 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-24 23:55:01 -07:00
Shirshanka Das
7ed9cd2838
feat(ingest): snowflake - basic test connection capability ( #5464 )
2022-07-22 09:14:37 +02:00
Shirshanka Das
14d764a26f
fix(ingest): fix serialization of report to handle nesting ( #5455 )
2022-07-20 18:25:07 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT ( #5451 )
2022-07-20 20:54:43 +05:30
Mugdha Hardikar
ced6c38239
fix(ingest): bigquery-usage - fix dataset name for sharded table ( #5412 )
2022-07-19 20:59:02 -07:00
Mugdha Hardikar
a6dc669891
docs(bigquery): add changelog and unittest for profiling limits ( #5407 )
2022-07-19 09:39:09 +05:30
Mayuri Nehate
e6ce4324c9
fix(ingest): looker - pass transport options to all api calls ( #5417 )
2022-07-17 13:55:20 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Pedro Silva
bc96cf22e7
fix(metadata-ingestion) Fix broken csv enricher test ( #5406 )
2022-07-15 19:00:36 +05:30
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added ( #5397 )
2022-07-15 15:37:06 +05:30
Pedro Silva
b2edd44b6a
Adds support for Domains in CSV source ( #5372 )
2022-07-15 14:20:41 +05:30
Felix Lüdin
a0303448ba
feat(dashboards): add datasets field to DashboardInfo aspect ( #5188 )
...
Co-authored-by: John Joyce <john@acryl.io>
2022-07-14 09:54:02 -07:00
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation ( #5196 )
2022-07-13 10:17:38 -07:00
Shirshanka Das
860d475c5e
feat(ingest): improve domain ingestion usability ( #5366 )
2022-07-11 09:37:38 -07:00
Shirshanka Das
558a65a3c3
fix(ci): fix mysql test and attempt kafka-connect ingestion ( #5352 )
2022-07-07 08:28:34 -07:00
Mugdha Hardikar
94dd3ad5a1
fix(ingest): bigquery-usage - dataset name for sharded tables ( #5347 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-07 00:37:13 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector ( #5104 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Aditya Radhakrishnan
fc8e59387d
feat(ingest): update CSV source to support description and ownership type ( #5346 )
2022-07-06 21:29:29 +05:30
Mayuri Nehate
f23c2c9b64
fix(ingest): tableau - omit schema fields when name is absent ( #5275 )
2022-07-05 10:40:55 -07:00
Shirshanka Das
e93e4691fb
feat(ingest): lookml - adding support for only emitting reachable views from explores ( #5333 )
2022-07-05 10:14:12 -07:00
Mayuri Nehate
80e91b457f
feat(ingest): looker - ingest dashboard create/update/delete timestamps ( #5312 )
2022-07-05 09:04:41 -07:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake ( #5259 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
Shirshanka Das
4b3135a0f8
feat(ingest): dbt - improving dbt_meta mapping ( #5237 )
2022-06-24 13:43:12 +02:00
Tamas Nemeth
1086614129
fix(ingest): bigquery - Grouping date named tables at bigquery ( #5230 )
...
* Grouping date named tables at bigquery
* Fixing table name for sharded tables
2022-06-23 11:53:25 +02:00
Piotr Sierkin
9f2b3b9ba6
fix(ingest): dbt - make assertion display names consistent ( #5214 )
...
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-22 22:07:00 -07:00
Aditya Radhakrishnan
82ca92f8f9
feat(ingest): adds csv enricher ingestion source ( #5221 )
2022-06-22 12:25:39 +05:30
Atul Saurav
648ebfcc93
feat(ingestion) ldap: make ldap attrs keys configurable ( #4682 )
2022-06-21 12:01:00 -07:00
Tamas Nemeth
393c07ee52
refactor(ingest): bigquery-usage - Adding tests for bigquery usage filters ( #5195 )
2022-06-20 18:28:27 -07:00
Aseem Bansal
c942350e3c
feat(ci): split integration tests to reduce run time ( #5205 )
2022-06-20 21:08:37 +05:30
Aseem Bansal
d518b5a085
fix(cli): correct handling of env variables ( #5203 )
2022-06-20 20:53:47 +05:30
