Alexey Kravtsov
c182fe7fca
feat(ingestion): add groups to ldap users ( #5470 )
2022-08-01 15:04:30 -07:00
Harshal Sheth
4f93aaa3a7
feat(ingest): add deprecation warning for Python 3.6 ( #5519 )
2022-08-01 10:20:41 -07:00
Harshal Sheth
465e2c6e9a
fix(ingest): fix unbound variable bug in cli ingest list-runs ( #5527 )
2022-07-29 17:30:35 -07:00
Vishal Shah
f11172f94c
fix(ingest): airflow: update subdag check for compatibility with older Airflow versions ( #5523 )
...
* use getattr to default None if no subdag
* add None check
* add other None check
* Apply suggestions from code review- double quotes
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
* minor tweak to fix lint
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-07-29 13:28:20 -07:00
Harshal Sheth
55cb34e5d4
test(ingest): limit GMS retries in test ( #5509 )
2022-07-29 15:11:31 +05:30
Aditya Radhakrishnan
c8fc246319
feat(identity): update azure and okta connectors to emit Origin aspects ( #5495 )
2022-07-28 16:03:57 -07:00
Harshal Sheth
9c7d4bd465
fix(ingest): respect rest emitter timeout setting ( #5508 )
2022-07-28 09:42:14 +05:30
Aseem Bansal
9b5afcce51
feat(cli): delete - add --only-soft-deleted option, perf improvements ( #5485 )
2022-07-27 11:22:24 -07:00
Harshal Sheth
690443ce14
fix(ingest): cleanup unused flake8 noqa statements ( #5492 )
...
* fix(ingest): cleanup unused flake8 noqa statements
In the future, we can discover these using `flake8-noqa`.
* add back c901
2022-07-27 22:02:32 +05:30
Aezo
85a55ffac7
fix(ingest): dbt - add support for trino datatypes ( #5379 )
2022-07-26 17:02:00 -07:00
Harshal Sheth
c294e89317
refactor(ingest): cleanup importlib.import_module calls ( #5490 )
2022-07-26 16:34:54 -07:00
Mayuri Nehate
04de6c27b7
feat(ingest): snowflake - test_connection add support for capability report ( #5472 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-26 09:29:57 -07:00
Mayuri Nehate
455ec182e5
feat(model, ingest): add user email in dashboard user usage counts ( #5471 )
2022-07-25 23:06:53 -07:00
Aseem Bansal
5d71f73062
feat(cli): delete - hard delete deletes soft deleted entities ( #5478 )
2022-07-25 18:17:02 -07:00
Gabe Lyons
efc5602493
feat(ingest): dbt - updating source lineage logic ( #5414 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-24 23:55:01 -07:00
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore ( #5418 )
2022-07-24 23:52:25 -07:00
Tamas Nemeth
cb05159474
fix(ingest): bigquery: multiproject profiling fix ( #5474 )
2022-07-23 18:44:46 +02:00
Guillaume Gardey
6101759c0a
fix(ingest/trino): Avoid exception if $properties table empty or not readable ( #5447 )
...
Under some configuration of access rules in Trino, the user may not have
read access to the content of the table, which will result in an exception
(`fetchone()` returns `None`)
This commit ensures no exception are raised and the ingestion can proceed.
2022-07-22 14:17:29 +05:30
Shirshanka Das
7ed9cd2838
feat(ingest): snowflake - basic test connection capability ( #5464 )
2022-07-22 09:14:37 +02:00
Mayuri Nehate
fa46167dfe
fix(ingest): tableau - fix tableau db error, add more logs ( #5423 )
2022-07-21 08:54:16 -07:00
Shirshanka Das
14d764a26f
fix(ingest): fix serialization of report to handle nesting ( #5455 )
2022-07-20 18:25:07 -07:00
Mugdha Hardikar
1f4d3722e2
fix(ingest): hive - add column comment as a column description ( #5449 )
2022-07-20 12:32:02 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT ( #5451 )
2022-07-20 20:54:43 +05:30
Mugdha Hardikar
ced6c38239
fix(ingest): bigquery-usage - fix dataset name for sharded table ( #5412 )
2022-07-19 20:59:02 -07:00
Tim Costa
d065553958
fix(ingest/glue): handle error when generating s3 tags for virtual view tables ( #5398 )
...
Co-authored-by: Tim Costa <timcosta@amazon.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-19 20:43:09 -07:00
Shirshanka Das
76133c6f37
feat(ingest): add test source connection feature, structured report file ( #5442 )
2022-07-19 20:40:59 -07:00
Mugdha Hardikar
a6dc669891
docs(bigquery): add changelog and unittest for profiling limits ( #5407 )
2022-07-19 09:39:09 +05:30
Mayuri Nehate
65a308a4ed
fix(ingest): looker - extract usage for dashboards allowed by pattern ( #5424 )
2022-07-18 14:21:17 +02:00
Mayuri Nehate
e6ce4324c9
fix(ingest): looker - pass transport options to all api calls ( #5417 )
2022-07-17 13:55:20 -07:00
Shirshanka Das
f387fa6149
fix(ingest): ensure upgrade checks run async ( #5383 )
2022-07-16 17:38:33 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added ( #5397 )
2022-07-15 15:37:06 +05:30
Pedro Silva
b2edd44b6a
Adds support for Domains in CSV source ( #5372 )
2022-07-15 14:20:41 +05:30
Aseem Bansal
ef02bf4b04
fix(quickstart): use platform agnostic way to get folder ( #5400 )
2022-07-15 14:15:24 +05:30
Aseem Bansal
45315ef1d4
fix(bigquery): add storage project name ( #5395 )
2022-07-14 19:52:38 +05:30
Aseem Bansal
60714df08f
fix(bigquery): multi-project GCP setup run query through correct project ( #5393 )
2022-07-14 16:03:01 +05:30
Tamas Nemeth
4334248953
feat(airflow): Circuit breaker and python api for Assertion and Operation ( #5196 )
2022-07-13 10:17:38 -07:00
Tamas Nemeth
9ec4fbae86
fix(ingest): bigquery - Graceful bq partition id date parsing failure ( #5386 )
2022-07-13 13:21:45 +02:00
Tamas Nemeth
4c6d427800
fix(cli): respect server telemetry settings correctly ( #5384 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-13 11:24:18 +02:00
Tamas Nemeth
f0281f32ab
fix(airflow): fix for failing serialisation when Param was specified + support for external task sensor ( #5368 )
...
fixes #4546
2022-07-12 10:20:27 -07:00
Aezo
ff0aa3f24b
feat(sdk): python - add get_aspects_for_entity ( #5255 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-12 10:10:07 -07:00
Navin Sharma
f3e5afdba9
feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart ( #5353 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-11 22:33:24 -07:00
Shirshanka Das
489b5bb5b4
fix(ingest): domains - check whether urn based domain exists during resolution ( #5373 )
2022-07-11 15:08:26 -07:00
Shirshanka Das
860d475c5e
feat(ingest): improve domain ingestion usability ( #5366 )
2022-07-11 09:37:38 -07:00
Mugdha Hardikar
94dd3ad5a1
fix(ingest): bigquery-usage - dataset name for sharded tables ( #5347 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-07 00:37:13 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector ( #5104 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Aditya Radhakrishnan
fc8e59387d
feat(ingest): update CSV source to support description and ownership type ( #5346 )
2022-07-06 21:29:29 +05:30
Mugdha Hardikar
77eaab609d
docs(bigquery): profiling report enhancement ( #5342 )
2022-07-06 18:38:35 +05:30
Vincent Koc
d60f789519
chore: Refactor Python Codebase ( #5113 )
2022-07-06 16:09:27 +05:30
Mugdha Hardikar
5216d72f91
feat(bigquery): support size, rowcount, lastmodified based table selection for profiling ( #5329 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-06 15:29:26 +05:30
Mayuri Nehate
f23c2c9b64
fix(ingest): tableau - omit schema fields when name is absent ( #5275 )
2022-07-05 10:40:55 -07:00
