Harshal Sheth
fcdb8a2226
fix(ingest): mongodb - add pymongo srv extra ( #5701 )
2022-08-22 23:42:09 -07:00
Tamas Nemeth
c66c263ceb
fix(airflow): Stable tag order in DataFlow/DataJobs ( #5696 )
2022-08-22 23:40:53 -07:00
Remi
b3022b15ca
feat(ingestion): dbt - add github_info config ( #5648 )
2022-08-22 23:38:28 -07:00
Harshal Sheth
679cd290fb
feat(ingest): dbt - add enable_owner_extraction option ( #5707 )
2022-08-22 23:36:51 -07:00
Shirshanka Das
b2383acdd0
fix(ingest): refactor sync-async config, thread-safety for sink reporting ( #5705 )
2022-08-22 18:55:30 -07:00
Aditya Radhakrishnan
4e2bfdd236
fix(ingest): emit status aspect for entities ingested from okta and azure_ad ( #5700 )
2022-08-22 13:28:35 -07:00
Shirshanka Das
7a58381eb6
feat(ingest): add support for a event failure log, reporting cancelled runs on cli ( #5694 )
2022-08-21 23:15:34 -07:00
divyamanohar-stripe
2afa3a2b2e
feat(airflow): add UP_FOR_RETRY run result for task runs ( #5664 )
2022-08-21 17:17:02 -07:00
Shirshanka Das
647de906f2
feat(ingest): rest-sink - stability improvements to handle large inpu… ( #5693 )
2022-08-21 12:30:19 -07:00
Shirshanka Das
bb788ac317
feat(ingest): file - add support for folders, large files, improve co… ( #5692 )
2022-08-21 14:18:22 +05:30
Ravindra Lanka
228f3b50ea
feat(ingestion): send reports of ingestion runs to datahub ( #5639 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-19 09:08:17 -07:00
Chris Collins
67bec6cf83
fix(docs) Fix link from Business Glossary ingestion page ( #5680 )
...
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2.lan>
2022-08-18 16:52:54 -07:00
Harshal Sheth
ad57fb9dbb
chore(ingest): set min stackprinter version ( #5666 )
2022-08-18 11:47:49 -07:00
Kwanyoung Son
9143663f1f
fix(ingest): redash - fix redash dashboard url bug ( #5500 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-16 13:39:27 -07:00
Aezo
8d6a9e08c9
feat(ingest): GE profiler Trino support ( #5361 )
...
* feat(ingest): GE Profile/Action Trino support
* bumping GE version
* updated golden test files
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-16 09:46:52 -07:00
Peter Szalai
0d5e698218
feat(ingest): rest_emitter - Adding option to disable ssl ( #5642 )
2022-08-16 15:31:46 +02:00
Harshal Sheth
d854798b96
fix(ingest): remove detailed profiler event ( #5616 )
2022-08-15 22:42:42 -07:00
Harshal Sheth
bf189d980d
fix(ingest): mongodb - use ping command to test connection ( #5650 )
...
fixes #5637 .
2022-08-15 22:37:07 -07:00
Harshal Sheth
680c4a8f81
chore(ingest): drop data-lake source in favor of s3 source ( #5628 )
2022-08-15 22:30:40 -07:00
Mugdha Hardikar
a449e8ba7d
feat(mssql): add multi database ingest support ( #5516 )
...
* feat(mssql): add multi database ingest support
* Delete older golden file.
* Update s3.md
* fix test setup
2022-08-15 21:37:47 -07:00
Harshal Sheth
dfd0d1581b
fix(ingest): remove alphabet field from allow/deny config ( #5629 )
2022-08-15 20:55:17 -07:00
Mayuri Nehate
dc08bedd6e
feat(ingest): snowflake - add snowflake-beta connector ( #5517 )
2022-08-15 20:54:02 -07:00
Amanda Hernando
337087cac0
feat(ingest): glue - add stateful ingestion ( #5553 )
2022-08-15 20:50:45 -07:00
Harshal Sheth
41e8f7b203
feat(ingest): generate a list of aspects in codegen ( #5633 )
2022-08-15 17:21:40 -07:00
Mugdha Hardikar
31abb57bde
fix(ingest): delta-lake - allow environment, credential file based s3 authentication ( #5636 )
2022-08-15 17:08:41 -07:00
John Joyce
be22455ebb
feat(ui): Adding slack handle to corp group info ( #5645 )
2022-08-15 14:35:57 -07:00
Peter Szalai
b496994e06
docs(ingestion): Improve developer docs ( #5644 )
2022-08-15 12:41:23 -07:00
Shirshanka Das
b996f21844
fix(ingest): cli - handle exception in upgrade check ( #5641 )
2022-08-14 11:52:20 -07:00
Shirshanka Das
63a3745010
fix(ingest): okta - make async loop init more robust ( #5640 )
2022-08-12 17:35:53 -07:00
Harshal Sheth
a991dc9491
fix(ingest): delta-lake - fix iteration bug ( #5625 )
2022-08-11 18:25:19 -07:00
Aditya Radhakrishnan
b042ab1ab0
fix(ingest): fix indenting issue in azure ad connector ( #5627 )
2022-08-11 14:10:28 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support ( #5521 )
2022-08-10 15:00:31 -07:00
Harshal Sheth
44328b66e3
fix(ingest): use default telemetry ID when config is unwritable ( #5614 )
2022-08-10 14:58:03 -07:00
mohdsiddique
34c2f94ede
fix(transformers): domain transformer - change config, add docs ( #5606 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-10 12:14:05 -07:00
Ravindra Lanka
3aa74e0431
fix(ingest): glue - fix minor logging bug. ( #5605 )
2022-08-09 17:45:55 -07:00
liyuhui666
0481075705
fix(ingest): Fix ingest Clickhouse without password ( #5511 )
...
* fix(ingest): Fix ingest Clickhouse without password
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-09 10:30:56 -07:00
Harshal Sheth
c7b3413b11
fix(ingest): simplify upgrade version stats ( #5588 )
2022-08-09 22:07:34 +05:30
Harshal Sheth
b46a6cd63f
feat(ingest): remove orderedset dependency ( #5591 )
2022-08-09 22:07:20 +05:30
liyuhui666
d33eecbad5
feat(ingest): clickhouse - add metadata modification time and data size ( #5330 )
...
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-08 14:00:02 -07:00
Jordan Wolinsky
3a86ff3485
Fix profiling when using {table}. ( #5531 )
...
* profiling fix for when using {table}
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-08-08 13:16:59 -07:00
Jordan Wolinsky
33339e2c89
Expose catalog_name in athena.py ( #5548 )
...
* expose catalog_name to the sql alchemy uri that is passed into pyathena
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-08 11:40:05 -07:00
mohdsiddique
0a3721cab3
feat(ingest): power-bi - make ownership ingestion optional ( #5335 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-08-08 11:26:00 -07:00
Mugdha Hardikar
b32a0723a1
feat(ingest): delta-lake - extract table history into operation aspect ( #5277 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-07 11:35:09 -07:00
Shirshanka Das
da0258c6ad
fix(ingest): moving delta-lake connector to be 3.7+ only ( #5584 )
2022-08-07 09:32:18 -07:00
Mugdha Hardikar
d6621b4481
fix(ingest): sql-common - db2, snowflake bug fixes to extract table descriptions ( #5526 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-07 09:23:23 -07:00
Harshal Sheth
9790f3cefa
feat(ingest): infer aspectName from aspect type in MCP ( #5566 )
2022-08-07 07:52:58 -07:00
Piotr Sierkin
828a711684
feat(ingest): dbt - control over emitting test_results, test_definitions, etc. ( #5328 )
...
Co-authored-by: Piotr Sierkin <piotr.sierkin@getindata.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-06 21:42:53 -07:00
Harshal Sheth
69124a0a99
fix(ingest): handle when current server version is unavailable ( #5547 )
2022-08-06 20:59:52 -07:00
Harshal Sheth
3c2a9c585b
fix(ingest): activate mypy support for ParamSpec typing annotation ( #5551 )
2022-08-04 17:05:52 +05:30
mohdsiddique
c619ba9500
feat(transformers): Add domain transformer for dataset ( #5456 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-03 21:11:42 -07:00
