3904 Commits

Author SHA1 Message Date
Tamas Nemeth
a6930562fd
fix(ingest): presto-on-hive - Setting display name properly (#6065) 2022-09-29 16:20:17 +02:00
Harshal Sheth
71f5ec7f19
fix(ingest): mssql - alias for mssql-odbc source (#6080) 2022-09-29 15:33:49 +02:00
Harshal Sheth
05b9d4ef2f
fix(doc): note that Athena doesn't support lineage (#6081) 2022-09-29 15:30:09 +02:00
Shirshanka Das
74d9fa25a6
feat(ingest): looker - add support for simple column level lineage (#6084) 2022-09-28 20:41:30 -07:00
Mayuri Nehate
21a8718b10
feat(ingest): add column-level lineage support for snowflake (#6034) 2022-09-28 16:30:05 -07:00
Harshal Sheth
7e08a05a22
docs(ingest): clarify bigquery-beta multiproject setup (#6071) 2022-09-27 23:52:55 -07:00
Tamas Nemeth
3b9e9793a7
fix(ingest): bigquery-beta - handling complex types properly (#6062) 2022-09-27 21:31:24 +02:00
Harshal Sheth
59a2228d13
fix(ingest): correct tableau browse paths (#6064) 2022-09-27 12:30:52 -07:00
Harshal Sheth
7da2e9852f
fix(ingest): compat with mypy 0.981 (#6056) 2022-09-27 17:34:57 +02:00
Harshal Sheth
3f1d47c069
feat(ingest): list referenced env variables in recipe (#6043) 2022-09-26 23:16:18 -07:00
mohdsiddique
c062bf2201
fix(ingestion): Tableau test case execution fix (#6005) 2022-09-26 18:14:42 -07:00
Mayuri Nehate
dc8b9d3c4d
docs(ingest): add path spec examples for s3 (#6050) 2022-09-26 18:06:54 -07:00
Tamas Nemeth
32b8bef92e
fix(ingest): bigquery-beta - Additional fixes for Bigquery beta (#6051) 2022-09-26 14:08:09 -07:00
Alexey Kravtsov
3c3ab64954
feat(ingest): implement compression for CheckpointState (#6007) 2022-09-26 10:18:42 -07:00
Harshal Sheth
611c053117
refactor(ingest): use aspect map in transformers (#6040) 2022-09-25 23:48:58 -07:00
Harshal Sheth
036f7202dd
docs(ingest): add example of dbt column_meta_mapping (#6038) 2022-09-25 23:40:59 -07:00
Harshal Sheth
f227bd982b
refactor(ingest): streamline pydantic configs (#6011) 2022-09-25 23:37:48 -07:00
Tamas Nemeth
3b1a0c568e
fix(ingest): bigquery-beta - Getting datasets with biquery client (#6039)
* Getting datasets with biquery client instead of information schema because it did not work everywhere
Changing lists to lossylist in report
2022-09-24 00:48:15 +02:00
John Joyce
78454888b5
refactor(ingest): Browse Paths Upgrade Tableau (#6008) 2022-09-23 13:02:34 -07:00
Tamas Nemeth
722be5dc0c
fix(ingest): bigquery-beta - Project name quote and graceful lineage/usage failures (#6035) 2022-09-23 19:25:34 +02:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
Harshal Sheth
0c63178a71
fix(ingest): support snowflake-beta extra compatibility (#6032) 2022-09-22 22:07:44 -07:00
Harshal Sheth
3a6d1d2bf1
feat(ingest): aws - support extra args to role config (#6031) 2022-09-22 17:43:32 -07:00
Harshal Sheth
27f28019de
refactor(ingest): move common host_port validation (#6009) 2022-09-22 16:32:07 -07:00
Ravindra Lanka
b8941ab190
feat(ingestion): Add fail-safe stale entity removal via configurable 'fail_safe_threshold' param. (#6027) 2022-09-22 16:09:22 -07:00
Harshal Sheth
2c03005fc2
fix(ingest): glue - better error handling (#6030) 2022-09-22 14:53:19 -07:00
Shirshanka Das
11191734fe
fix(ingest): lookml - make explore parsing more robust (#6028) 2022-09-22 13:14:39 -07:00
Harshal Sheth
25b335d3b3
feat(quickstart): add --no-pull-images option to docker quickstart (#6017) 2022-09-21 21:57:17 -07:00
Harshal Sheth
68db859ca1
refactor(ingest): streamline two-tier db config validation (#5986) 2022-09-21 10:45:37 -07:00
Ravindra Lanka
b638bcf442
feat(ingestion): Documentation on adding stateful ingestion use-cases to new sources (#5985) 2022-09-21 09:02:50 -07:00
mohdsiddique
44a67b52cf
feat(ingestion): Tableau dashboard & chart usage stats (#5999)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-20 17:41:56 -07:00
Mayuri Nehate
b195b6c123
fix(ingest): encode reserved characters when creating dataset urn (#5977)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-20 16:59:02 -07:00
Tamas Nemeth
46494bc0ad
feat(ingest): presto-on-hive - Description and hive view support (#5993)
* Presto on Hive Improvements like:
 - Capturing table/column descriptions
 - Adding Hive view support
 - Various bug fixes
2022-09-21 00:40:10 +02:00
Shirshanka Das
8e8fb51ce3
feat(cli): extend put command to support platform creation (#5990) 2022-09-20 11:52:22 -07:00
Aezo
6c865d00c4
feat(ingest): stateful, catalog and pascalcase con (#5890) 2022-09-20 14:54:22 +02:00
Pedro Silva
7e5f44a481
feat(docs): Adds docs on K8s scheduled ingestion (#5984) 2022-09-20 15:04:42 +05:30
Harshal Sheth
8ffa7054e5
feat(ingest): dbt column-level meta mappings + add_terms operation (#5970)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-19 15:26:12 -07:00
John Joyce
df3633e7f3
refactor(looker): Migrating to new browse path format (#5688) 2022-09-19 14:43:35 -07:00
Mayuri Nehate
4062385d6b
fix(ingest): pin great-expectations dependency to fix profiling error (#5980) 2022-09-19 12:45:22 -07:00
Harshal Sheth
98ee621849
fix(ingest): handle uname missing on windows (#5981) 2022-09-19 10:36:16 -07:00
Tamas Nemeth
663a659f66
feat(ingest): bigquery-v2 - Add full profiling capability (#5953) 2022-09-17 09:46:45 +02:00
Harshal Sheth
c8cd7d5040
refactor(ingest): use typed objects in dbt ingestion (#5929) 2022-09-16 15:07:59 -07:00
Mayuri Nehate
a14617b6a4
fix(ingest): continue validation of s3 path_specs even if platform is set (#5951) 2022-09-16 12:03:57 -07:00
Harshal Sheth
937ab192c0
feat(ingest): add support for aliases in plugin registry (#5958) 2022-09-16 07:19:32 -07:00
Harshal Sheth
78f648a6e0
docs(ingest): add example of ssl with mysql (#5954) 2022-09-16 17:46:52 +05:30
skrydal
a026c84691
feat: qualifiedName support + populating glue ARN (#5952) 2022-09-15 21:15:03 -07:00
Shirshanka Das
f70bb201ce
fix(build): fix preflight script for m1 for lib postgresql (#5957) 2022-09-15 13:21:02 -07:00
Shirshanka Das
8bbe3f61f7
fix(docs): fix loom embed (#5956) 2022-09-15 13:19:46 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source (#5923)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:53:54 -07:00
Mugdha Hardikar
93681d7a71
feat(ingest): delta-lake - support delta tables from minio (#5758)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:51:14 -07:00