Mayuri Nehate
a8c1397e5e
feat(ingest): tableau - improve lineage, workbooks query, fix pagination ( #5756 )
2022-09-05 23:19:22 -07:00
Harshal Sheth
7e16ce0126
feat(ingest): looker - add test connection ( #5768 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-05 21:11:34 -07:00
Harshal Sheth
bee27e8468
fix(ingest): use AwsConnectionConfig instead of AwsSourceConfig ( #5813 )
2022-09-05 21:10:33 -07:00
Harshal Sheth
6d83eb9449
refactor(ingest): prefer as imports instead of pegasus2avro files ( #5820 )
2022-09-05 21:09:07 -07:00
David Sanchez
a092a770a3
docs(ingest): bigquery - add needed delete role to list ( #5826 )
2022-09-05 21:04:33 -07:00
Tamas Nemeth
d283e2b588
fix(ingest): presto-on-hive - customize filter query for postgres ( #5825 )
2022-09-05 21:01:55 -07:00
Shirshanka Das
23b929ea10
feat(cli): report memory usage during ingest ( #5828 )
2022-09-05 11:53:39 -07:00
Shirshanka Das
172441beae
fix(ingest): looker - report dashboard scanning correctly ( #5829 )
2022-09-05 11:10:47 -07:00
Mayuri Nehate
4bf4236e29
feat(ingest): snowflake-beta - populate size, add table level profiles for large tables ( #5774 )
2022-09-04 22:37:57 -07:00
Shirshanka Das
84b279a933
feat(ingest):looker - reduce mem usage, misc reporting improvements ( #5823 )
2022-09-04 15:43:57 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph ( #5805 )
2022-09-02 15:24:40 +05:30
Shirshanka Das
ae4fb7c2e1
feat(ingest): looker - reduce memory requirements ( #5815 )
2022-09-02 10:45:51 +02:00
Tamas Nemeth
c91e29b052
fix(ingest): bigquery-beta - Fixing dependencies ( #5814 )
...
* Fixing bigquery beta dependencies
* Removing unneded comment
2022-09-02 13:47:14 +05:30
Shirshanka Das
9afda47085
feat(cli): add support for sampled reporting to keep logs manageable ( #5800 )
2022-09-01 14:47:28 -07:00
Harshal Sheth
c05f3970fd
feat(ingest): cli - add rewrite option for metadata file check ( #5763 )
2022-09-01 14:30:00 -07:00
Harshal Sheth
e884b69b0e
chore(ingest): remove archived docs ( #5793 )
2022-09-01 12:10:03 -07:00
Ravindra Lanka
af1fc8d91d
fix(ingest): snowflake - fix oauth config validation ( #5796 )
2022-08-31 17:51:13 -07:00
mohdsiddique
dbcd3099d4
fix(ingestion): looker - fix dashboard and chart-usage calculations ( #5791 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-31 16:22:11 -07:00
Gabe Lyons
570367ce4a
docs(lookml): updating github_info in lookml docs ( #5779 )
2022-08-31 10:23:10 -07:00
Shirshanka Das
134ca67369
feat(cli): add spinner to indicate progress ( #5769 )
2022-08-30 13:25:03 -07:00
Harshal Sheth
138846acca
fix(ingest): add pydantic version upper bound ( #5775 )
2022-08-30 11:07:23 -07:00
mohdsiddique
1f1056d7cf
feat(ingestion): looker - chart usage statistics ( #5652 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-08-30 00:21:31 -07:00
Tamas Nemeth
4572c96d60
feat(ingestion): bigquery - Bigquery beta connector - first cut ( #5663 )
2022-08-30 07:33:24 +02:00
Harshal Sheth
24e4ee1746
feat(ingest): add config to extractor interface ( #5761 )
2022-08-29 19:16:17 -07:00
Harshal Sheth
80edf7c8ed
fix(ingest): add databricks dep for hive ( #5764 )
2022-08-29 19:14:04 -07:00
Mayuri Nehate
cc2a86853b
fix(ingest): snowflake-beta - fix missing initialization of variable ( #5757 )
2022-08-29 16:35:36 -07:00
Harshal Sheth
eb87db9813
fix(ingest): proper null skip logic in serialization ( #5749 )
2022-08-29 16:34:58 -07:00
Tamas Nemeth
7e15947a37
fix(doc): presto-on-hive - Removing new lines from docs to fix doc generation ( #5755 )
2022-08-29 13:42:07 +02:00
Harshal Sheth
ee43262f7c
chore(ingest): add vulture config and remove dead code ( #5745 )
2022-08-28 23:41:15 -07:00
Harshal Sheth
d5547d0fb3
chore(ingest): update mixpanel api endpoint ( #5750 )
2022-08-27 18:02:53 -07:00
Mayuri Nehate
a6369d355b
feat(ingest): snowflake - improvements to snowflake-beta connector ( #5736 )
2022-08-27 16:25:50 -07:00
Ravindra Lanka
b23195d3df
Fix sqllineage parser to handle special tokens with a hyphens in the table and column names. ( #5748 )
2022-08-26 18:11:00 -07:00
John Joyce
10672c3464
fix(bootstrap): Remove malformed test in bootstrap.json ( #5747 )
2022-08-26 11:19:48 -07:00
Harshal Sheth
fa0fd7b830
fix(ingest): tweak mongodb schema inference to fix test ( #5744 )
2022-08-26 11:15:16 -07:00
Mugdha Hardikar
e448bb8832
feat(ingest): mysql - support multiple database in single recipe ( #5684 )
2022-08-26 19:47:49 +02:00
Shirshanka Das
fe52df6bab
fix(docs): fixes issue with auto-generated ingestion doc ( #5733 )
2022-08-26 09:31:53 -07:00
liyuhui666
08f5a44df0
feat(elasticsearch): Add nested type display ( #5524 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-08-26 09:07:03 -07:00
Shirshanka Das
ed1ceca9a7
fix(ingest): looker - soft-deleted charts should re-emerge on re-discovery ( #5732 )
2022-08-26 08:18:01 -07:00
Aseem Bansal
83d15dd86e
feat(ingest): file - allow filter by aspect and get stats ( #5738 )
2022-08-26 18:54:26 +05:30
Tamas Nemeth
a251625d04
fix(ingest): bigquery - Not setting ge config schema when profiling with temp table ( #5737 )
2022-08-26 13:32:44 +02:00
Shirshanka Das
c979349c65
fix(deps): remove tdigest dependency and associated code ( #5729 )
2022-08-25 17:08:38 -07:00
David Haglund
b830247727
fix(superset): do not crash when display_uri is not set ( #5711 )
2022-08-24 23:26:02 -07:00
Aseem Bansal
3da9941521
feat(ingest): round reported time to 2 decimal places ( #5721 )
2022-08-24 23:08:33 -07:00
Harshal Sheth
d7bdfc2b86
fix(ingest): redshift-usage: check full table names with AllowDenyPattern ( #5702 )
...
* fix(ingest): redshift-usage: check full table/schema names with AllowDenyPattern
* schema pattern does not take dot syntax
* update redshift filter test
2022-08-24 14:33:18 -07:00
mohdsiddique
7d532b8886
fix(ingestion): ingest tables from dba_tables in oracle source ( #5592 )
...
* inspector object wrapper for oracle inspector
* WIP
* before golden file creation
* fix(ingestion): ingest tables from dba_tables in oracle source
* code review comments
* address review comments
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:48:08 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term ( #5649 )
2022-08-24 08:01:56 -07:00
Shirshanka Das
d549ff323b
feat(ingest): remove nulls during serialization ( #5719 )
2022-08-24 08:00:56 -07:00
Ravindra Lanka
2a56d2c276
fix(ci): ingest - fix nifi integration tests ( #5718 )
2022-08-23 21:46:01 -07:00
Peter Szalai
150a36e236
feat(ingest): presto-on-hive - Add mode option to presto-on-hive source ( #5659 )
2022-08-23 23:18:27 +02:00
Shirshanka Das
505cefef13
feat(ingest): better reporting for file source, friendlier stats names ( #5710 )
2022-08-23 10:21:24 -07:00
