87 Commits

Author SHA1 Message Date
Shirshanka Das
c5fc2ea798
fix(ingest): looker - deps, column level lineage fixes (#6271) 2022-10-24 08:31:48 +02:00
Shirshanka Das
26b4a9eec4
fix(ingest):lookml - better column-level lineage, hive urn generation… (#6254) 2022-10-20 16:39:11 -07:00
Harshal Sheth
30014072ad
feat(ingest): lookml - add support for local/remote dependencies (#6150) 2022-10-07 13:14:21 -07:00
Shirshanka Das
74d9fa25a6
feat(ingest): looker - add support for simple column level lineage (#6084) 2022-09-28 20:41:30 -07:00
John Joyce
df3633e7f3
refactor(looker): Migrating to new browse path format (#5688) 2022-09-19 14:43:35 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term (#5649) 2022-08-24 08:01:56 -07:00
Harshal Sheth
355c129c7c
chore(ingest): drop python 3.6 support (#5521) 2022-08-10 15:00:31 -07:00
Harshal Sheth
690443ce14
fix(ingest): cleanup unused flake8 noqa statements (#5492)
* fix(ingest): cleanup unused flake8 noqa statements

In the future, we can discover these using `flake8-noqa`.

* add back c901
2022-07-27 22:02:32 +05:30
Shirshanka Das
e93e4691fb
feat(ingest): lookml - adding support for only emitting reachable views from explores (#5333) 2022-07-05 10:14:12 -07:00
Gabe Lyons
3c7c83f447
tests(lookml): adding tests for model deny patterns (#4934) 2022-06-06 08:26:27 -07:00
Shirshanka Das
8d281fc013
fix(ingest): lookml - add view definitions for all views (#4875) 2022-05-10 10:48:36 -07:00
darapuk
a05d798939
(fix): Update path generated when creating LookML URL (#4554)
* (fix): Update path generated when creating LookML URL
2022-04-01 11:54:36 -07:00
Shirshanka Das
a69eac8247
feat(ingest): dbt,looker,sql_common,kafka - moving sources to produce display names and subtypes more consistently (#4496) 2022-03-27 18:49:26 -05:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
Swaroop Jagadish
7d986ec880
fix(ingest): populate system metadata for all metadata events (mcp, mcpw) (#3900) 2022-01-16 12:03:38 -08:00
Hyun Min Choi
e76d40b57a
fix(lkml): bump lkml version up to 1.1.2 to support sql_preamble expression (#3757) 2021-12-21 12:13:13 -08:00
varunbharill
73bd7657aa
fix(test): Fixing lookml integration test. (#3405) 2021-10-14 18:09:32 -07:00
Swaroop Jagadish
0cf157e991
fix(ingest): lookml view file resolution and looker spurious aspect issues (#3397) 2021-10-14 01:16:35 -07:00
John Joyce
d7a6ca5423
feat(subtypes): support visualization for "view" subtypes (#3376) 2021-10-12 15:47:29 -07:00
Swaroop Jagadish
0d2454bfb1
feat: add support for specialization of models through subtypes with looker integration (#3338) 2021-10-06 23:39:52 -07:00
Swaroop Jagadish
cfc97107e8
feat(ingest): add support for github and looker links in looker views and explores (#3332) 2021-10-06 07:13:38 -07:00
Swaroop Jagadish
6580a453c8
fix(ingest): more robust error handling in lookml sql parsing (#3325) 2021-10-03 20:04:26 -07:00
Swaroop Jagadish
bc50c8a779
fix(ingest): fix typo in looker tag generation (#3287) 2021-09-22 12:33:20 -07:00
Gabe Lyons
ff527f4bed
feat(foreign keys): add foreign key models (#3275) 2021-09-22 10:29:27 -07:00
Swaroop Jagadish
dea5ef7b09
fix(ingest): making lookml recursive and nested includes work (#3264) 2021-09-19 17:28:44 -07:00
Swaroop Jagadish
bb73c467da
fix(ingest): looker cascading derived tables should express lineage to view not underlying table (#3262) 2021-09-18 09:43:15 -07:00
Swaroop Jagadish
9db7a34cfa
feat(ingest): looker and lookml improvements - connection, explores, folders (#3255) 2021-09-16 23:09:45 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization (#3079) 2021-08-11 15:47:18 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960) 2021-07-29 20:04:40 -07:00
Harshal Sheth
90e05df791
fix(ingest): refactor + fix recursion in lookml file loading logic (#2913) 2021-07-22 15:54:01 -07:00
Harshal Sheth
89bdfdf1a8
fix(ingest): correct globs in lookml model discovery (#2891) 2021-07-16 11:59:50 -07:00
Harshal Sheth
2f921d15e8
fix(ingest): avoid setting timestamps unless source system provides it (#2843) 2021-07-08 12:11:06 -07:00
Harshal Sheth
d66381451a
feat(ingest): refactor mce comparison and add pytest update golden files option (#2812) 2021-06-30 16:53:20 -07:00
Kevin Hu
4ddc4c28be
fix(ingest): fix lookml platform URN (#2742) 2021-06-22 13:55:29 -07:00
Kevin Hu
a89094da5b
feat(ingest): add support for Glue ETL jobs (#2687) 2021-06-22 11:33:22 -07:00
Harshal Sheth
26dcece8ec
fix(ingest): use looker data platform (#2708) 2021-06-16 16:58:13 -07:00
Fredrik Sannholm
133577557c
feat(ingest): Looker view and dashboard ingestion (#2493) 2021-05-13 11:42:53 -07:00