3089 Commits

Author SHA1 Message Date
Harshal Sheth
90e05df791
fix(ingest): refactor + fix recursion in lookml file loading logic (#2913) 2021-07-22 15:54:01 -07:00
Harshal Sheth
6e833e761e
feat(ingest): improve bigquery-usage robustness and docs (#2925) 2021-07-22 15:37:55 -07:00
aseembansal-gogo
7dfe61a542
fix(ingest): fix workunit name to be consistent with other sources (#2931) 2021-07-22 15:26:47 -07:00
Kevin Hu
757abfc6f6
fix(ingest): fix browsepaths and ownership urns (#2935) 2021-07-22 15:26:10 -07:00
aseembansal-gogo
4e0da7c319
fix(ingest): glue add support for mapping varchar, decimal types (#2930) 2021-07-22 13:47:26 -07:00
Kevin Hu
6dbc59940a
feat(ingest): refactor mlModel grouping and add browsepaths (#2929) 2021-07-22 13:33:15 -07:00
Harshal Sheth
7dc85a478e
feat(ingest): add make_data_platform_urn method to builder (#2926) 2021-07-22 13:25:07 -07:00
Kevin Hu
84a1486b89
feat(ingest): dbt aliases (#2927) 2021-07-22 07:57:14 -07:00
Lal Rishav
99790d9052
fix(react): enable relation between glossary term and datasets searchable (#2806)
* 2805 | glossary term linked to dataset is not displayed
2021-07-22 07:25:29 -07:00
Kevin Hu
736249f0c7
feat(ingest): extract SageMaker metrics, hyperparameters, and external URLs (#2910) 2021-07-21 21:30:07 -07:00
Harshal Sheth
7535cf2b85
fix(ingest): note that views are not supported for Athena (#2924) 2021-07-21 12:48:40 -07:00
Harshal Sheth
ad30f2b8ec
feat(ingestion): support multiple project IDs in bigquery usage stats (#2920) 2021-07-21 12:42:06 -07:00
Harshal Sheth
416f2a95df
feat(ingest): add support for Oracle spatial types (#2909) 2021-07-20 19:13:49 -07:00
Kevin Hu
91c01a3b42
fix(ingest): stringify all dbt custom props (#2916) 2021-07-20 10:14:45 -07:00
aseembansal-gogo
6e1b2cf4f7
feat(ingest): Add option to change name of database for postgres (#2898) 2021-07-20 07:01:42 -07:00
Harshal Sheth
267efe767f
fix(ingest): issue a warning if the column list is empty (#2912) 2021-07-20 06:45:35 -07:00
Kevin Hu
6abd5e191a
feat(ingest): lineage for SageMaker model endpoints and groups (#2894) 2021-07-19 11:30:43 -07:00
Harshal Sheth
45e931dbac
feat(ingest): add can_add_aspect method for MCEs (#2905) 2021-07-17 20:02:07 -07:00
Remi
79218b1466
feat(ingest): use node comment as description if existing else default to key (#2877) 2021-07-16 12:54:32 -07:00
Harshal Sheth
0cf31544b8
fix(ingest): use logger.warning instead of logger.warn (#2893) 2021-07-16 12:15:55 -07:00
James Lamb
caaf7107b8
fix(ingest): change LookMLSource._get_upsteam_lineage() to _get_upstream_lineage() (#2888) 2021-07-16 12:14:13 -07:00
Harshal Sheth
89bdfdf1a8
fix(ingest): correct globs in lookml model discovery (#2891) 2021-07-16 11:59:50 -07:00
Kevin Hu
dc72ecd5a4
feat(ingest): add connectivity check for Looker (#2902) 2021-07-16 11:58:24 -07:00
Kevin Hu
289153574c
fix(ingest): string-ify dbt custom props (#2900) 2021-07-16 09:35:14 -07:00
Lal Rishav
ae014bf2e1
fix(glossary):default browse path for glossary term (#2788) 2021-07-16 09:15:24 -07:00
Kevin Hu
44ed2f3684
feat(ingest): extract lineage between SageMaker jobs and models (#2868) 2021-07-15 18:56:13 -07:00
Harshal Sheth
8e573fdb31
fix(ingest): fix druid misconfiguration bug (#2882) 2021-07-14 20:29:23 -07:00
Harshal Sheth
fe6bfc9685
fix(ingest): default to unlimited query log delay in bigquery-usage (#2881) 2021-07-14 20:05:31 -07:00
Kevin Hu
bc84c82a68
feat(ingest): extract dbt meta fields (#2876) 2021-07-13 14:58:25 -07:00
Kevin Hu
c4e2b9afa2
feat(ingest): add browse paths + dataplatform for Feast features (#2849) 2021-07-12 11:05:18 -07:00
Harshal Sheth
220dfe728c
feat(ingest): support dynamic imports for transfomer methods (#2858) 2021-07-12 11:03:53 -07:00
Harshal Sheth
fd02f711cd
fix(ingest): handle 'fields' list missing in bigquery-usage (#2844) 2021-07-08 17:10:11 -07:00
Kevin Hu
a2106ca9e8
feat(ingest): SageMaker jobs and models (#2830) 2021-07-08 16:16:16 -07:00
Kevin Hu
799b0634e1
fix(ingest): check for dbt materialization before proceeding (#2842) 2021-07-08 15:12:37 -07:00
Harshal Sheth
74e34dddfc
feat(ingest): prettify stack traces in CLI (#2845) 2021-07-08 13:29:34 -07:00
Fredrik Sannholm
c2f2973c1b
fix(ingest): Fix glob pattern and handle possible recursion in lookml (#2851) 2021-07-08 12:26:11 -07:00
Harshal Sheth
2f921d15e8
fix(ingest): avoid setting timestamps unless source system provides it (#2843) 2021-07-08 12:11:06 -07:00
Kevin Hu
739e0efa61
fix(ingest): do not fail dbt ingestion when encountering missing nodes (#2833) 2021-07-06 19:32:00 -07:00
Harshal Sheth
523fa32eb6
fix(ingest): various BigQuery source fixes (#2836) 2021-07-06 19:18:18 -07:00
Harshal Sheth
6b59cdeb82
fix(ingest): mask password in info-level logs (#2835) 2021-07-06 16:41:54 -07:00
Harshal Sheth
288d17f07e
docs(ingest): update links to Kafka docs (#2834) 2021-07-06 15:33:52 -07:00
Harshal Sheth
2a9fdfc181
fix(cli): change docker nuke to also remove stopped containers (#2825) 2021-07-02 20:27:28 -07:00
Harshal Sheth
6ef0bf0dfd
fix(ingest): convert superset timestamps to micros (#2827)
* Previous values were in seconds, which rendered incorrectly in the UI.
2021-07-02 20:21:56 -07:00
Gabe Lyons
8d6362419f
docs(elastic-for-graph): Add migrating from neo4j to elastic instructions (#2826) 2021-07-02 20:19:33 -07:00
Harshal Sheth
d6c3043bc4
fix(ingest): view handling resilience for redshift (#2816) 2021-07-02 10:26:50 -07:00
Harshal Sheth
6fe663bf6a
feat(ingest): basic support for complex hive types (#2804) 2021-06-30 22:57:13 -07:00
Harshal Sheth
d66381451a
feat(ingest): refactor mce comparison and add pytest update golden files option (#2812) 2021-06-30 16:53:20 -07:00
Harshal Sheth
e51f86a9de
feat(ingest): support ingesting from multiple snowflake dbs (#2793) 2021-06-30 15:54:17 -07:00
Harshal Sheth
906ad67a37
refactor(ingest): extract sqlalchemy uri generation logic (#2786) 2021-06-30 09:33:41 -07:00
Harshal Sheth
ef75bc6e5c
fix(ingest): better warnings and error handling for rest sink (#2800) 2021-06-29 22:37:44 -07:00