5512 Commits

Author SHA1 Message Date
John Joyce
4649ca7f39
fix(gms): Validate unrecognized model fields. (#3034) 2021-08-04 22:23:16 -07:00
Kevin Hu
3d061161d8
fix(ingest): glue import type stubs only for testing (#3032) v0.8.8 2021-08-04 12:43:22 -07:00
Gabe Lyons
8c4a1414fc
fix(gms): handling partial system metadata in gms (#3030) 2021-08-04 12:26:29 -07:00
John Joyce
fa8f8b239a
feat(frontend): encode Original URI in Authentication Redirect (#3026) 2021-08-04 11:55:03 -07:00
Gabe Lyons
2fc71da58d
fix(restore-indices): add system metadata restoration to restore-indices (#3029) 2021-08-04 11:44:22 -07:00
Kevin Hu
3701931363
feat(ingest): extract dbt versions into custom properties (#3021) v0.8.7 2021-08-03 12:13:49 -07:00
Gabe Lyons
ea7952ce77
fix(caching): refetch query on update (#3020) 2021-08-03 12:05:18 -07:00
Kevin Hu
07bbd50ad2
fix(ingest): don't assume Glue job description always exists (#3019) 2021-08-03 11:42:43 -07:00
Brian
35aca2cad6
fix(react): fix weird 0 rendering possible bugs (#3000)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-08-03 11:18:39 -07:00
Dexter Lee
51a2669332
feat(ingest): add kafka emitters for MetadataChangeProposal format (#3018) 2021-08-03 11:17:16 -07:00
John Joyce
2aae2fd601
fix(gms): Adding Rest.li Write-Time Model Validation (#2999) 2021-08-03 09:54:13 -07:00
John Joyce
7074d9c627
fix(quickstart): Bumping Default Memory for GMS and Frontend (#3009) 2021-08-02 23:58:33 -07:00
John Joyce
20b1685de2
fix(gms): better logging on failed MCL / MAE (#3007) 2021-08-02 17:53:56 -07:00
Gabe Lyons
f4a6d18c12
fix(blank pages): removing apollo caching (#3008) 2021-08-02 17:49:57 -07:00
John Joyce
93069e5cec
fix(ci): using AspectExtractor instead of removed SnapshotToAspectMap (#3006) 2021-08-02 15:13:08 -07:00
Gabe Lyons
9b0f8bc0d3
fix(graphql): fetching data platforms using standard procedure (#2998) 2021-08-02 11:35:09 -07:00
Enrico Minack
8e9b5f4b7a
refactor(test): Refactor GraphService tests (#2944) 2021-08-02 11:34:45 -07:00
James Lamb
fd205221b2
fix(ingest): map all LookML dimension types to corresponding avro types (#2972) 2021-08-02 11:09:05 -07:00
Dexter Lee
283f6376d1
fix(ingestion): Safeguard against empty values for profile ingestion (#3005) 2021-08-02 10:42:40 -07:00
Dexter Lee
c982626867
fix(datahub-upgrade) add config registry to datahub upgrade container (#3002) 2021-08-02 07:55:35 -07:00
John Joyce
beb9b623fb
fix(dataset stats): Fix checks for existence of row and column counts (#3003) 2021-08-02 07:53:37 -07:00
Brian
411bbeab56
feat(react): update dataset documents tab with a merged document column (#2997) 2021-08-02 07:50:03 -07:00
Brian
25e8e8f5ad
feat(react): update search result has result counts for each entities that has result (#2991) 2021-08-02 07:48:22 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Dexter Lee
15c0c4dfb3
fix(browse): Fix browse pagination and multi-browse path issue (#2984) 2021-07-30 10:48:32 -07:00
aseembansal-gogo
2712f5587e
docs(ingest): Add instructions to install required dependency (#2995) 2021-07-30 07:21:24 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960) 2021-07-29 20:04:40 -07:00
Chinmay Bhat
cabcdd0553
docs(ingest): fixed Snowflake recipe to escape dollar-sign (#2994) 2021-07-29 16:36:09 -07:00
Harshal Sheth
c8aea00082
docs: remove a few outdated docs (#2981) 2021-07-29 15:32:23 -07:00
John Joyce
f3bc300737
docs: add docs on extracting container logs (#2988) 2021-07-29 15:12:30 -07:00
Harshal Sheth
49c53394b8
test(ingestion): run full tests on both python versions (#2963) 2021-07-29 00:21:41 -07:00
James Lamb
07ff99fdbe
fix(ingest): add more debug logging to LookML metadata ingestion (#2967)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-28 23:46:01 -07:00
James Lamb
acffd8fb4d
fix(ingest): ensure that LookML files are always parsed in the same order (#2966) 2021-07-28 23:20:49 -07:00
James Lamb
e88ccd93e3
fix(ingest): ensure workunits are created for all LookML views (#2965) 2021-07-28 23:13:15 -07:00
Gabe Lyons
242ca71f77
fix(tags): fixing tag applied to module for tags w/ colons in the name (#2982) 2021-07-28 23:09:25 -07:00
Gabe Lyons
d9d03c9bd9
feat(ml-model): adding ml models and ml model groups (#2961) 2021-07-28 20:39:05 -07:00
Kevin Hu
bf2775f6cf
feat(ingest): type stubs for boto3 (#2975) 2021-07-28 20:35:35 -07:00
James Lamb
b2dc4b96eb
perf(ingest): remove unused variable in Looker ingestion (#2979) 2021-07-28 20:33:27 -07:00
Harshal Sheth
1c334bb0e0
fix(ingest): infer bigquery project identifier (#2980)
Also refactor by moving get_identifier method into the source rather than leaving it in the config.
2021-07-28 20:31:33 -07:00
Chinmay Bhat
a33770b022
fix(ingest): fix hive ingestion to respect database configuration (#2978) 2021-07-28 20:20:18 -07:00
Harshal Sheth
7ab6355b1c
feat(ingest): stricter deserialization for MCE JSONs (#2976) 2021-07-28 14:50:21 -07:00
Kevin Hu
a1d1dd4269
feat(docs): tutorial for writing a custom transformer (#2959) 2021-07-28 14:38:13 -07:00
Harshal Sheth
14bca4c2f6
fix(ingestion): isolate dependency requirements of airflow hooks (#2977) 2021-07-28 14:23:06 -07:00
Harshal Sheth
c32ba3c5ef
feat(ingest): add timezone validation to bigquery usage (#2962) 2021-07-28 14:16:31 -07:00
Dexter Lee
e2d1acae9d
fix(elasticsearch-setup): fix elasticsearch setup for aws (#2974) 2021-07-28 13:55:15 -07:00
Harshal Sheth
328b098d01
text(ingestion): test multiple python versions in CI (#2952) 2021-07-26 13:25:58 -07:00
Harshal Sheth
fa22b8e17b
feat(ingest): add Airflow TaskFlow example (#2958) 2021-07-26 13:09:25 -07:00
Kevin Hu
662017ef17
fix(ingest): patch lookml types and refactor ingestion sources layout (#2950) 2021-07-26 13:06:52 -07:00
James Lamb
5d396b1487
fix(ingest): match nested LookML files mentioned in 'include' statements (#2957) 2021-07-26 12:38:49 -07:00
Gabe Lyons
79c956abe7
Revert "fix(gql): removing data platform caching in gql (#2947)" (#2956)
This reverts commit 49093ea1cee5e2563d9390ae529af08d287000aa.
2021-07-26 12:17:21 -07:00