Aezo
6c865d00c4
feat(ingest): stateful, catalog and pascalcase con ( #5890 )
2022-09-20 14:54:22 +02:00
Pedro Silva
7e5f44a481
feat(docs): Adds docs on K8s scheduled ingestion ( #5984 )
2022-09-20 15:04:42 +05:30
Shirshanka Das
e24e5b61b9
fix(datahub-ranger-plugin): add support to publish jars ( #5983 )
2022-09-19 17:46:01 -07:00
Harshal Sheth
8ffa7054e5
feat(ingest): dbt column-level meta mappings + add_terms operation ( #5970 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-19 15:26:12 -07:00
John Joyce
df3633e7f3
refactor(looker): Migrating to new browse path format ( #5688 )
2022-09-19 14:43:35 -07:00
Mayuri Nehate
4062385d6b
fix(ingest): pin great-expectations dependency to fix profiling error ( #5980 )
2022-09-19 12:45:22 -07:00
Harshal Sheth
2f7fe593b7
ci: reduce pip backtracking in airflow plugin ( #5982 )
2022-09-19 12:40:51 -07:00
Harshal Sheth
98ee621849
fix(ingest): handle uname missing on windows ( #5981 )
2022-09-19 10:36:16 -07:00
Parham Ghazanfari
2712dd1903
fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism. ( #5936 )
...
* fix(patch-entity-registry): Remove exception for entities with key aspects.
* test(patch-entity-registry): Fix failing unit test for entities with key aspect
* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java
* fix(patch-entity-registry): Remove duplicate semicolon.
* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.
* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java
* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java
Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-19 10:47:20 -05:00
Felix Lüdin
a407e0a370
feat(dashboard): add subTypes aspect to dashboard entity ( #5843 )
...
Co-authored-by: John Joyce <john@acryl.io>
2022-09-18 23:03:38 -07:00
Shirshanka Das
41746690fd
feat(protobuf): support for custom platform, subtypes, misc improvements ( #5973 )
2022-09-18 18:04:47 -07:00
Shirshanka Das
6f4835688e
fix(quickstart): elasticsearch-setup script fails on curl ( #5975 )
2022-09-18 17:05:13 -07:00
Tamas Nemeth
663a659f66
feat(ingest): bigquery-v2 - Add full profiling capability ( #5953 )
2022-09-17 09:46:45 +02:00
Harshal Sheth
c8cd7d5040
refactor(ingest): use typed objects in dbt ingestion ( #5929 )
2022-09-16 15:07:59 -07:00
Chris Collins
efc6ac3753
fix(ui) Filter search through schemas based on non-editable tags and terms as well ( #5942 )
...
* filter based on non-editable tags and terms as well
* update function name for consistency
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2.lan>
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2-18.lan>
2022-09-16 14:57:17 -07:00
Mayuri Nehate
a14617b6a4
fix(ingest): continue validation of s3 path_specs even if platform is set ( #5951 )
2022-09-16 12:03:57 -07:00
Aseem Bansal
eca73c0524
feat(ci): exempt from stale label ( #5964 )
2022-09-16 11:34:41 -07:00
Bogdan Antoniu
a86c966c91
feat(elasticsearch-setup): Add insecure option for curl
...
Co-authored-by: EXTERNAL Antoniu Bogdan (Fortech, EB-DB/ENG-Ku) <external.Bogdan.Antoniu@ro.bosch.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2022-09-16 11:22:50 -05:00
Harshal Sheth
937ab192c0
feat(ingest): add support for aliases in plugin registry ( #5958 )
2022-09-16 07:19:32 -07:00
Chris Collins
461406a090
feat(ingestion-ui) Use CLI version defined in recipe for test connection ( #5959 )
2022-09-16 09:54:39 -04:00
Harshal Sheth
78f648a6e0
docs(ingest): add example of ssl with mysql ( #5954 )
2022-09-16 17:46:52 +05:30
Aseem Bansal
a4720f8e2e
feat(elastic-setup): add better error handling ( #5963 )
2022-09-16 17:34:06 +05:30
skrydal
a026c84691
feat: qualifiedName support + populating glue ARN ( #5952 )
2022-09-15 21:15:03 -07:00
Harshal Sheth
a0f59825ec
docs(airflow) add back auth token info for airflow ( #5960 )
...
Seems this PR https://github.com/datahub-project/datahub/pull/5703 was accidentally reverted.
2022-09-15 17:02:28 -05:00
Shirshanka Das
f70bb201ce
fix(build): fix preflight script for m1 for lib postgresql ( #5957 )
2022-09-15 13:21:02 -07:00
Shirshanka Das
8bbe3f61f7
fix(docs): fix loom embed ( #5956 )
2022-09-15 13:19:46 -07:00
GYUHOON KIM
4986eac8d2
docs: datahub_conn_id => conn_id in Airflow Integration ( #5920 )
...
Co-authored-by: 김규훈[W Stat] <gyuhoon.kim@webtoonscorp.com>
2022-09-15 10:21:03 -07:00
Mayuri Nehate
2558129391
refactor(snowflake): move snowflake-beta to certified snowflake source ( #5923 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:53:54 -07:00
Mugdha Hardikar
93681d7a71
feat(ingest): delta-lake - support delta tables from minio ( #5758 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-15 09:51:14 -07:00
Harshal Sheth
7c00adc0ef
docs(airflow): show that rest host points at gms ( #5913 )
2022-09-15 09:25:45 -07:00
Harshal Sheth
66985335d0
fix(ingest): add trailing newline to ssh keys ( #5947 )
2022-09-14 20:53:26 -07:00
Shirshanka Das
14873775bd
feat(docs): lookml - add video for ui ingestion, remove secret step until we support ssh-keys as secrets ( #5948 )
2022-09-14 20:16:49 -07:00
Chris Collins
a3af5106e8
fix(ui) Make LookML deploy key a textarea and format key ( #5946 )
...
Co-authored-by: Chris Collins <chriscollins@Chriss-MBP-2.lan>
2022-09-14 17:29:46 -07:00
Harshal Sheth
9384a52b23
feat(ingest): skip ssh known_hosts verification for git clone ( #5945 )
2022-09-14 16:43:21 -07:00
Ravindra Lanka
cf2f59f85f
fix(ingest): Fix snowflake usage stateful ingestion backward compatibility check. ( #5943 )
2022-09-14 13:25:50 -07:00
Chris Collins
34ed0af053
feat(ingestion-ui) Add LookML form to managed ingestion UI ( #5939 )
2022-09-14 16:05:37 -04:00
skrydal
f61a040555
feat(ingestion) Add more info to glue entities ( #5874 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-14 12:25:09 -07:00
Pedro Silva
43edc3b656
feat(docs) Adds guide on how to use personal access tokens ( #5873 )
...
* feat(docs) Adds guide on how to use personal access tokens
* Removes local images and uses static-asset repository
2022-09-14 13:13:14 -05:00
Harshal Sheth
e23523a781
fix(ingest): fix type annotations on some pydantic fields ( #5795 )
2022-09-14 11:05:31 -07:00
John Joyce
38f111117c
refactor(gms): Adding Java Entity Services ( #5931 )
2022-09-14 10:19:13 -07:00
Mayuri Nehate
8ead62dae5
fix(transformer): fix invalid lastModified.actor entry in transformers ( #5906 )
2022-09-14 09:59:17 -07:00
Harshal Sheth
a1e1d2fd0a
feat(ingest): add ConfigEnum type ( #5734 )
2022-09-14 09:57:42 -07:00
Justin Marozas
133b5e0348
feat(search): Add support for Elasticsearch object field type ( #5891 )
...
* object-type searchable field WIP
* elasticsearch object-type field WIP
* talk about the object fieldType in the docs
2022-09-14 11:50:19 -05:00
Shirshanka Das
c5f8fc1907
fix(docs): lookml - clean up links ( #5938 )
2022-09-14 09:43:59 -07:00
Ravindra Lanka
ee68f09624
feat(ingestion): Refactor standard state-handling tasks into a common handler that are common across all stateful ingestion sources. ( #5766 )
2022-09-14 09:30:42 -07:00
Harshal Sheth
8f5b773025
fix(airflow): prioritize conn_type over id-based type inference ( #5911 )
2022-09-14 18:30:03 +02:00
firas omrane
c606abdb40
fix(docker) Add platform to docker-compose command ( #5683 )
2022-09-14 17:56:42 +05:30
Aseem Bansal
f669ba6f14
feat(elastic-setup): more verbose logging ( #5937 )
2022-09-14 17:35:26 +05:30
Harshal Sheth
d5d8a38caa
fix(ingest): move git requirement into lookml deps ( #5932 )
2022-09-14 14:47:07 +05:30
Aseem Bansal
ff04e0e0bd
fix(ci): process older issues first ( #5926 )
2022-09-14 14:46:41 +05:30
