7127 Commits

Author SHA1 Message Date
RyanHolstien
a10a4ac62c
fix(dataPlatformInstance): add data platform instance to entity registry (#4537) 2022-03-30 22:55:31 -07:00
mayurinehate
467ea7917c
fix(kafka-connect): fix lineage for postgres-like 3-level hierarchy d… (#4375)
* fix(kafka-connect): fix lineage for postgres-like 3-level hierarchy dialects in jdbc source connnector

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-03-30 20:59:02 -07:00
RyanHolstien
d311067384
fix(cli): delete - handle case insensitive entity types (#4492) 2022-03-30 20:37:14 -07:00
Sergio Gómez Villamor
bdf17f551e
feat(ingest): glue - adds platform instance capability (#4130) 2022-03-30 18:50:26 -07:00
mohdsiddique
57002c766d
feat(stateful dbt): add stateful ingestion capability in dbt source (#4456)
* feat(stateful dbt): add stateful ingestion capability in dbt source

Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-03-30 18:09:02 -07:00
Pedro Silva
306ddff13e
feat(platform): adds side-effect report for rollbacks (#4482)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-03-30 17:33:35 -07:00
Maggie Hays
0be0689093
docs: Ingestion Source Docs Template (#4275)
* testing img.shield for status

* update to hyperlink

* changing link format

* adding status options

* updating prerequisities and quickstart

* update to ingestion docs

* updating template with collapse details

* adding linebreak between pip install commands

* Removed incomplete sentence

* typo fix

* pushing current changes

* testing logos in markdown table

* markdown table fix

* markdown table fix

* adding in additional logos

* transposing markdown table

* settling on final table format

* adding commented-out source template to sidebar.js

* moving reference sidebar and adding trailing comma

* fixing docs build
2022-03-30 15:36:39 -07:00
mayurinehate
9ba36100ab
feat(tableau): emit lineage edge from embedded datasource to upstream… (#4470)
* feat(tableau): emit lineage edge from embedded datasource to upstream published datasource

Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-03-30 15:32:15 -07:00
Sunil Patil
36e9552d61
feat(ingestion): Support pluggable Schema Registry for Kafka Source (#4535)
* Support for pluggable schema registry for the Kafka source.
Co-authored-by: Sunil Patil <spatil@twilio.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-03-30 13:20:23 -07:00
Ebu (えぶ)
dad6a53890
feat(ui): Add new loading pattern logo (#4369) 2022-03-30 11:42:13 -07:00
leifker
9cc6d8af32
feat(integration): protobuf - additional annotations and features (#4493) 2022-03-30 10:50:13 -07:00
zhoxie-cisco
14df3cf165
perf(docker): datahub-gms - add jetty configuration xml (#4435)
* Add jetty cofig xml to change requestHeaderSize.

* Add jetty config in docker-compose.dev.yml

Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-03-30 10:10:47 -07:00
Aseem Bansal
5d9c146bf7
doc: add example of profiling in default example (#4532) 2022-03-30 10:07:32 -07:00
Aseem Bansal
4db91e440d
doc: clarify CLI releases (#4533) 2022-03-30 10:07:09 -07:00
David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example (#4528) 2022-03-30 09:10:23 -07:00
David Haglund
9881d75696
fix(docs): Minor fixes to pip install commands (#4315)
Add closing quote where it was missing.
2022-03-30 07:29:09 -07:00
Aseem Bansal
294227e398
doc: update docker docs for mentioning Python CLI (#4521) 2022-03-29 20:48:23 -07:00
Kevin Hu
1bad3c7bc9
fix(ingest): mssql - support database_alias (#4523) 2022-03-29 20:47:43 -07:00
Arun Vasudevan
c79c778270
feat(ingest): kafka-connect - support mapping for multiple DB instances (#4501) 2022-03-29 20:46:07 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
John Joyce
0e4e32a317
Adding has container (#4526) 2022-03-29 18:26:28 -07:00
cuong-pham
4833452192
fix(ingest): make tableau ingestion more resilient to error (#4494) 2022-03-29 17:44:50 -07:00
Aseem Bansal
a137631cb5
doc(ingestion): add examples of running in docker and Kubernetes (#4519) 2022-03-29 17:43:49 -07:00
Andres Lowrie
8564d45404
docs(metadata-ingestion): callout props in para (#4485) 2022-03-29 17:43:12 -07:00
RyanHolstien
b843014c5e
Oss/urn validation (#4511) 2022-03-29 16:44:58 -07:00
Dexter Lee
70ad4b2cd6
feat(policy): Add tooltip and view button (#4525)
* Add tooltip and view

* Add links to details page
2022-03-29 14:45:44 -07:00
mayurinehate
e2723bc981
feat(assertion): update python example, assertion entity doc (#4507) 2022-03-29 13:25:51 -07:00
Kevin Hu
838982abb6
feat(ingestion): detect and disable telemetry in CI (#4513) 2022-03-29 13:21:53 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Ravindra Lanka
4f7d0f3281
Fix: Snowflake Table to View lineage (#4520) 2022-03-29 09:42:43 -07:00
Aseem Bansal
d30b6e1465
feat(ingest): Add config to improve user exp for initial ingestion and fix docs (#4510)
* feat(snowflake): change defaults to improve user experience for initial ingestion + documentation
2022-03-29 07:15:36 -07:00
Aseem Bansal
f36cf69360
feat(ingest): option for number of workunits in preview (#4517)
* feat(ingest): option for number of workunits in preview + documentation update
2022-03-29 07:10:22 -07:00
Tamas Nemeth
4358d8fb01
feat(ingest): athena - set Athena location as upstream (#4503) 2022-03-29 07:06:48 -07:00
MugdhaHardikar-GSLab
37aedfc87c
feat(s3): add s3 source (#4490)
* feat(data-lake): add containers and folder level dataset support

* docs(data-lake): Update readme for data lake

* doc(data-lake): fix examples, update doc

* lint fix

* feat(s3): add s3 source, restore old data-lake source

Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-03-29 11:52:57 +02:00
Xu Wang
34b36c0fe1
feat(notebook): graphqul related logic change for notebook (#4468)
* feat(notebook) graphqul related logic change for notebook

* resolve pr comments

1. add dataPlatformInstance aspect support
2. make NotebookCell required

* resolve :datahub-graphql-core:checkstyleMain failure

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-28 13:52:41 -07:00
Aseem Bansal
13cc9ccfe2
doc: update instructions for updating DataHub on quickstart (#4401) 2022-03-28 09:37:37 -07:00
Shubham Thakre
31c1fe92e1
SecretBuilderModal -> name field validation updated (#4500) 2022-03-28 08:29:47 -07:00
Aseem Bansal
6b04dff913
docs: add example of database and schema allow/deny patterns (#4505) 2022-03-28 13:06:40 +02:00
Aseem Bansal
a702265824
fix(snowflake): allow/deny patterns (#4504)
* fix(snowflake): allow/deny patterns

* fix lint failures

* fix linting
2022-03-28 12:48:00 +02:00
Shirshanka Das
a69eac8247
feat(ingest): dbt,looker,sql_common,kafka - moving sources to produce display names and subtypes more consistently (#4496) 2022-03-27 18:49:26 -05:00
Aseem Bansal
ab36ac0f12
feat(snowflake): stop querying for usage data when no mix/max dates (#4480) 2022-03-25 11:02:38 +01:00
Aseem Bansal
7f1a1a3dcf
fix(snowflake-usage): do not ingest for stage as a dataaset (#4483) 2022-03-25 10:59:37 +01:00
Shirshanka Das
f18f453200
moving to dockerhub for actions container (#4497) 2022-03-24 22:24:07 -07:00
darapuk
c9b40ec1ca
fix: Update GroupProfile to read from properties over deprecated info aspect (#4475) 2022-03-24 12:46:58 -07:00
Aseem Bansal
1a20f76225
fix(ingestion): pin Jinja2 to version < 3.1.0 (#4489) 2022-03-24 12:26:38 -07:00
Aseem Bansal
f770ed5fea
fix(ingestion): stop CLI build failures (#4484) 2022-03-24 17:03:56 +01:00
Aseem Bansal
9596e73706
doc: add caveats to snowflake doc (#4467) 2022-03-24 16:24:38 +01:00
Aseem Bansal
611cc2ddb5
fix(snowflake): don't recommend accountadmin role for snowflake (#4481) 2022-03-24 07:29:52 -07:00
Aseem Bansal
dcd4af51bb
fix: change log level to debug (#4479) 2022-03-24 07:27:25 -07:00
Dexter Lee
a1ebc6be86
Add recent searches filtering (#4476) 2022-03-23 16:24:19 -07:00