5512 Commits

Author SHA1 Message Date
David Haglund
9881d75696
fix(docs): Minor fixes to pip install commands (#4315)
Add closing quote where it was missing.
2022-03-30 07:29:09 -07:00
Aseem Bansal
294227e398
doc: update docker docs for mentioning Python CLI (#4521) 2022-03-29 20:48:23 -07:00
Kevin Hu
1bad3c7bc9
fix(ingest): mssql - support database_alias (#4523) 2022-03-29 20:47:43 -07:00
Arun Vasudevan
c79c778270
feat(ingest): kafka-connect - support mapping for multiple DB instances (#4501) 2022-03-29 20:46:07 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
John Joyce
0e4e32a317
Adding has container (#4526) 2022-03-29 18:26:28 -07:00
cuong-pham
4833452192
fix(ingest): make tableau ingestion more resilient to error (#4494) 2022-03-29 17:44:50 -07:00
Aseem Bansal
a137631cb5
doc(ingestion): add examples of running in docker and Kubernetes (#4519) 2022-03-29 17:43:49 -07:00
Andres Lowrie
8564d45404
docs(metadata-ingestion): callout props in para (#4485) 2022-03-29 17:43:12 -07:00
RyanHolstien
b843014c5e
Oss/urn validation (#4511) 2022-03-29 16:44:58 -07:00
Dexter Lee
70ad4b2cd6
feat(policy): Add tooltip and view button (#4525)
* Add tooltip and view

* Add links to details page
2022-03-29 14:45:44 -07:00
mayurinehate
e2723bc981
feat(assertion): update python example, assertion entity doc (#4507) 2022-03-29 13:25:51 -07:00
Kevin Hu
838982abb6
feat(ingestion): detect and disable telemetry in CI (#4513) 2022-03-29 13:21:53 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies (#4516)
* Add domain based policy and view based policy

* Add new files

* Fix issue

* Fix comment on markdown

* Fix to John's comments

* Update policies.md

* Remove comments

* Fix to John's comments

* Fix policy details page

* Add back notebook privileges

* Fix graphql

Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Ravindra Lanka
4f7d0f3281
Fix: Snowflake Table to View lineage (#4520) 2022-03-29 09:42:43 -07:00
Aseem Bansal
d30b6e1465
feat(ingest): Add config to improve user exp for initial ingestion and fix docs (#4510)
* feat(snowflake): change defaults to improve user experience for initial ingestion + documentation
2022-03-29 07:15:36 -07:00
Aseem Bansal
f36cf69360
feat(ingest): option for number of workunits in preview (#4517)
* feat(ingest): option for number of workunits in preview + documentation update
2022-03-29 07:10:22 -07:00
Tamas Nemeth
4358d8fb01
feat(ingest): athena - set Athena location as upstream (#4503) 2022-03-29 07:06:48 -07:00
MugdhaHardikar-GSLab
37aedfc87c
feat(s3): add s3 source (#4490)
* feat(data-lake): add containers and folder level dataset support

* docs(data-lake): Update readme for data lake

* doc(data-lake): fix examples, update doc

* lint fix

* feat(s3): add s3 source, restore old data-lake source

Co-authored-by: Mayuri N <mayuri.nehate@gslab.com>
2022-03-29 11:52:57 +02:00
Xu Wang
34b36c0fe1
feat(notebook): graphqul related logic change for notebook (#4468)
* feat(notebook) graphqul related logic change for notebook

* resolve pr comments

1. add dataPlatformInstance aspect support
2. make NotebookCell required

* resolve :datahub-graphql-core:checkstyleMain failure

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-28 13:52:41 -07:00
Aseem Bansal
13cc9ccfe2
doc: update instructions for updating DataHub on quickstart (#4401) 2022-03-28 09:37:37 -07:00
Shubham Thakre
31c1fe92e1
SecretBuilderModal -> name field validation updated (#4500) 2022-03-28 08:29:47 -07:00
Aseem Bansal
6b04dff913
docs: add example of database and schema allow/deny patterns (#4505) 2022-03-28 13:06:40 +02:00
Aseem Bansal
a702265824
fix(snowflake): allow/deny patterns (#4504)
* fix(snowflake): allow/deny patterns

* fix lint failures

* fix linting
2022-03-28 12:48:00 +02:00
Shirshanka Das
a69eac8247
feat(ingest): dbt,looker,sql_common,kafka - moving sources to produce display names and subtypes more consistently (#4496) 2022-03-27 18:49:26 -05:00
Aseem Bansal
ab36ac0f12
feat(snowflake): stop querying for usage data when no mix/max dates (#4480) 2022-03-25 11:02:38 +01:00
Aseem Bansal
7f1a1a3dcf
fix(snowflake-usage): do not ingest for stage as a dataaset (#4483) 2022-03-25 10:59:37 +01:00
Shirshanka Das
f18f453200
moving to dockerhub for actions container (#4497) 2022-03-24 22:24:07 -07:00
darapuk
c9b40ec1ca
fix: Update GroupProfile to read from properties over deprecated info aspect (#4475) 2022-03-24 12:46:58 -07:00
Aseem Bansal
1a20f76225
fix(ingestion): pin Jinja2 to version < 3.1.0 (#4489) 2022-03-24 12:26:38 -07:00
Aseem Bansal
f770ed5fea
fix(ingestion): stop CLI build failures (#4484) 2022-03-24 17:03:56 +01:00
Aseem Bansal
9596e73706
doc: add caveats to snowflake doc (#4467) 2022-03-24 16:24:38 +01:00
Aseem Bansal
611cc2ddb5
fix(snowflake): don't recommend accountadmin role for snowflake (#4481) 2022-03-24 07:29:52 -07:00
Aseem Bansal
dcd4af51bb
fix: change log level to debug (#4479) 2022-03-24 07:27:25 -07:00
Dexter Lee
a1ebc6be86
Add recent searches filtering (#4476) 2022-03-23 16:24:19 -07:00
Xu Wang
d04092e634
feat(ingest): add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn (#4469)
* feat: add python utility classes for NotebookUrn, CorpuserUrn and CorpGroupUrn

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-03-23 16:07:57 -07:00
Shubham Thakre
fd3723ac7e
Feature/modal-validation-and-UI-fixes-updates (#4439) 2022-03-23 13:35:45 -07:00
Kevin Hu
a7b0275b86
feat(ingest): simplify event IDs for function invocations (#4398)
* Simplify function call events
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>

Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-03-23 12:52:29 -07:00
Sergio Gómez Villamor
9fbb521bfe
chore: acryl-data 0.6.12 (#4474) 2022-03-23 10:24:48 -07:00
Tamas Nemeth
5c8017789a
fix(redshift) Properly handling database alias in redshift usage and redshift lineage generation (#4473)
* Fix database-alias in redshift usage and redshift lineage generation
2022-03-23 16:01:14 +01:00
Gabe Lyons
4c1d04910b
enabling ml tabs (#4471) 2022-03-23 07:12:22 -07:00
Ethan Claassen
4476356ec8
fix: java dependency vulnerabilities (#4460)
* fix: java dependency vulnerabilities

* Upgrade org.hibernate:hibernate-validator (PLT-2)
2022-03-22 14:21:55 -07:00
Tamas Nemeth
2013d5ddbd
feat(ingest) data-lake: Add s3 properties metadata when ingesting s3 files (#4453)
* Add s3 porperties for data lake ingestion
2022-03-22 10:31:18 -07:00
Aseem Bansal
861015d57a
fix: change for repository change (#4464) 2022-03-22 09:21:09 -07:00
Aseem Bansal
15d5e418fb
fix(snowflake-usage): add more error handling (#4466) 2022-03-22 08:10:03 -07:00
Fernanda de Camargo
e290e6e07e
fix(ingest): add fix to tableau connector when table has None fields (#4445)
Co-authored-by: Ludmila Ferreira <ludmila.ferreira@elo7.com>
2022-03-22 14:59:18 +01:00
mayurinehate
885cf26828
docs(hive): update recipe with example to specify kerberos auth (#4457) 2022-03-22 13:38:21 +01:00
pedro-iatzky
6a6d744667
fix(ingest): bigquery - fix ingestion of external tables (#4313) 2022-03-22 13:35:41 +01:00
Gabe Lyons
c585f291e8
adding final transport options (#4462) 2022-03-22 10:03:11 +01:00
Xu Wang
277ed43109
feat(notebook): add data models for Notebook entity (#4223)
* add Notebook data model

* resolve PR comments

1. add glossaryTerms aspect
2. make text in TextCell not searchable

* add dataPlatformInstance aspect and make notebookTool non-searchable

* make data doc cell title optional

* mark Notebook related aspects and entity as in BETA version

* add comments in entry-registry.yml for notebook entity

Co-authored-by: Xu Wang <xu.wang@grandrounds.com>
2022-03-21 14:10:52 -07:00