3975 Commits

Author SHA1 Message Date
Sergio Gómez Villamor
9e28423c6d
feat(ingest): add optional config for ownership type in ownership transformers (#3159)
Co-authored-by: Sergio Gómez <sergio.gomez.villamor@adevinta.com>
2021-09-01 22:44:03 -07:00
Remi
75d99690a5
fix(dbt): use_identifiers option and avoid duplicate descriptions (#3179) 2021-09-01 22:08:23 -07:00
Shirshanka Das
88a3523fbb
feat(ingest): Add a business glossary source (#3164) 2021-09-01 15:10:12 -07:00
Gabe Lyons
9ba378f3a0
fix(react): show schema-attached description (#3178) 2021-09-01 13:39:53 -07:00
Dexter Lee
f63d9205e6
feat(airflow): add example docker setup for airflow (#3176) 2021-09-01 11:51:14 -07:00
Chinmay Bhat
b07dc16299
docs(ingestion): updated hive ingestion docs with Databricks recipe (#3170) 2021-08-31 22:30:36 -07:00
Chinmay Bhat
6953af58a6
fix(doc): add use_odbc to mssql doc example (#3171) 2021-08-31 22:01:43 -07:00
Gabe Lyons
9708adb0d6
feat(react): Dataset page refresh + improved homepage, search and browse screens (#3169) 2021-08-31 22:00:56 -07:00
Fredrik Sannholm
1d56446652
feat(ingest): Minor Kafka Connect source improvements (#3148) 2021-08-29 08:33:42 -07:00
Chinmay Bhat
bda881cbf2
feat(ingest): Adding Azure Source integration to ingest users, groups and group memberships (#3161) 2021-08-29 08:32:40 -07:00
Swaroop Jagadish
d1b57927a9
fix(frontend): replacing broken link for default avatar (#3156) 2021-08-24 21:40:39 -07:00
Swaroop Jagadish
88afec7f1c
feat(ingest): adding maxSchemaSize to mongodb source (#3153) 2021-08-24 12:15:40 -07:00
Fredrik Sannholm
f73725fdf6
feat(ingestion): bring your own SQL parser (#3110) 2021-08-23 20:21:48 -07:00
Swaroop Jagadish
65943cc190
deps(ingest): upgrade to pick up acryl-pyhive changes (#3145) 2021-08-23 20:18:11 -07:00
Sergio Gómez Villamor
dd7bead514
fix(profiles): prevent NoneType exception when profiling empty datasets (#3144)
Co-authored-by: Sergio Gómez <sergio.gomez.villamor@adevinta.com>
2021-08-23 13:49:51 -07:00
Swaroop Jagadish
72af0c317a
fix(deps): Adding min version to python-dateutil to guard against isoparse failures (#3139) 2021-08-21 18:41:28 -07:00
Swaroop Jagadish
8fe67f7c46
fix(airflow): only emit specific keys for airflow lineage properties (#3137) 2021-08-21 13:35:46 -07:00
John Joyce
81eb4f19bf
feat(sso): Just-In-Time User & Group Provisioning on SSO Login (oidc) (#3082) 2021-08-20 07:42:18 -07:00
Dexter Lee
db3784b407
feat(ingest): Add custom browse paths for kafka sources and remove browse lowercase filter (#3113) 2021-08-19 12:18:42 -07:00
taufiqibrahim
dd1b81b727
feat(ingest): adding redash source (#2918)
Co-authored-by: tibrahim <taufiq.ibrahim@bizzy.co.id>
2021-08-18 12:03:03 -07:00
John Joyce
f40bf1ce19
feat(group ui): Basic group search membership in UI (#3094) 2021-08-16 20:47:18 -07:00
Shikha-Trivedi-Saxo
c9c1ba457e
feat(business-glossary): Glossary term relationship backend (#3012) 2021-08-15 23:05:03 -07:00
Shirshanka Das
39a0081800
fix(ingest): increasing default ingestion REST timeout to 30 seconds (#3095) 2021-08-13 11:05:44 -07:00
Gabe Lyons
c13d83b5c5
fix: fixing key-value after adding version (#3093) 2021-08-12 17:52:58 -07:00
Gabe Lyons
b73d0ebb8b
feat: Adding clarity around qualified unions and removing extra lines for structs (#3091)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2021-08-12 16:25:44 -07:00
John Joyce
8c9c696cdd
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership (#3043) 2021-08-11 18:49:16 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization (#3079) 2021-08-11 15:47:18 -07:00
Kevin Hu
f642d6c0be
fix(ingest): sqlalchemy-snowflake add constraints to make sure we don't pull in 1.2.5 (#3078) 2021-08-11 13:20:01 -07:00
Chinmay Bhat
7abcb45f8c
feat(ingest): add support for jdbc connector to kafka-connect source (#3076) 2021-08-11 08:50:38 -07:00
Kevin Hu
1ad1243371
feat(docs): link to SQL profiling docs from each SQL source (#3071) 2021-08-11 08:00:21 -07:00
Kevin Hu
f4fe4d3c65
feat(docs): add overrides for sidebar labels and S3 guide in sources dropdown (#3068) 2021-08-10 16:46:02 -07:00
Kevin Hu
752626b6c7
fix(ingest): remove tags from bootstrap_mce since that is deprecated (#3069) 2021-08-10 13:32:22 -07:00
Rahul Jain
0e0198f385
feat(ingest): Added support for "add dataset ownership by regex match" (#2990) 2021-08-10 11:03:16 -07:00
Kevin Hu
5891482114
fix(ingest): apply case insensitive regex matching by default (#3067) 2021-08-10 10:35:57 -07:00
aseembansal-gogo
61fcc9b04c
docs(ingest): fix typos (#3066) 2021-08-10 09:44:04 -07:00
Gabe Lyons
4e15c7adbb
feat(cli): datahub init & docs for it (#3062) 2021-08-09 22:30:48 -07:00
Kevin Hu
45247083e3
docs(ingest): link to docs from recipes (#3058) 2021-08-09 10:00:47 -07:00
aseembansal-gogo
9ee091f518
feat(ingest): add transformers to clear dataset ownership, mark status, add browse paths (#2986) 2021-08-09 09:43:46 -07:00
Dexter Lee
0956b79b4d
fix(ingest): stop looker source from unnecessarily filling out owners (#3056) 2021-08-08 23:07:05 -07:00
Dexter Lee
8316316daa
fix(ingest): add default configurable timeout for rest emitter (#3055) 2021-08-08 22:30:55 -07:00
Kevin Hu
8a23d0eac9
fix(docs): update metadata ingestion dev guide (#3039) 2021-08-08 15:28:41 -07:00
Kevin Hu
32b8fc6108
feat(docs): refactor source and sink ingestion docs (#3031) 2021-08-08 13:40:51 -07:00
Gabe Lyons
fef2ea7126
feat(quickstart): linking to slack from quickstart (#3051) 2021-08-06 13:03:59 -07:00
Kevin Hu
40ecd96c7a
feat(ingest): replace and warn against relative imports (#3033) 2021-08-06 10:25:30 -07:00
aseembansal-gogo
ac345e0ade
feat(ingest): add underlying platform for glue (#3035) 2021-08-06 10:19:21 -07:00
Kevin Hu
3d0534be4c
fix(ingest): detect malformed Glue S3 script paths (#3037) 2021-08-05 20:06:32 -07:00
Kevin Hu
f1bea875b2
fix(ingest): replace backticks for lookml (#3038) 2021-08-05 20:05:20 -07:00
Kevin Hu
ec3dfebc24
fix(ingest): add bigquery type mappings (#3040) 2021-08-05 20:03:21 -07:00
Kevin Hu
3d061161d8
fix(ingest): glue import type stubs only for testing (#3032) 2021-08-04 12:43:22 -07:00
Kevin Hu
3701931363
feat(ingest): extract dbt versions into custom properties (#3021) 2021-08-03 12:13:49 -07:00