845 Commits

Author SHA1 Message Date
Aseem Bansal
308dbf2b1a
fix(ingest): superset - fix connection inference for redshift (#3944) 2022-01-27 22:58:34 -08:00
RyanHolstien
f6cbeba515
fix(cli): add missing classes to typed aspect map (#4000)
Co-authored-by: Ryan Holstien <ryan@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-27 22:55:40 -08:00
Nick Wu
149d2fa3d0
docs(ingest): add missing back tick for metadata-ingestion/README.md (#4003) 2022-01-27 22:51:48 -08:00
John Joyce
27c543a3aa
feat(domains): UI for Asset Domains (p2) (#3995) 2022-01-27 22:02:41 -08:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources (#3996) 2022-01-27 15:31:25 -08:00
dipeshmaurya
ad0019cb22
fix(docs): typo in bigquery_to_datahub.yml (#3988) 2022-01-27 15:01:59 -08:00
John Joyce
282851eeed
feat(domains): Adding backend for Asset Domains (p1) (#3952) 2022-01-27 13:07:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) (#3975) 2022-01-27 10:33:12 -08:00
John Joyce
9366a47f88
fix(quickstart): Assign correct mysql-setup container for M1 and remove "head" default version. (#3987)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-26 18:15:54 -08:00
John Joyce
cf38b61a7f
feat(ingest): looker - optional external_base_url config for chart and dashboard urls (#3985)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-26 15:06:34 -08:00
Kevin Hu
62f7d05557
feat(ingest): data-lake - support for Avro files (#3913) 2022-01-26 10:29:00 -08:00
Harshal Sheth
e6060c03be
fix(ingest): don't dump variables for config errors (#3974) 2022-01-25 22:30:18 -08:00
Harshal Sheth
ea5a66bbc5
fix(ingest): serialization - tighten conditions for restli json transformation (#3973) 2022-01-25 21:56:04 -08:00
Tamas Nemeth
cec541d827
fix(ci): ingestion - Restrict python to <=3.9.9 due to upstream looker sdk issues (#3961)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-25 19:11:53 -08:00
Aseem Bansal
b6a340d46b
fix(example): fix typo (#3907) 2022-01-25 19:06:58 -08:00
Harshal Sheth
5168f0a50e
refactor(ingestion): remove duplicate aspect type (#3972) 2022-01-25 19:05:14 -08:00
iasoon
5dac30c93e
fix(ingestion): match default username for Azure OIDC and Azure ingestion source (#3926) 2022-01-25 18:57:18 -08:00
John Joyce
0da1a6b53d
fix(graphQL): Fixing set ordering in batchGet of entities (#3950) 2022-01-23 11:24:09 -08:00
Ravindra Lanka
715a2e5f8e
feat(ingest): snowflake, glue - add support for lineage to s3 (#3946) 2022-01-21 17:19:21 -08:00
Ravindra Lanka
7eda2bf144
fix(ingest): snowflake_usage - emit usage workunits when include_operational_stats is enabled. (#3949) 2022-01-21 17:16:03 -08:00
John Joyce
8b716ad2b4
Adding SampleHiveDataset bootstrap metadata (#3947) 2022-01-21 14:39:51 -08:00
Aseem Bansal
6c3441ccdc
fix(docs): fix openapi docs (#3940) 2022-01-21 07:55:50 -08:00
Aseem Bansal
f3d01009df
docs(ingest): fix command for running quick tests (#3942) 2022-01-21 07:40:31 -08:00
RyanHolstien
85ff0f3630
fix(ingest): telemetry - soft fail (#3934) 2022-01-21 07:35:42 -08:00
Aseem Bansal
4aa14214d9
feat(ingest): rest-emitter: make test_connection more robust (#3919)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-19 18:51:47 -08:00
Aseem Bansal
22efdec2ab
Revert "fix(glossary): owner should be optional as per docs (#3858)" (#3910)
This reverts commit d59574f671f8599933f5b6072d2a65d5e4f3b341.
2022-01-18 09:33:05 -08:00
Kevin Hu
d4075b972c
docs(ingest): data lake - describe path-spec configuration (#3905) 2022-01-17 15:41:02 -08:00
Hoang-Vu Le
d5ef7cefa2
fix(ingest): nifi - replace hardcode password with config variable (#3902)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-17 15:36:37 -08:00
Kevin Hu
9e30b42638
feat(ingest): data lake - support for profiling data lake assets (#3656) 2022-01-17 15:01:23 -08:00
Jiwei
f804184884
docs(elasticsearch): fix typo in config example (#3901) 2022-01-17 14:56:17 -08:00
Aseem Bansal
400e0fe838
feat(ingest): kafka - support schema references (#3862) 2022-01-17 14:29:54 -08:00
Ravindra Lanka
1efe04f88a
feat(ingest): glue - support for nested structs (#3895) 2022-01-17 14:21:53 -08:00
Aseem Bansal
d59574f671
fix(glossary): owner should be optional as per docs (#3858) 2022-01-17 08:40:16 -08:00
Swaroop Jagadish
7d986ec880
fix(ingest): populate system metadata for all metadata events (mcp, mcpw) (#3900) 2022-01-16 12:03:38 -08:00
Ravindra Lanka
a44b48a6b8
feat(ingest): elasticsearch - add Elasticsearch Source (#3893)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-14 13:10:12 -08:00
Tamas Nemeth
2daa06a58f
fix(ingest): redshift - mapping for spectrum external array types (#3890) 2022-01-14 12:23:57 -08:00
Tamas Nemeth
e95446be1c
fix(ingest): sqlparser - Not lowercasing looker source's special table name (#3891)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-14 12:22:17 -08:00
varunbharill
cc52e3e759
fix(ingest): bigquery - update dependencies for module. (#3874)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-13 22:12:11 -08:00
iasoon
de50a34201
feat(ingest): dbt - support spark sql types (#3880) 2022-01-13 12:37:29 -08:00
iasoon
285aa1b9ac
docs(ingest): azure-ad - specify required permission type (#3886) 2022-01-13 12:30:16 -08:00
Kevin Hu
88b1e8c426
feat(ingest): ingestion-specific telemetry (#3881) 2022-01-12 21:47:42 -08:00
Aseem Bansal
7498f4bf54
doc(kafka): add permissions required for confluent cloud (#3850) 2022-01-12 14:50:58 -08:00
iasoon
988baeb467
feat(ingest): metabase - allow configuring how database engines get mapped to platforms (#3869) 2022-01-12 00:52:55 -08:00
Kevin Hu
5f701ebb3c
fix(cli): disable telemetry in CLI tests (#3877) 2022-01-12 00:25:42 -08:00
iasoon
130d5ff635
docs(ingest): azure-ad - correct default value for username attr (#3861) 2022-01-11 19:37:28 -08:00
Rickard Cardell
2f7e49b399
feat(ingest): datahub-rest - Make datahub-rest client more robust by configurable retries. (#3826) (#3860) 2022-01-11 19:35:06 -08:00
iasoon
6f7c2120fd
fix(ingest): metabase - fix crashes on missing values (#3859) 2022-01-10 15:40:52 -08:00
Harshal Sheth
0171735ae0
feat(build): include correct version in metadata-ingestion docker image (#3857) 2022-01-10 15:38:19 -08:00
Aditya Radhakrishnan
c3e98645a2
feat(ingest): operational stats - show last updated for sql usage sources (#3845) 2022-01-07 17:27:09 -08:00
iasoon
0a6ec819cf
fix(ingest): dbt - handle database =None for executors like spark (#3851) 2022-01-07 15:50:29 -08:00