7127 Commits

Author SHA1 Message Date
Harshal Sheth
d4bf6ce3fc
feat(docs): fast reload command for markdown edits (#6539) 2022-11-29 00:52:16 -05:00
Harshal Sheth
7f93ee5f13
fix(ingest): set DataProcessInstance created ts to start time (#6566) 2022-11-28 20:26:40 -08:00
John Joyce
d1b12243bb
feat(models): Adding 'created', 'lastModified' timestamp to Dataset, Container, Dashboard, Chart (#6527) 2022-11-28 18:18:34 -08:00
John Joyce
7136dd5ae6
feat(platform): Support @Searchable + @Relationship Annotations for Timeseries Aspects (#6455) 2022-11-28 18:17:40 -08:00
Mert Tunç
536218cb4b
docs(ingest/kafka): add field descriptions of kafka-related configs to pydantic (#6559) 2022-11-28 17:37:04 -05:00
Harshal Sheth
880d04246d
fix(ingest): handle docker-compose version v prefix (#6561) 2022-11-28 16:55:15 -05:00
david-leifker
d7faaa00c0
fix(contrib): Update base python image for es7-upgrade (#6562) 2022-11-28 15:51:03 -06:00
John Joyce
6eb63c2aab
feat(ui): Add Test Connection Support for BigQuery ingestion source (#6543) 2022-11-28 10:29:46 -08:00
mohdsiddique
4d76b415c0
fix(apache-ranger): rome dependency (#6560)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-11-28 09:21:06 -08:00
Tamas Nemeth
28a61bc9f9
fix(ingest): bigquery - setting partition id for profiling data (#6558) 2022-11-28 18:18:51 +01:00
Teppo Naakka
87312f85f5
feat(ingest): powerbi - scan all accessible workspaces (#6441) 2022-11-28 17:17:15 +01:00
Tamas Nemeth
278c38cae4
fix(ingest): bigquery - Fixing querying non-date partition columns in profiling (#6554) 2022-11-26 18:48:33 +01:00
Tamas Nemeth
d424edde41
fix(ingest): bigquery - missing sqlalchemy dep and row count fix (#6553) 2022-11-25 22:33:14 +01:00
Mayuri Nehate
7a8e36d57d
feat(ingest): refactor classification mixin interface, support new info types (#6545) 2022-11-25 18:48:42 +05:30
Pedro Silva
5fd5866a03
feat(upgrade): Make restore from backup logic generic (#6536) 2022-11-24 21:49:24 +05:30
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var (#6546) 2022-11-24 21:34:53 +05:30
Mayuri Nehate
a12f5daaf4
style(ingest): fix lint checks for superset (#6548) 2022-11-24 21:33:57 +05:30
Chris Collins
6255181169
fix(ui) Display duplicate nodes in lineage viz (#6526) 2022-11-23 16:14:21 -08:00
Chris Collins
cc832124df
fix(ui) Wrap schema field descriptions to allow read more/less always (#6541)
Co-authored-by: Chris Collins <chriscollins@Chriss-MacBook-Pro-2.local>
2022-11-23 16:01:40 -08:00
Harshal Sheth
ce3f663a57
build(ingest): support flake8 6.0.0 (#6540) 2022-11-23 17:40:55 -05:00
Phong Vu
0eb54c6387
fix(ingest): handle groupby custom label case (#6456)
fix(ingest): handle groupby custom label case

Co-authored-by: Phong Vu <phongvt@meeyland.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-11-23 14:12:18 -08:00
John Joyce
73671de7e7
refactor(recommendations): Filtering for specific entity types in recommendations (#6538) 2022-11-23 13:33:35 -08:00
John Joyce
a400eb0d52
refactor(ui): Adding apollo caching to manage domains page. (#6494) 2022-11-23 12:31:31 -08:00
Harshal Sheth
ebd685d40d
fix(ingest/airflow): respect enabled flag in airflow plugin (#6528) 2022-11-23 11:52:05 -08:00
Harshal Sheth
4db51b4c4f
feat(ingest): disable stateful_ingestion failsafe by default (#6537) 2022-11-23 11:51:56 -08:00
Tamas Nemeth
8d525d67a9
fix(ingest): kafka - properly picking doc from union type (#6472) 2022-11-23 20:42:21 +01:00
Pedro Silva
055196c9d4
fix(security): Bump ranger plugin commons dependency (#6535) 2022-11-23 17:18:27 +00:00
Aseem Bansal
0862a22632
fix(build): remove warnings in github actions (#6512) 2022-11-23 16:43:23 +05:30
Mayuri Nehate
37e95c9f91
fix(ingest): fix trino properties and tests (#6518) 2022-11-23 01:10:07 -05:00
Bumsoo Kim
e41f42b9db
fix(ingest): fix typo in urn utilities (#6520)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-11-23 01:05:32 -05:00
Mayuri Nehate
22847a987a
feat(ingest): automated term classification for snowflake (#6376) 2022-11-23 00:43:30 -05:00
Harshal Sheth
2b9b123a85
fix(ingest): make kafka emit callback optional (#6525) 2022-11-22 16:57:14 -05:00
Ankit keshari
7f71b2578b
feat(ui): Add sorting method to fieldpath column of schema tab (#6510)
Co-authored-by: John Joyce <john@acryl.io>
2022-11-22 13:43:56 -08:00
Parham Ghazanfari
269342bec0
feat(kafka-setup): Added support for MSK IAM authentication. (#6435) 2022-11-22 15:37:24 -06:00
Parham Ghazanfari
497c5eee74
feat(datahub-upgrade): Added msk IAM auth as a build dependency. (#6439) 2022-11-22 15:36:53 -06:00
Chris Collins
7b13c28391
fix(ui) Fix roles not always displaying on page load (#6524) 2022-11-22 15:01:48 -06:00
Mayuri Nehate
a1b3929b38
fix(ingest): fix typo in unique count profiling (#6517) 2022-11-22 14:23:01 -05:00
Mayuri Nehate
e085a9e7dc
feat(ingest): add config for ingesting delta table without files (#6403)
Closes undefined
2022-11-22 14:15:40 -05:00
Harshal Sheth
2cb1e6576d
fix(ingest): add alias for bigquery-beta (#6521) 2022-11-22 14:15:20 -05:00
dependabot[bot]
648ce31377
build(deps): bump loader-utils from 2.0.0 to 2.0.4 in /docs-website (#6452) 2022-11-23 00:37:08 +05:30
RyanHolstien
848574dbff
fix(platform): patch for entity creation, honor async flag on request (#6504) 2022-11-22 11:05:09 -08:00
Harshal Sheth
1229c1f60d
feat(airflow): support kafka sinks in the airflow plugin (#6508) 2022-11-22 10:49:00 -08:00
Harshal Sheth
3fdaf13f2c
feat(ingest/csv-enrich): handle BOM character (#6509)
This has come up a number of times e.g. https://datahubspace.slack.com/archives/C029A3M079U/p1669000226732159?thread_ts=1669000226.732159&amp;cid=C029A3M079U
2022-11-22 12:53:34 -05:00
Harshal Sheth
74cc88f2df
fix(ingest): correctly handle transformer patch semantics (#6505) 2022-11-22 09:29:57 -08:00
syedzoherer
5010e0cf69
Added I AM auth for Opensearch (#6370)
* Added I AM auth for Opensearch

* Code refactor and removed default Region for AWS cred.

* Added missing opensearch region exception

* Update RestHighLevelClientFactory.java

* Fixed stylecheck

* Update RestHighLevelClientFactory.java

* Update RestHighLevelClientFactory.java

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
John Joyce
86798ec618
feat(ui): Introducing Share Button on Entity Pages (#6450) 2022-11-22 08:48:03 -08:00
Aseem Bansal
7e326b7d03
fix(docs): add missing docs for 0.9.1 (#6515) 2022-11-22 20:41:29 +05:30
Harshal Sheth
10a31b1aa0
fix(ingest/snowflake): fix lineage allow/deny pattern typo (#6506) 2022-11-22 07:09:48 +01:00
Harshal Sheth
490097e532
fix(ingest): remove redundant types (#6486)
Possible since https://github.com/python/typeshed/pull/9220 was merged.

Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2022-11-21 23:08:05 +01:00
Harshal Sheth
fdb74b0524
fix(tableau): extra defensive error-handling (#6503) 2022-11-21 14:40:18 -05:00