867 Commits

Author SHA1 Message Date
Sergio Gómez Villamor
070dfa0eaf
fix(config): fixes config key in DataHubAuthorizerFactory (#5371) 2022-07-11 09:57:20 -07:00
neojunjie
5bb7fe3691
feat(ingest) - add audit actor urn to auditStamp (#5264) 2022-07-08 09:21:16 -07:00
Justin Marozas
414252351a
fix(cassandra): fix Cassandra queries used by IngestDataPlatformInstancesStep (#5199) 2022-07-07 22:20:57 -07:00
Chris Collins
68fb0d8f06
feat(schema) Show last observed timestamp in the schema tab (#5348) 2022-07-07 12:31:01 -07:00
Aditya Radhakrishnan
a63d8be538
feat(bootstrap): create abstract class UpgradeStep to abstract away upgrade logic (#5349) 2022-07-06 13:57:05 -07:00
Mayuri Nehate
4b515e022b
feat(ingest): salesforce - add connector (#5104)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Vincent Koc <koconder@users.noreply.github.com>
2022-07-06 10:01:16 -07:00
Pedro Silva
14f769e0d5
fix(tokens) Adds non-admin tests for access tokens (#5174) 2022-07-05 18:57:23 -07:00
John Joyce
b02c7f5952
perf(search): Improve search default performance (#5311) 2022-07-01 10:40:51 -07:00
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 (#5299) 2022-06-30 17:21:12 +05:30
John Joyce
11356e37ba
feat(ui) Adding support for deleting Tags and Domains via the UI (#5280)
* Adding support for deleting tags and domains via the UI

* Fixing tests
2022-06-29 19:41:41 -07:00
Gabe Lyons
7102aec3b1
feat(siblings): index sibling aspects for historical dbt metadata (#5291)
* fixing dbt platform issues

* starting sibling restore index job work

* finish restore indices

* migrating to list urns

* rename constant

* disaster recovery
2022-06-29 19:40:47 -07:00
Gabe Lyons
9e58cd6ff1
fix(Siblings): Have sibling hook use entity client (#5279)
* fixing dbt platform issues

* have sibling hook use entity client over entity service

* switching search service as well

* lint

* more lint

* more specific exceptions
2022-06-29 10:02:45 -07:00
John Joyce
fdee7a787b
feat(GraphQL): Support for Deleting Domains, Tags via GraphQL API (#5272) 2022-06-28 14:57:22 -07:00
Mugdha Hardikar
5455122267
feat(ingest): delta-lake: adding support for delta lake (#5259)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-06-27 16:16:33 -07:00
John Joyce
234d27a642
fix(ui): Support deleting references to glossary terms / nodes, users, assertions, and groups (#5248)
* Adding referential integrity to deletes API

* Updating comments

* Fix build

* fix checkstyle

* Fixing Delete Entity utils Test
2022-06-27 14:31:40 -07:00
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
Gabe Lyons
baf3f3f33c
feat(dbt): add sibling association logic to associate dbt elements with their target systems (#5190) 2022-06-22 08:31:18 -07:00
RyanHolstien
ba21efc7dd
feat(bootstrap): add bootstrap step to clear out unknown aspect rows from the database (#5148) 2022-06-21 16:00:16 -07:00
Mert Tunç
e4921ee5d2
fix(gms-app-properties): remove unnecessary space from application.yml (#5216) 2022-06-21 14:57:20 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature (#5121) 2022-06-21 07:30:40 -07:00
RyanHolstien
46e84026a3
feat(graphql): add metrics capturing for graphql latency (#5200) 2022-06-20 18:24:45 -07:00
Chris Collins
af0e34889c
feat(upgrade) Check version when determining to run RestoreGlossaryIndices step (#5182) 2022-06-16 09:07:56 -07:00
John Joyce
57b983ef1d
feat(boot): Make Glossary Term Upgrade Async (#5164) 2022-06-14 14:24:59 -07:00
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version (#5145) 2022-06-10 09:05:24 +05:30
John Joyce
d05cd085d9
fix(tokens): Fix stale cache problem, reduce cache timeout for access tokens + fix listing owner tokens (#5140) 2022-06-09 15:41:24 -07:00
Aditya Radhakrishnan
fdf4e48495
feat(users): add ability to add native users from the UI (#5097)
Co-authored-by: John Joyce <john@acryl.io>
2022-06-08 18:13:22 -07:00
John Joyce
10b1333703
fix(ui): Fixing missing homescreen logo (#5112) 2022-06-07 16:58:17 -07:00
John Joyce
96c0746aff
refactor(graphql): Migrate Visual Config into the Configuration Provider (#4780) 2022-06-06 16:36:05 -07:00
Chris Collins
d22180eb0e
feat(upgrades) Create new DataHubUpgrade + Restore Glossary Entities Bootstrap step (#5099) 2022-06-06 16:34:03 -07:00
Dexter Lee
92f81189eb
feat(model): Add optional context field to tag/term association (#5085) 2022-06-06 08:46:32 -07:00
RyanHolstien
e06df1fcf3
feat(kafka): use a thread pool executor for kafka for thread reuse (#5079) 2022-06-06 08:10:07 -07:00
Nirmit Jain
ce3ddc9afe
fix: ES Rest Client Creation for non ssl authenticated connection (#5056)
* Bug fix for RestClientCreation

Fixed bug stated in https://github.com/datahub-project/datahub/issues/5046

* Called overridden method to avoid code redundancy

 changed as per comments

* Added type for builder

Co-authored-by: Nirmit Jain <nirmit.jain@navi.com>
2022-06-01 11:45:38 -07:00
Aseem Bansal
2dd826626d
feat(model): new chart types (#5017) 2022-06-01 18:14:36 +05:30
Dexter Lee
b204357f41
Remove exception on ingest policies (#5050) 2022-05-31 14:44:47 -07:00
Felix Lüdin
2a373c21e5
fix(docs): hana - rename SAP HANA source and data platform (#5043) 2022-05-31 14:44:16 -07:00
John Joyce
1a31f7888a
fix(restore): Add RESTATE ChangeType to MCL / MCP to permit restore indices (#5022) 2022-05-30 10:04:51 -07:00
Chris Collins
43deb7080a
feat(glossary) Business Glossary updates (#5026) 2022-05-29 21:26:07 -07:00
RyanHolstien
2a2fd05345
feat: telemetry improvements (#5029) 2022-05-27 17:04:45 -07:00
John Joyce
b6773e4637
feat(Tests): Make DataHub Tests Feature configurable via env variable (#5020) 2022-05-26 12:29:20 -07:00
Ravindra Lanka
108b492ed1
feat(ingestion): Add Iceberg source (#5010)
Co-authored-by: cccs-eric <eric.ladouceur@cyber.gc.ca>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-05-26 08:05:57 -07:00
buggythepirate
92338c7912
feat(ingest): Added new ingestion source SAP HANA (#4376)
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
2022-05-26 03:42:50 -07:00
Pedro Silva
72c310ce50
fix(gms): Fix incorrect StatefulTokenService init (#5004)
StatefulTokenService was not getting correctly initialised in GMS due to a typo on the configuration for the salt leading to inconsistent hashing logic.
2022-05-25 14:59:05 -07:00
John Joyce
944be9a1da
feat(Tests): Metadata Tests Models + APIs + UI (Part 1) (#4989) 2022-05-25 08:55:08 -07:00
mayurinehate
65cf0053a3
feat(model): add created, lastModified auditstamps to SchemaField (#4943) 2022-05-24 22:51:26 -07:00
Dexter Lee
669160a677
feat(run): Create a describe run endpoint for fetching aspects created by the ingestion run (#4964) 2022-05-24 14:46:36 -07:00
Justin Marozas
97bce80fc9
refactor(metadata-io): introduce a storage-independent in-memory entity aspect model (#4957) 2022-05-24 12:40:42 -07:00
John Joyce
ce061e3fb5
feat(authorization): Adding AuthorizerContext + ResourceSpecResolver to context (#4982) 2022-05-24 11:06:49 -07:00
Pedro Silva
bbe79170fc
feat(graphql) Add new Revokable Token API (#4970) 2022-05-24 10:44:31 -07:00
RyanHolstien
71c7dc455f
fix(metadata-service): telemetry - fix hardcoded aspect name, suppress errors when producing MAE (#4981) 2022-05-24 09:18:20 -07:00
liyuhui666
d78f1d64b2
fix(data platforms): Update data_platforms.json (#4966)
Fixed clickHouse data source icon not being displayed after DataHub startup because there is no network
2022-05-19 20:52:24 -07:00