867 Commits

Author SHA1 Message Date
Peter Szalai
4792ac56b7
feat(monitoring): track graphql errors in metrics (#6087)
* feat(monitoring): track graphql errors in metrics

* fix(statuscode): use status code

* address linting

* address linting
2022-09-29 21:36:17 +02:00
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES (#5502)
* refactor(elasticsearch-setup-job): create-indices.sh readability

The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.

* fix(elasticsearch-setup-job): AWS indices creation

Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.

* feat(elasticsearch-setup-job): configuration hint

mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way

* fix(elasticsearch-setup-job): silent curl

* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint

* docs(elasticsearch-setup-job): index dropping explained

- more comments
- more defensive approach
- index file renamed

* fix(elasticsearch-setup-job): script fixes

* merge(elasticsearch-setup-job): merging in PR #5937

* merge(elasticsearch-setup-job): merging in PR #5963

* merge(elasticsearch-setup-job): merging in PR #5975

Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
Pedro Silva
164bc1aa53
Revert "chore(setup): change defaults for partitions (#6074)" (#6086) 2022-09-29 15:44:32 +05:30
Aseem Bansal
4cf635e16e
chore(setup): change defaults for partitions (#6074) 2022-09-28 15:04:35 +05:30
Aseem Bansal
1c4e127ff9
feat(retention): disable applying retention on bootstrap (#6066) 2022-09-27 12:24:37 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 (#5836)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Aditya Radhakrishnan
325b959ea6
feat(roles): add ability to invite users into a role (#6015) 2022-09-23 16:48:23 -07:00
Shirshanka Das
af6a423f9d
feat(patch): report whether server is patch capable (#6037) 2022-09-23 14:42:45 -07:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs (#5901)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
atul-chegg
d53cbbb9bf
fix(platform): Add aws-secretsmanager-jdbc driver in dependencies (#5968) 2022-09-22 22:23:45 -07:00
John Joyce
407cd6c826
refactor(gms): Improving JWT parsing logic (#6025) 2022-09-22 19:29:51 -07:00
RyanHolstien
2c659214ab
feat(gms): Write back lineage search results to in-memory cache bound to feature flag (#6006)
Co-authored-by: Piyush Narang <piyushn@stripe.com>
2022-09-22 15:01:24 -07:00
Gabe Lyons
b9b0147dd1
feat(data platform) adding data platform indexing & select platform modal in frontend (#5988)
* adding data platform indexing & select platform modal in frontend

* comments
2022-09-20 08:53:26 -07:00
Parham Ghazanfari
2712dd1903
fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism. (#5936)
* fix(patch-entity-registry): Remove exception for entities with key aspects.

* test(patch-entity-registry): Fix failing unit test for entities with key aspect

* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java

* fix(patch-entity-registry): Remove duplicate semicolon.

* fix(patch-entity-registry): Use AspectSpec to retrieve aspect class in order to support custom entity ingestion via patch mechanism.

* fix(patch-entity-registry): Fixed incorrect merge conflict resolution in BrowsePathUtils.java

* fix(patch-entity-registry): Remove extraneous import from BrowsePathUtils.java

Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-19 10:47:20 -05:00
Justin Marozas
133b5e0348
feat(search): Add support for Elasticsearch object field type (#5891)
* object-type searchable field WIP

* elasticsearch object-type field WIP

* talk about the object fieldType in the docs
2022-09-14 11:50:19 -05:00
John Joyce
450fb2effb
refactor(gms): Refactoring util + entity client class locations (#5902) 2022-09-12 12:11:28 -07:00
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. (#4756) 2022-09-11 11:27:46 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix (#5634) 2022-09-07 13:32:38 -07:00
Pedro Silva
9434afc78a
feat(hooks): Add toggle for enabling/disabling platform event hook (#5840) 2022-09-06 14:53:58 -05:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph (#5805) 2022-09-02 15:24:40 +05:30
Gabe Lyons
d75b2e8c9f
power favicon via env var (#5810) 2022-09-01 17:06:30 -07:00
John Joyce
ca29f8b679
fix(bootstrap): Creating dedicated thread pool for executing async bootstrap steps + misc fixes (#5798) 2022-08-31 19:34:17 -07:00
Chris Collins
951bca096a
fix(audit logs) Set actor urn on audit stamp through Java Entity Client (#5788) 2022-08-31 10:26:47 -07:00
Aditya Radhakrishnan
73cd2f995d
feat(roles): add roles feature to DataHub (#5767) 2022-08-30 18:31:34 -07:00
Gabe Lyons
47aa32a8a5
feat(simplified homepage): adding option to show limited entity types on homepage (#5678) 2022-08-30 09:17:11 -07:00
Harshal Sheth
6aec44db00
chore: update server-side telemetry endpoint (#5759) 2022-08-29 19:16:50 -07:00
Aditya Radhakrishnan
89238408b9
fix(search): validate entities exist before returning search results in EntityClient (#5751) 2022-08-29 13:40:02 -07:00
Chris Collins
33754d41f5
feat(ingestion) Add ability to rollback ingestion from UI - BE PR (#5739) 2022-08-29 13:09:15 -07:00
John Joyce
10672c3464
fix(bootstrap): Remove malformed test in bootstrap.json (#5747) 2022-08-26 11:19:48 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term (#5649) 2022-08-24 08:01:56 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests (#5704) 2022-08-23 16:25:18 -07:00
Gabe Lyons
9bdbe32972
check if restore step should run before sleeping (#5660) 2022-08-17 09:15:51 -07:00
John Joyce
be22455ebb
feat(ui): Adding slack handle to corp group info (#5645) 2022-08-15 14:35:57 -07:00
Gabe Lyons
c41f92c8d0
feat(model): Add optional message field to auditstamp (#5611)
* adding messge to audit stamp

* Update AuditStamp.pdl

* Update AuditStamp.pdl
2022-08-11 13:48:49 -07:00
Gabe Lyons
2e332d8c09
fix(graph service): only query for entities that should have lineage [Breaking Change] (#5539)
* allow filtering multiple entity types in graph service

* fixing up tests

* fixing imports

* lint fix

* another lint fix

* fixing another lint

* responding to comments

* fixing entity registry test

* always fetch yourself
2022-08-11 13:15:38 -07:00
ksrinath
9a74054b5a
feat(metadata-service-auth): add support for eternal personal access tokens (#5433) 2022-08-09 10:04:39 -07:00
John Joyce
57b7ade1f0
feat(ui): Add rich UI ingestion run summary (#5577) 2022-08-08 14:33:57 -07:00
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 (#5562) 2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart (#5550) 2022-08-02 15:02:01 -07:00
Salih Can
0ded02544c
fix(analytics-tab) - fix analytics tab config variable for gms (#5529) 2022-08-02 17:05:04 +05:30
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms (#4999) 2022-08-01 09:47:08 -07:00
Aditya Radhakrishnan
eec5eae0ab
feat(groups): add native groups concept to DataHub (#5443) 2022-07-20 16:55:10 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT (#5451) 2022-07-20 20:54:43 +05:30
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 (#5409) 2022-07-15 21:32:32 +05:30
Pedro Silva
5b61bcc4e0
fix(gms): Change MessageDigest to be thread safe (#5405) 2022-07-15 16:28:59 +05:30
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
liyuhui666
d24b91df42
fix(kafka): add missing configs (#5394) 2022-07-15 14:53:55 +05:30
Felix Lüdin
a0303448ba
feat(dashboards): add datasets field to DashboardInfo aspect (#5188)
Co-authored-by: John Joyce <john@acryl.io>
2022-07-14 09:54:02 -07:00
Aditya Radhakrishnan
3a2fec341a
fix(bootstrap): skip ingesting data platforms that already exist (#5382) 2022-07-12 17:23:41 -07:00
Pedro Silva
5011c2f6db
fix(gms) Propagate cache exception upstream (#5381) 2022-07-12 16:02:28 -07:00