115 Commits

Author SHA1 Message Date
david-leifker
5ad15a7b99
privileges(refactor): consolidate individual sys op privileges (#11549) 2024-10-07 15:36:13 -05:00
david-leifker
5cbd83675e
refactor(criterion): refactor criterion construction (#11486) 2024-09-27 13:11:40 -05:00
david-leifker
a481ea4ffb
feat(graph): graph index soft-delete support (#11453) 2024-09-23 10:10:03 -05:00
david-leifker
738eaed6f1
feat(throttle): extend throttling to API requests (#11325) 2024-09-12 09:52:20 -05:00
david-leifker
f23765ec30
feat(auth): implement session authorization cache (#11327) 2024-09-11 15:06:24 -05:00
david-leifker
edb9a87b84
fix(elasticsearch): refactor idHashAlgo setting (#11193) 2024-08-16 14:41:44 -05:00
RyanHolstien
06562f320d
feat(search): support sorting on multiple fields (#10775) 2024-08-09 15:29:43 -05:00
david-leifker
543e447787
fix(ingestion): enforce lastObserved timestamps in SystemMetadata (#11104) 2024-08-06 17:57:01 -05:00
ksrinath
906bc98c82
fix(restli): log aspect-not-found as a warning rather than as an error (#10834) 2024-07-04 12:01:39 +05:30
david-leifker
b4e05050d1
feat(logging): unified request logging (graphql, openapi, restli) (#10802) 2024-06-29 02:50:10 -05:00
david-leifker
333799c338
feat(strucutred-properties): structured properties delete and schema change support (#10711) 2024-06-17 19:53:54 -05:00
Harshal Sheth
402bf31938
feat(gms): add ingestProposalBatch endpoint (#10706) 2024-06-14 12:30:19 -07:00
david-leifker
34c1a9592c
feat(openapi): openapi v3 updates (#10710) 2024-06-14 12:36:57 -05:00
david-leifker
a847748f8c
fix(ebean): fix auto-closeable ebean dao streams (#10506) 2024-05-15 14:10:32 -05:00
david-leifker
6ed21bd1bc
feat(plugins): spring custom plugins (#10389)
Co-authored-by: Kevin Chun <kevinchun@netflix.com>
Co-authored-by: Kevin Chun <kevin1chun@gmail.com>
2024-05-09 14:56:03 -05:00
david-leifker
adffce2f03
feat(openapi-v3): entity-registry openapi spec (#9550)
Co-authored-by: Ajoy Majumdar <ajoymajumdar@hotmail.com>

Adds support for custom aspects in the openapi api
2024-04-18 15:03:41 -05:00
david-leifker
731c29e675
feat(graph-retriever): implement graph retriever (#10241) 2024-04-16 10:12:48 -05:00
Davi Arnaut
717e40b89d
chore(usage-stats): measure time for getting buckets and aggregations (#10220) 2024-04-05 11:22:32 -07:00
david-leifker
9a0a53bbe4
fix(restoreIndices): batchSize vs limit (#10178) 2024-04-01 15:54:37 -05:00
Davi Arnaut
c3257d81c8
feat(metadata-jobs): improve consumer logging (#10173) 2024-03-31 08:07:58 -07:00
Pedro Silva
35ec7dfe14
fix(graphQL): Ignore soft-deleted assertions in UI calls (#10148) 2024-03-27 22:55:27 +00:00
RyanHolstien
2657c8f68b
feat(lineage): add a parameter to allow limiting the per hop exploration of lineage search (#10062) 2024-03-26 11:48:39 -05:00
david-leifker
45f6c2a21e
fix(ingestProposal): fix/handle no-op ingestion (#10126) 2024-03-25 18:12:28 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
david-leifker
93b5907f99
fix(usage-stats): usage-stats error handling and filter (#10105) 2024-03-22 21:47:00 -05:00
Davi Arnaut
c4a453204c
fix(opensearch): Rollover usage events at a file size rather than time-based manner (#10006) 2024-03-07 10:32:16 -08:00
david-leifker
ed10a8d8cc
feat(search): search access controls (#9892)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
david-leifker
62f2789724
feat(structured-properties): soft delete (#9812) 2024-02-21 18:16:42 -06:00
david-leifker
63322225d9
misc: datahub-upgrade improvements, aspect key & default aspects fixes (#9796) 2024-02-07 14:41:49 -06:00
david-leifker
ff0818bad7
fix(aspects): fix default aspect generation for non-restli locations (#9746) 2024-01-31 18:28:35 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage (#9697) 2024-01-23 17:49:23 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
david-leifker
bd9b0c49fb
perf(entity-service): batch exists calls (#9663) 2024-01-19 16:32:22 -06:00
david-leifker
8415fc214b
feat(entity-registry): entity registry plugins (#9538) 2024-01-08 14:20:03 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
david-leifker
c66619ccc7
fix(elasticsearch): set datahub usage events shard & replica count (#9388) 2023-12-05 14:03:24 -06:00
david-leifker
b03515fbc7
feat(usageclient): updates for usageclient (#9255) 2023-11-16 18:39:36 -06:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 (#9031) 2023-10-18 13:45:46 -05:00
Amanda Hernando
c564abcbf0
feat(auth): add group membership field resolver provider (#8846)
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
Co-authored-by: Adrián Pertíñez <adrian.pertinez@thoughtworks.com>
2023-10-12 11:38:42 -07:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
siladitya
9fdfa49028
fix(datahub-gms) usage stats queryRange API's Authorization error for Dataset Owners (#8819)
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
2023-09-20 07:55:19 -07:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates (#8456) 2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update (#8745) 2023-09-01 19:36:01 +05:30
Indy Prentice
4778a8cd99
fix(usage): Update index lifecycle policy to not delete old datahub usage events (#8565)
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-08-03 18:02:59 -03:00
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() (#8461)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode (#8320) 2023-06-30 15:56:12 -05:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex (#8341)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30