david-leifker
adffce2f03
feat(openapi-v3): entity-registry openapi spec ( #9550 )
...
Co-authored-by: Ajoy Majumdar <ajoymajumdar@hotmail.com>
Adds support for custom aspects in the openapi api
2024-04-18 15:03:41 -05:00
david-leifker
731c29e675
feat(graph-retriever): implement graph retriever ( #10241 )
2024-04-16 10:12:48 -05:00
Davi Arnaut
717e40b89d
chore(usage-stats): measure time for getting buckets and aggregations ( #10220 )
2024-04-05 11:22:32 -07:00
david-leifker
9a0a53bbe4
fix(restoreIndices): batchSize vs limit ( #10178 )
2024-04-01 15:54:37 -05:00
Davi Arnaut
c3257d81c8
feat(metadata-jobs): improve consumer logging ( #10173 )
2024-03-31 08:07:58 -07:00
Pedro Silva
35ec7dfe14
fix(graphQL): Ignore soft-deleted assertions in UI calls ( #10148 )
2024-03-27 22:55:27 +00:00
RyanHolstien
2657c8f68b
feat(lineage): add a parameter to allow limiting the per hop exploration of lineage search ( #10062 )
2024-03-26 11:48:39 -05:00
david-leifker
45f6c2a21e
fix(ingestProposal): fix/handle no-op ingestion ( #10126 )
2024-03-25 18:12:28 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization ( #10066 )
2024-03-23 06:15:36 -05:00
david-leifker
93b5907f99
fix(usage-stats): usage-stats error handling and filter ( #10105 )
2024-03-22 21:47:00 -05:00
Davi Arnaut
c4a453204c
fix(opensearch): Rollover usage events at a file size rather than time-based manner ( #10006 )
2024-03-07 10:32:16 -08:00
david-leifker
ed10a8d8cc
feat(search): search access controls ( #9892 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
david-leifker
62f2789724
feat(structured-properties): soft delete ( #9812 )
2024-02-21 18:16:42 -06:00
david-leifker
63322225d9
misc: datahub-upgrade improvements, aspect key & default aspects fixes ( #9796 )
2024-02-07 14:41:49 -06:00
david-leifker
ff0818bad7
fix(aspects): fix default aspect generation for non-restli locations ( #9746 )
2024-01-31 18:28:35 -06:00
david-leifker
264278861b
feat(build): support jdk8 spark lineage ( #9697 )
2024-01-23 17:49:23 -06:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms ( #9626 )
...
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
david-leifker
bd9b0c49fb
perf(entity-service): batch exists calls ( #9663 )
2024-01-19 16:32:22 -06:00
david-leifker
8415fc214b
feat(entity-registry): entity registry plugins ( #9538 )
2024-01-08 14:20:03 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint ( #9373 )
2023-12-06 11:02:42 +05:30
david-leifker
c66619ccc7
fix(elasticsearch): set datahub usage events shard & replica count ( #9388 )
2023-12-05 14:03:24 -06:00
david-leifker
b03515fbc7
feat(usageclient): updates for usageclient ( #9255 )
2023-11-16 18:39:36 -06:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 ( #9031 )
2023-10-18 13:45:46 -05:00
Amanda Hernando
c564abcbf0
feat(auth): add group membership field resolver provider ( #8846 )
...
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
Co-authored-by: Adrián Pertíñez <adrian.pertinez@thoughtworks.com>
2023-10-12 11:38:42 -07:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x ( #8852 )
2023-09-21 13:01:55 -05:00
siladitya
9fdfa49028
fix(datahub-gms) usage stats queryRange API's Authorization error for Dataset Owners ( #8819 )
...
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
2023-09-20 07:55:19 -07:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates ( #8456 )
2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update ( #8745 )
2023-09-01 19:36:01 +05:30
Indy Prentice
4778a8cd99
fix(usage): Update index lifecycle policy to not delete old datahub usage events ( #8565 )
...
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-08-03 18:02:59 -03:00
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() ( #8461 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module ( #8306 )
2023-07-20 06:39:14 +05:30
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery ( #8352 )
2023-07-12 17:12:23 +05:30
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode ( #8320 )
2023-06-30 15:56:12 -05:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex ( #8341 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index ( #8277 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices ( #8265 )
...
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Indy Prentice
69d26e5b46
feat(opensearch): Rollover usage events at a file size rather than time-based manner ( #8182 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-20 16:54:10 -05:00
Indy Prentice
e35ac44f58
fix(ingest): Call validator on the base urn as well as aspect components when ingesting ( #8250 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-16 11:47:19 -05:00
RyanHolstien
9588440549
fix(apiAuth): add resources where applicable and update docs ( #8234 )
2023-06-14 17:21:09 -05:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default ( #8053 )
2023-05-23 11:38:58 -05:00
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits ( #8061 )
2023-05-22 17:06:31 -07:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits ( #8051 )
...
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver ( #7840 )
2023-04-18 09:10:04 -07:00
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements ( #7550 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter ( #7235 )
2023-02-22 19:03:14 -06:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization ( #6614 )
2023-02-22 15:45:45 -06:00
david-leifker
ebec860bce
fix(search): fix search filters, handle detection of keyword subfield ( #7372 )
2023-02-20 19:27:10 -06:00
RyanHolstien
31ee8aacec
fix(search): support searchFlags for GraphQL ( #7346 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-16 13:26:21 -06:00
Aseem Bansal
aa4c6fcc05
chore(log/docs): improve error log, docs ( #7239 )
2023-02-03 17:43:53 +05:30
