david-leifker
8415fc214b
feat(entity-registry): entity registry plugins ( #9538 )
2024-01-08 14:20:03 -06:00
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 ( #9458 )
2023-12-15 13:28:33 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint ( #9373 )
2023-12-06 11:02:42 +05:30
david-leifker
c66619ccc7
fix(elasticsearch): set datahub usage events shard & replica count ( #9388 )
2023-12-05 14:03:24 -06:00
david-leifker
b03515fbc7
feat(usageclient): updates for usageclient ( #9255 )
2023-11-16 18:39:36 -06:00
RyanHolstien
1b737243b2
feat(avro): upgrade avro to 1.11 ( #9031 )
2023-10-18 13:45:46 -05:00
Amanda Hernando
c564abcbf0
feat(auth): add group membership field resolver provider ( #8846 )
...
Co-authored-by: Adrián Pertíñez <khurzak92@gmail.com>
Co-authored-by: Adrián Pertíñez <adrian.pertinez@thoughtworks.com>
2023-10-12 11:38:42 -07:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x ( #8852 )
2023-09-21 13:01:55 -05:00
siladitya
9fdfa49028
fix(datahub-gms) usage stats queryRange API's Authorization error for Dataset Owners ( #8819 )
...
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
2023-09-20 07:55:19 -07:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates ( #8456 )
2023-09-02 19:25:44 -05:00
david-leifker
7dd6e09ac5
refactor(build): upgrade to gradle 7 & guava update ( #8745 )
2023-09-01 19:36:01 +05:30
Indy Prentice
4778a8cd99
fix(usage): Update index lifecycle policy to not delete old datahub usage events ( #8565 )
...
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-08-03 18:02:59 -03:00
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() ( #8461 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module ( #8306 )
2023-07-20 06:39:14 +05:30
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery ( #8352 )
2023-07-12 17:12:23 +05:30
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode ( #8320 )
2023-06-30 15:56:12 -05:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex ( #8341 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index ( #8277 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices ( #8265 )
...
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Indy Prentice
69d26e5b46
feat(opensearch): Rollover usage events at a file size rather than time-based manner ( #8182 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-20 16:54:10 -05:00
Indy Prentice
e35ac44f58
fix(ingest): Call validator on the base urn as well as aspect components when ingesting ( #8250 )
...
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-16 11:47:19 -05:00
RyanHolstien
9588440549
fix(apiAuth): add resources where applicable and update docs ( #8234 )
2023-06-14 17:21:09 -05:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default ( #8053 )
2023-05-23 11:38:58 -05:00
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits ( #8061 )
2023-05-22 17:06:31 -07:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits ( #8051 )
...
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver ( #7840 )
2023-04-18 09:10:04 -07:00
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements ( #7550 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter ( #7235 )
2023-02-22 19:03:14 -06:00
RyanHolstien
98f3f93442
feat(auth): REST API authorization ( #6614 )
2023-02-22 15:45:45 -06:00
david-leifker
ebec860bce
fix(search): fix search filters, handle detection of keyword subfield ( #7372 )
2023-02-20 19:27:10 -06:00
RyanHolstien
31ee8aacec
fix(search): support searchFlags for GraphQL ( #7346 )
...
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-16 13:26:21 -06:00
Aseem Bansal
aa4c6fcc05
chore(log/docs): improve error log, docs ( #7239 )
2023-02-03 17:43:53 +05:30
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges ( #7159 )
2023-02-02 15:30:49 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
david-leifker
d8af0b43bd
fix(runid): always update runid, except when queued ( #6876 )
2022-12-28 13:09:30 -06:00
david-leifker
cb6314c51d
fix(elasticsearch): fixes out of order runId writes ( #6845 )
...
Co-authored-by: leifker <dleifker@gmail.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-12-27 17:50:11 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework ( #6634 )
2022-12-06 10:22:41 -08:00
david-leifker
2de9d3d5bf
fix(logging): Remove lombok as source of slf4j-api, convert to compileOnly where possible ( #6616 )
2022-12-04 19:57:47 -08:00
david-leifker
4ca3327d89
fix(security): update ranger commons & dependencies for security vulns ( #6577 )
...
* fix(security): update ranger commons & dependencies for security vulns
2022-11-30 17:05:01 -06:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint ( #6097 )
...
* feat(ingest): add async option to ingest proposal endpoint
* small tweak to validate before write to K, also keep existing path for timeseries aspects
* avoid double convert
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention ( #6088 )
2022-09-30 16:11:39 +05:30
Tomáš Kubín
596d48448e
fix(elasticsearch) Analytics indices creation on AWS ES ( #5502 )
...
* refactor(elasticsearch-setup-job): create-indices.sh readability
The script contains many copy-pasting and is not easy to follow.
Add comments, extract commonly used operations into functions, unify approaches.
* fix(elasticsearch-setup-job): AWS indices creation
Fix the issue where Amazon OpenSearch (AWS ES) indices are incorrectly initialised
and the Analytics screen shows errors only.
* feat(elasticsearch-setup-job): configuration hint
mention USE_AWS_ELASTICSEARCH env value if it seems it's set the wrong way
* fix(elasticsearch-setup-job): silent curl
* fix(elasticsearch-setup-job): better USE_AWS_ELASTICSEARCH hint
* docs(elasticsearch-setup-job): index dropping explained
- more comments
- more defensive approach
- index file renamed
* fix(elasticsearch-setup-job): script fixes
* merge(elasticsearch-setup-job): merging in PR #5937
* merge(elasticsearch-setup-job): merging in PR #5963
* merge(elasticsearch-setup-job): merging in PR #5975
Co-authored-by: Pedro Silva <pedro@acryl.io>
2022-09-29 14:10:51 +01:00
RyanHolstien
0728656fbf
feat(patch): initial support of json patch style semantics in MCPs ( #5901 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-22 23:52:18 -07:00
John Joyce
450fb2effb
refactor(gms): Refactoring util + entity client class locations ( #5902 )
2022-09-12 12:11:28 -07:00
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. ( #4756 )
2022-09-11 11:27:46 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph ( #5805 )
2022-09-02 15:24:40 +05:30
Aditya Radhakrishnan
89238408b9
fix(search): validate entities exist before returning search results in EntityClient ( #5751 )
2022-08-29 13:40:02 -07:00
Chris Collins
33754d41f5
feat(ingestion) Add ability to rollback ingestion from UI - BE PR ( #5739 )
2022-08-29 13:09:15 -07:00
Gabe Lyons
2e332d8c09
fix(graph service): only query for entities that should have lineage [Breaking Change] ( #5539 )
...
* allow filtering multiple entity types in graph service
* fixing up tests
* fixing imports
* lint fix
* another lint fix
* fixing another lint
* responding to comments
* fixing entity registry test
* always fetch yourself
2022-08-11 13:15:38 -07:00
John Joyce
57b7ade1f0
feat(ui): Add rich UI ingestion run summary ( #5577 )
2022-08-08 14:33:57 -07:00
