925 Commits

Author SHA1 Message Date
Chris Collins
265e2a4e42
feat(ui/graphql) Add ability to sort search results from search results page (#8595) 2023-08-09 16:51:06 -04:00
Indy Prentice
926a9c36a6
refactor(search) Use search across multiple-entities API, deprecate Aggregator classes (#8498)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-08-08 11:23:27 -03:00
Indy Prentice
4778a8cd99
fix(usage): Update index lifecycle policy to not delete old datahub usage events (#8565)
Co-authored-by: Indy Prentice <indy@ip-192-168-3-10.us-west-2.compute.internal>
2023-08-03 18:02:59 -03:00
RyanHolstien
b142851b32
fix(glue): restore glue configurations (#8533) 2023-08-02 17:17:49 -05:00
RyanHolstien
9f791a3b6e
feat(browseV2): add browseV2 logic to system update (#8506)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-01 12:48:02 -05:00
david-leifker
b77b4e2ba9
feat(elasticsearch): allow bulk delete (#8424) 2023-07-31 10:05:26 +05:30
Yang Jiandan
753b0f1acc
fix(gms): GMS hang when upgrade image #8270 (#8271)
Co-authored-by: yangjd33 <yangjd33@chinaunicom.cn>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-07-29 06:28:11 -05:00
david-leifker
3640291493
config(ebean): add ebean retry configuration (#8500) 2023-07-28 14:09:44 -05:00
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() (#8461)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
Gabe Lyons
a97ac52481
fix(presto-on-hive): update presto-on-hive URN in data_platforms.json (#8484) 2023-07-23 17:10:22 +05:30
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
david-leifker
e725d4df74
fix(schema-reg): allow other response codes from schema registry check (#8302) 2023-07-17 12:45:03 +05:30
Indy Prentice
61a1f5775c
feat(openapi): Add openapi endpoint for getting task status (#8391)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-12 17:29:03 -03:00
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
Chris Collins
18c1f12436
feat(ui) Allow a configurable default tab for domain entity profile page (#8316) 2023-07-11 10:30:47 -04:00
Chris Collins
12543bca33
fix(config) Set search and browse flags default off (#8378) 2023-07-10 11:57:35 -04:00
Chris Collins
5d3c6a8a00
fix(java) Add try catch block when backfilling browse v2 (#8377) 2023-07-06 15:41:38 -04:00
david-leifker
217151ea55
fix(schema-registry): fix internal schema reg with custom duhe topic … (#8371) 2023-07-06 14:15:58 -05:00
david-leifker
a5f420ffd4
feat(browsepathv2): enable incremental update browsepath (#8354) 2023-07-06 10:42:07 -05:00
skrydal
cfa864e418
feat(auth): Fine grained ownership policies (#7499)
Co-authored-by: davidlacedonia <davidlacedonia@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-07-03 09:44:22 -07:00
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode (#8320) 2023-06-30 15:56:12 -05:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex (#8341)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30
Chris Collins
c051ea00b0
feat(ui) Show Acryl information with button and banner behind flag (#8330) 2023-06-29 17:13:50 -04:00
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Chris Collins
a36b9ed04f
fix(ingestion) Fixes producing MAE events with browsePathsV2 aspect (#8304) 2023-06-27 14:38:51 +05:30
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265)
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Chris Collins
ed2159bc36
feat(ui) Update Search & Browse to be a unified experience (#8235)
Co-authored-by: Josh Eilers <josh.eilers@acryl.io>
2023-06-21 13:40:07 +05:30
Indy Prentice
69d26e5b46
feat(opensearch): Rollover usage events at a file size rather than time-based manner (#8182)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-20 16:54:10 -05:00
david-leifker
a5ee1cae62
fix(custom-search): revert underscore as quoted (#8163) 2023-06-16 17:26:30 -05:00
Indy Prentice
e35ac44f58
fix(ingest): Call validator on the base urn as well as aspect components when ingesting (#8250)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-16 11:47:19 -05:00
RyanHolstien
6ce0a248fd
feat(ui): create fast path for immediate processing of ui sourced changes (#8200)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-15 16:47:13 +05:30
RyanHolstien
9588440549
fix(apiAuth): add resources where applicable and update docs (#8234) 2023-06-14 17:21:09 -05:00
Indy Prentice
2b94a103ac
Add combined health check endpoint which can check multiple components (#8191)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-09 10:36:25 +01:00
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189)
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
2023-06-07 18:42:19 -05:00
david-leifker
57c5d2fb47
fix(restli): update base client retry logic (#8172) 2023-06-06 09:50:08 -05:00
RyanHolstien
b42f518255
chore(json): fix json vulnerability (#8150) 2023-05-30 18:50:40 -05:00
RyanHolstien
4f50445d98
fix(scroll): fix scroll cache key for hazelcast (#8149) 2023-05-30 18:50:16 -05:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
Chris Collins
3c0d720eb6
feat(ui) Add readOnly flag that disables profile URL editing (#8067) 2023-05-23 15:29:02 -04:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
RyanHolstien
12517958f5
fix(upgrade): removes sleep from bootstrap process (#8016) 2023-05-23 09:52:59 -05:00
Aseem Bansal
f70cb05d3f
fix(ci): add missing updates to restli-spec (#8106) 2023-05-23 15:08:41 +05:30
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits (#8061) 2023-05-22 17:06:31 -07:00
Sergio Gómez Villamor
423a4cb39c
doc(auth): fixes doc in DataHubSystemAuthenticator.java (#8071)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 14:45:47 -05:00
RyanHolstien
dcc2ec112b
chore(vulnerability): add exclusions for json to prevent leaking dependency (#8090) 2023-05-19 16:39:30 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties (#7974)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
2023-05-17 11:03:08 -07:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051)
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00