867 Commits

Author SHA1 Message Date
Indy Prentice
27392f9f81
refactor(search): Support searching multiple entities in search() as in scroll() (#8461)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-24 15:39:44 -03:00
Gabe Lyons
a97ac52481
fix(presto-on-hive): update presto-on-hive URN in data_platforms.json (#8484) 2023-07-23 17:10:22 +05:30
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
david-leifker
e725d4df74
fix(schema-reg): allow other response codes from schema registry check (#8302) 2023-07-17 12:45:03 +05:30
Indy Prentice
61a1f5775c
feat(openapi): Add openapi endpoint for getting task status (#8391)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-07-12 17:29:03 -03:00
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
Chris Collins
18c1f12436
feat(ui) Allow a configurable default tab for domain entity profile page (#8316) 2023-07-11 10:30:47 -04:00
Chris Collins
12543bca33
fix(config) Set search and browse flags default off (#8378) 2023-07-10 11:57:35 -04:00
Chris Collins
5d3c6a8a00
fix(java) Add try catch block when backfilling browse v2 (#8377) 2023-07-06 15:41:38 -04:00
david-leifker
217151ea55
fix(schema-registry): fix internal schema reg with custom duhe topic … (#8371) 2023-07-06 14:15:58 -05:00
david-leifker
a5f420ffd4
feat(browsepathv2): enable incremental update browsepath (#8354) 2023-07-06 10:42:07 -05:00
skrydal
cfa864e418
feat(auth): Fine grained ownership policies (#7499)
Co-authored-by: davidlacedonia <davidlacedonia@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-07-03 09:44:22 -07:00
RyanHolstien
10e5ecf6d2
fix(async): submit additional default aspects only when not in async mode (#8320) 2023-06-30 15:56:12 -05:00
Indy Prentice
52c9eb9370
fix(restli): Add docs for get task status, and fix hostname regex (#8341)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-30 17:53:58 +05:30
Chris Collins
c051ea00b0
feat(ui) Show Acryl information with button and banner behind flag (#8330) 2023-06-29 17:13:50 -04:00
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Chris Collins
a36b9ed04f
fix(ingestion) Fixes producing MAE events with browsePathsV2 aspect (#8304) 2023-06-27 14:38:51 +05:30
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265)
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Chris Collins
ed2159bc36
feat(ui) Update Search & Browse to be a unified experience (#8235)
Co-authored-by: Josh Eilers <josh.eilers@acryl.io>
2023-06-21 13:40:07 +05:30
Indy Prentice
69d26e5b46
feat(opensearch): Rollover usage events at a file size rather than time-based manner (#8182)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-20 16:54:10 -05:00
david-leifker
a5ee1cae62
fix(custom-search): revert underscore as quoted (#8163) 2023-06-16 17:26:30 -05:00
Indy Prentice
e35ac44f58
fix(ingest): Call validator on the base urn as well as aspect components when ingesting (#8250)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-06-16 11:47:19 -05:00
RyanHolstien
6ce0a248fd
feat(ui): create fast path for immediate processing of ui sourced changes (#8200)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-15 16:47:13 +05:30
RyanHolstien
9588440549
fix(apiAuth): add resources where applicable and update docs (#8234) 2023-06-14 17:21:09 -05:00
Indy Prentice
2b94a103ac
Add combined health check endpoint which can check multiple components (#8191)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-06-09 10:36:25 +01:00
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189)
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
2023-06-07 18:42:19 -05:00
david-leifker
57c5d2fb47
fix(restli): update base client retry logic (#8172) 2023-06-06 09:50:08 -05:00
RyanHolstien
b42f518255
chore(json): fix json vulnerability (#8150) 2023-05-30 18:50:40 -05:00
RyanHolstien
4f50445d98
fix(scroll): fix scroll cache key for hazelcast (#8149) 2023-05-30 18:50:16 -05:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
Chris Collins
3c0d720eb6
feat(ui) Add readOnly flag that disables profile URL editing (#8067) 2023-05-23 15:29:02 -04:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
RyanHolstien
12517958f5
fix(upgrade): removes sleep from bootstrap process (#8016) 2023-05-23 09:52:59 -05:00
Aseem Bansal
f70cb05d3f
fix(ci): add missing updates to restli-spec (#8106) 2023-05-23 15:08:41 +05:30
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits (#8061) 2023-05-22 17:06:31 -07:00
Sergio Gómez Villamor
423a4cb39c
doc(auth): fixes doc in DataHubSystemAuthenticator.java (#8071)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-22 14:45:47 -05:00
RyanHolstien
dcc2ec112b
chore(vulnerability): add exclusions for json to prevent leaking dependency (#8090) 2023-05-19 16:39:30 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties (#7974)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
2023-05-17 11:03:08 -07:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051)
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
Aditya Radhakrishnan
c21ddb4e1a
fix(auth): guards against creating a user for the system actor (#7996) 2023-05-10 09:28:52 -07:00
david-leifker
cd819bdacc
fix(search): fix custom search config parsing (#8010) 2023-05-10 09:56:51 -05:00
RyanHolstien
0ed164344e
feat(telemetry): add server version (#7979) 2023-05-08 18:06:38 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930)
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2023-05-01 13:18:41 -05:00
david-leifker
ebb2af637f
feat(search): enable search initial customization (#7901) 2023-05-01 13:18:19 -05:00
david-leifker
b71baac0b8
logging(auth): adding optional logging to authentication exceptions (#7929) 2023-05-01 13:18:05 -05:00
david-leifker
9ef281acf2
fix(system-update): fix no wait flag (#7927) 2023-04-30 08:12:11 -05:00
RyanHolstien
7fcb6aacbe
fix(platforms): fix json parse exception for data platforms (#7918) 2023-04-27 20:13:45 -05:00