yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-10-12 09:25:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,918 Commits 328 Branches 129 Tags
Commit Graph

852 Commits

Author SHA1 Message Date
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277) 
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
 2023-06-28 17:06:51 -05:00
Chris Collins
a36b9ed04f
fix(ingestion) Fixes producing MAE events with browsePathsV2 aspect (#8304) 2023-06-27 14:38:51 +05:30
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265) 
enabling auto-merge as flaky tests succeeded on the first run
 2023-06-21 16:47:13 +00:00
Chris Collins
ed2159bc36
feat(ui) Update Search & Browse to be a unified experience (#8235) 
Co-authored-by: Josh Eilers <josh.eilers@acryl.io>
 2023-06-21 13:40:07 +05:30
Indy Prentice
69d26e5b46
feat(opensearch): Rollover usage events at a file size rather than time-based manner (#8182) 
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
 2023-06-20 16:54:10 -05:00
david-leifker
a5ee1cae62
fix(custom-search): revert underscore as quoted (#8163) 2023-06-16 17:26:30 -05:00
Indy Prentice
e35ac44f58
fix(ingest): Call validator on the base urn as well as aspect components when ingesting (#8250) 
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
 2023-06-16 11:47:19 -05:00
RyanHolstien
6ce0a248fd
feat(ui): create fast path for immediate processing of ui sourced changes (#8200) 
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-06-15 16:47:13 +05:30
RyanHolstien
9588440549
fix(apiAuth): add resources where applicable and update docs (#8234) 2023-06-14 17:21:09 -05:00
Indy Prentice
2b94a103ac
Add combined health check endpoint which can check multiple components (#8191) 
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-06-09 10:36:25 +01:00
david-leifker
81fdf9df55
fix(vulnerabilities)/vulnerabilities_fixes_datahub (#8075) (#8189) 
Co-authored-by: Sejal-NucleusTeq <109514187+Sejal-NucleusTeq@users.noreply.github.com>
 2023-06-07 18:42:19 -05:00
david-leifker
57c5d2fb47
fix(restli): update base client retry logic (#8172) 2023-06-06 09:50:08 -05:00
RyanHolstien
b42f518255
chore(json): fix json vulnerability (#8150) 2023-05-30 18:50:40 -05:00
RyanHolstien
4f50445d98
fix(scroll): fix scroll cache key for hazelcast (#8149) 2023-05-30 18:50:16 -05:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045) 
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-05-26 17:54:09 +01:00
Chris Collins
3c0d720eb6
feat(ui) Add readOnly flag that disables profile URL editing (#8067) 2023-05-23 15:29:02 -04:00
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
RyanHolstien
12517958f5
fix(upgrade): removes sleep from bootstrap process (#8016) 2023-05-23 09:52:59 -05:00
Aseem Bansal
f70cb05d3f
fix(ci): add missing updates to restli-spec (#8106) 2023-05-23 15:08:41 +05:30
Andrew Sikowitz
a43903bf6d
refactor(ingest): Auto report workunits (#8061) 2023-05-22 17:06:31 -07:00
Sergio Gómez Villamor
423a4cb39c
doc(auth): fixes doc in DataHubSystemAuthenticator.java (#8071) 
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-05-22 14:45:47 -05:00
RyanHolstien
dcc2ec112b
chore(vulnerability): add exclusions for json to prevent leaking dependency (#8090) 2023-05-19 16:39:30 -05:00
Indy Prentice
da33e27784
feat(search): Add AggregateAcrossEntities endpoint (#8000) 2023-05-19 21:26:50 +00:00
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties (#7974) 
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
 2023-05-17 11:03:08 -07:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039) 
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
 2023-05-17 07:17:25 +00:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051) 
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
 2023-05-17 00:01:57 -04:00
Aditya Radhakrishnan
c21ddb4e1a
fix(auth): guards against creating a user for the system actor (#7996) 2023-05-10 09:28:52 -07:00
david-leifker
cd819bdacc
fix(search): fix custom search config parsing (#8010) 2023-05-10 09:56:51 -05:00
RyanHolstien
0ed164344e
feat(telemetry): add server version (#7979) 2023-05-08 18:06:38 -05:00
david-leifker
cd05f5b174
feat(schema-registry): replace confluent schema registry (#7930) 
Co-authored-by: Pedro Silva <pedro@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
 2023-05-01 13:18:41 -05:00
david-leifker
ebb2af637f
feat(search): enable search initial customization (#7901) 2023-05-01 13:18:19 -05:00
david-leifker
b71baac0b8
logging(auth): adding optional logging to authentication exceptions (#7929) 2023-05-01 13:18:05 -05:00
david-leifker
9ef281acf2
fix(system-update): fix no wait flag (#7927) 2023-04-30 08:12:11 -05:00
RyanHolstien
7fcb6aacbe
fix(platforms): fix json parse exception for data platforms (#7918) 2023-04-27 20:13:45 -05:00
Mayuri Nehate
a0c4e0dd46
feat(ingest): add GCS ingestion source (#7903) 
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
 2023-04-27 19:03:41 +02:00
david-leifker
2ffa39f009
Logging and test models fixes (#7884) 2023-04-21 15:45:20 -05:00
Pedro Silva
9199c89f13
fix(cache): Fix cache key serialization in search service (#7858) 
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: Ryan Holstien <ryan@acryl.io>
 2023-04-20 19:07:23 +01:00
John Joyce
73a12379ae
refactor(platform): Refactoring ES Utils, adding EXISTS condition support to Filter Criterion (#7832) 2023-04-20 09:42:07 -07:00
Indy Prentice
3bd637843f
feat(elasticsearch): Add servlet which provides an endpoint for a healthcheck on the ES cl… (#7799) 
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Pedro Silva <pedro@acryl.io>
 2023-04-20 11:12:00 -05:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver (#7840) 2023-04-18 09:10:04 -07:00
david-leifker
1831b89a86
servlet(config): add search configuration endpoint (#7641) 2023-04-13 14:35:08 -05:00
RyanHolstien
cbf0809c4c
chore(snakeyaml): upgrade to snakeyaml 2 (#7786) 
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
 2023-04-13 12:01:51 -05:00
david-leifker
82e55636a7
feat(search): allow longer customProperties (#7804) 2023-04-12 16:59:11 -05:00
RyanHolstien
8ffb6a3585
feat(config): allow hooks to be enabled/disabled (#7761) 2023-04-07 11:10:05 -05:00
sz
d7ea1629af
feat(jwt authenticator): JWT authenticator with asymmetric PublicKey verification for JWT token. (#6495) 
Co-authored-by: syed.javed <syed.javed@precisely.com>
 2023-03-29 14:38:07 -07:00
Chris Collins
ba6426ef61
feat(ui) Update auto-complete functionality and design (#7515) 
Adds in new styles for auto-complete as well as the new functionality around quick filters.
 2023-03-27 12:45:38 -04:00
siladitya
4336252cb7
fix(datahub-upgrade): custom timeseries aspect index creation issue. (#7622) 
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
 2023-03-21 09:36:06 -07:00
Shirshanka Das
fc9ad49821
fix(platform): Ensure time based lineage handles noop changes (#7657) 
Co-authored-by: aditya-radhakrishnan <aditya@acryl.io>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
 2023-03-21 10:43:56 -05:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30