140 Commits

Author SHA1 Message Date
david-leifker
a06b3181a1
lint(restore-indices): clean-up restore indices class (#11176) 2024-08-14 17:46:09 -05:00
david-leifker
543e447787
fix(ingestion): enforce lastObserved timestamps in SystemMetadata (#11104) 2024-08-06 17:57:01 -05:00
Felix Lüdin
76f1b236a1
feat(restore-indices): add additional step to also clear system metadata service (#10662)
Co-authored-by: John Joyce <john@acryl.io>
2024-07-30 17:15:38 -07:00
david-leifker
333799c338
feat(strucutred-properties): structured properties delete and schema change support (#10711) 2024-06-17 19:53:54 -05:00
david-leifker
a847748f8c
fix(ebean): fix auto-closeable ebean dao streams (#10506) 2024-05-15 14:10:32 -05:00
david-leifker
b8b7928dd4
fix(misc): misc fixes for OSS release (#10493) 2024-05-13 14:37:36 -05:00
david-leifker
35dbbaa43f
fix(upgrade): fix upgrade npe (#10436) 2024-05-06 12:10:24 -05:00
david-leifker
b325819dd9
feat(upgrade): common base for mcl upgrades (#10429) 2024-05-03 14:18:19 -05:00
david-leifker
f36a597b17
fix(spring): refactor spring configuration (#10290) 2024-04-16 13:50:41 -05:00
david-leifker
731c29e675
feat(graph-retriever): implement graph retriever (#10241) 2024-04-16 10:12:48 -05:00
Aseem Bansal
70b1423280
feat(access): Experimental policy debugger (#9833)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-04-11 14:22:09 +01:00
david-leifker
7933ec68aa
feat(vianode): v3 of cll via datajob update (#10221) 2024-04-08 12:53:39 -05:00
david-leifker
9a0a53bbe4
fix(restoreIndices): batchSize vs limit (#10178) 2024-04-01 15:54:37 -05:00
Felix Lüdin
892a37d59c
fix: exclude Elasticsearch ignore_throttled warnings from log (#10042) 2024-03-25 12:30:12 -05:00
david-leifker
f9e64d03cc
feat(auth): view authorization (#10066) 2024-03-23 06:15:36 -05:00
david-leifker
35cf4f89e5
log(system-update): Update DataHubStartupStep.java (#9971) 2024-03-22 21:06:12 -05:00
david-leifker
e1c4f61890
fix(policy-backfull): fix policy backfill job (#10016) 2024-03-08 11:52:33 -06:00
david-leifker
ed10a8d8cc
feat(search): search access controls (#9892)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-02-28 16:57:26 -06:00
Pedro Silva
21ecb7170f
feat(policies): Make policies searchable by privilege, type, status or editable fields (#9877) 2024-02-26 15:57:01 +00:00
david-leifker
62f2789724
feat(structured-properties): soft delete (#9812) 2024-02-21 18:16:42 -06:00
david-leifker
63322225d9
misc: datahub-upgrade improvements, aspect key & default aspects fixes (#9796) 2024-02-07 14:41:49 -06:00
david-leifker
ff0818bad7
fix(aspects): fix default aspect generation for non-restli locations (#9746) 2024-01-31 18:28:35 -06:00
Shirshanka Das
1d06d38b68
feat(platform): add support for via nodes (#9733) 2024-01-29 16:03:27 -08:00
david-leifker
943bb57cbc
feat(backend): structured properties and forms (#9626)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2024-01-22 11:46:04 -06:00
david-leifker
8415fc214b
feat(entity-registry): entity registry plugins (#9538) 2024-01-08 14:20:03 -06:00
Nate Bryant
a29fce9d82
Adds urnBasedPagination option to datahub-upgrade RestoreIndices (#9232)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2023-12-19 14:08:55 -06:00
david-leifker
8f19138f68
feat(docker-compose): consolidate docker-compose profiles (#9478) 2023-12-19 12:00:54 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
david-leifker
353584c10a
feat(browsepathv2): Allow system-update to reprocess browse paths v2 (#9200) 2023-11-07 18:22:18 -06:00
david-leifker
b61c38ab05
refactor(misc): testngJava fix, systemrestli client, cache key fix, e… (#8926) 2023-09-30 22:47:59 -05:00
david-leifker
aef49b8fb2
feat(entity-client): enable client side cache for entity-client and usage-client (#8877) 2023-09-21 22:00:14 -05:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x (#8852) 2023-09-21 13:01:55 -05:00
ukayani
0f3819b511
feat(upgrade): add ability to provide a startingOffset for RestoreIndices (#8539) 2023-09-11 10:13:55 -05:00
david-leifker
1b79142d9e
feat(EntityService): batched transactions and ebean updates (#8456) 2023-09-02 19:25:44 -05:00
RyanHolstien
9f791a3b6e
feat(browseV2): add browseV2 logic to system update (#8506)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-08-01 12:48:02 -05:00
RyanHolstien
93fde6bf93
feat(io): refactor metadata-io module (#8306) 2023-07-20 06:39:14 +05:30
david-leifker
217151ea55
fix(schema-registry): fix internal schema reg with custom duhe topic … (#8371) 2023-07-06 14:15:58 -05:00
david-leifker
22e77710f2
fix(nocode): fix DeleteLegacyGraphRelationshipsStep for Elasticsearch (#8181)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-07 09:36:03 -05:00
Aseem Bansal
0b0e4997bf
chore(log): fix log as error instead of info (#8146) 2023-05-31 15:30:50 +05:30
RyanHolstien
530b9a6540
fix(jackson): increase max serialized string length default (#8053) 2023-05-23 11:38:58 -05:00
david-leifker
b97e7a03e8
feat(system-update): remove datahub-update requirement on schema reg (#7999) 2023-05-17 10:32:23 -05:00
RyanHolstien
d061d8782f
feat(metrics): add metrics for upgrade steps (#7992) 2023-05-10 11:59:14 -05:00
Aseem Bansal
1f88dab6f9
chore(log): change sout to log (#7931) 2023-05-06 17:50:26 +05:30
Felipe Ribeiro
6f5f8de99a
feat(upgrade): add gms protocol variable (#7752)
Co-authored-by: Felipe Ribeiro <fribeiro@fanatics.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-04-12 20:47:55 -05:00
Aseem Bansal
b039ad1176
refactor: misc fixes logging, annotations (#7579)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-16 09:49:35 +05:30
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements (#7550)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
david-leifker
7b939ab2a4
feat(elasticsearch): validate index.blocks.write setting (#7478) 2023-03-02 18:04:12 -06:00
John Joyce
32b55e7caa
refactor(upgrade): Trim upgrade name before executing (#7343) 2023-02-15 08:59:06 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
a5b5abf270
fix(kafka): datahub-upgrade job (#6864) 2022-12-27 12:35:48 -06:00