david-leifker
1194f910bd
bump(): upgrade Kafka 7.9.1 ( #13667 )
2025-05-30 21:51:36 -05:00
Tamas Nemeth
a1291faad9
feat(actions): Moving datahub-actions into oss datahub ( #13120 )
2025-04-16 12:23:29 +02:00
Aseem Bansal
867007f209
chore: remove obsolete attribute from docker ( #11573 )
2024-10-09 20:52:50 +05:30
david-leifker
4296373c5f
config(rest-api): enable authentication and api authorization by default ( #11484 )
2024-09-27 11:31:25 -05:00
david-leifker
edc8fd409d
chore(ingestion-base): bump base image packages ( #11053 )
2024-07-31 12:39:07 -05:00
david-leifker
77c4629ccf
refactor(docker): move to acryldata repo for all images ( #9459 )
2024-04-02 09:36:44 -05:00
Harshal Sheth
5793467e29
feat(quickstart): remove container_name from compose files ( #9809 )
2024-02-09 20:45:30 -05:00
RyanHolstien
55cb56821c
fix(kafka): fix infinite deserialization logging ( #9494 )
2023-12-21 10:33:25 -06:00
david-leifker
3a840371cc
fix(docker): docker compose health checks port fix ( #9326 )
2023-11-28 21:21:15 -06:00
Harshal Sheth
b565a657d2
feat(quickstart): fix broker InconsistentClusterIdException issues ( #9148 )
2023-10-30 23:35:12 -07:00
david-leifker
21eb4dfc12
feat(search): update to support OpenSearch 2.x ( #8852 )
2023-09-21 13:01:55 -05:00
david-leifker
40caf35812
feat(datahub-ingestion): refactor datahub ingestion slim images ( #8515 )
2023-08-17 10:40:17 +05:30
Harshal Sheth
b8681a7129
feat(quickstart): bump quickstart start periods more ( #8573 )
2023-08-04 15:17:16 +05:30
david-leifker
3640291493
config(ebean): add ebean retry configuration ( #8500 )
2023-07-28 14:09:44 -05:00
Harshal Sheth
e5f9ee178c
fix(cli/quickstart): handle docker hangs gracefully ( #8211 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 14:34:06 -05:00
Jinlin Yang
166dc90896
Upgrade kafka and its dependencies to 3.4 in docker compose ( #8161 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-06-13 13:57:54 +01:00
david-leifker
43d37ff442
chore(cp-schema-registry): bump minor version ( #8192 )
2023-06-09 11:53:18 +01:00
Guillaume Cernier
ef1ada118d
fix(docker-compose): make startup more robust with deterministic services' dependencies ( #7880 )
2023-05-08 16:42:15 -05:00
david-leifker
5c34170337
fix(docker): fix elasticsearch image tag ( #7548 )
2023-03-15 13:28:48 -07:00
Peter Szalai
e9f060dae3
Add setup job labels to compose files ( #7473 )
2023-03-02 15:05:16 +01:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter ( #7235 )
2023-02-22 19:03:14 -06:00
Peter Szalai
0a43d250d0
fix(dev.sh): Add context to kafka-setup build ( #7234 )
2023-02-03 17:45:42 +05:30
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements ( #6894 )
2023-01-31 18:44:37 -06:00
Peter Szalai
8a2230aea4
fix(quickstart): adding back kafka-setup ( #7181 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-01-31 00:34:36 +01:00
Pedro Silva
bef59b0928
feat(quickstart): Remove kafka-setup as a hard deployment requirement ( #7073 )
2023-01-24 16:12:57 +00:00
Peter Szalai
a629df5de2
fix(kafka-setup): Fix compose context for kafka-setup ( #6923 )
2023-01-03 08:12:31 -08:00
david-leifker
637b540fa6
fix(kafka-setup): fix return code check ( #6782 )
...
* fix(kafka-setup): parallelize topic creation
* Remove -setup from docker compose (not services)
2022-12-16 13:39:18 -06:00
Shirshanka Das
e688dd554a
chore(deps): upgrade neo4j to 4.4.x ( #6101 )
2022-10-02 23:16:45 -07:00
leifker
203a6ff57b
refactor(java11) - convert most modules to java 11 ( #5836 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-25 08:39:22 -07:00
Aseem Bansal
252992f15e
fix(ci): intermittent failure in github actions ( #5452 )
2022-07-25 23:02:02 -07:00
Navin Sharma
f3e5afdba9
feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart ( #5353 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-11 22:33:24 -07:00
John Joyce
d96ddec843
refactor(actions): Migrate to use new datahub-actions container ( #4903 )
2022-05-13 12:11:56 +05:30
Shirshanka Das
f18f453200
moving to dockerhub for actions container ( #4497 )
2022-03-24 22:24:07 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Aseem Bansal
8c7f63e4f7
feat: change quickstart to use head tag for actions ( #4357 )
2022-03-09 10:29:10 -08:00
Aseem Bansal
e6a2615c08
feat(quickstart): restart actions pod in case of failures ( #4342 )
2022-03-08 11:55:21 -08:00
John Joyce
787a7e6dcd
fix(quickstart): Pin actions pod + add volume mount for datahub-frontend ( #4318 )
2022-03-04 14:05:14 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) ( #4296 )
2022-03-03 19:22:35 -08:00
Ky-Anh Huynh
ef659570f4
fix(docker): docker-compose now persists kafka broker data ( #4031 )
2022-02-01 16:35:43 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Swaroop Jagadish
90b7b9dddd
fix(ci): moving defaults back to head now that docker builds are green ( #3993 )
2022-01-27 09:48:01 -08:00
John Joyce
aeabeec133
fix(quickstart): Pin Quickstart version to v0.8.23. ( #3983 )
2022-01-26 11:36:26 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )" ( #3740 )
2021-12-14 10:49:03 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )
2021-12-13 12:37:59 -08:00
John Joyce
5a4d194bad
feat(docker): reduce quickstart footprint ( #2744 )
2021-06-23 12:59:49 -07:00
Dexter Lee
9b4df56e57
fix(docker): update default tags to head ( #2730 )
2021-06-21 18:32:00 -07:00
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS ( #2690 )
2021-06-15 08:44:15 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling ( #2629 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta ( #2499 )
...
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
Harshal Sheth
07f4cb1199
feat: datahub check local-docker ( #2295 )
2021-03-26 10:03:51 -07:00
