109 Commits

Author SHA1 Message Date
cfli
6d71e83cf2 update reranker 2024-10-23 23:35:26 +08:00
cfli
cb564425dc update args 2024-10-23 15:04:47 +08:00
cfli
f4c43312c5 update examples 2024-10-22 18:30:33 +08:00
cfli
46a87a6913 update reranker prompt 2024-10-22 12:22:38 +08:00
cfli
8d50fbd258 update reranker 2024-10-22 12:05:22 +08:00
cfli
023196950f update reranker examples 2024-10-22 10:51:50 +08:00
cfli
529ae31f92 reranker examples 2024-10-21 22:06:49 +08:00
hanhainebula
4e13ad380e update embedder finetune examples 2024-10-21 21:09:54 +08:00
hanhainebula
323c357bcc update decoder-only embedder finetune examples 2024-10-21 19:43:01 +08:00
hanhainebula
45cd82c7b3 debug for EncoderOnlyEmbedderM3Model: colbert:done 2024-10-21 18:32:06 +08:00
cfli
1d5bf7c518 reranker finetune 2024-10-21 18:13:52 +08:00
hanhainebula
7f98e4a864 debug for EncoderOnlyEmbedderM3Model: colbert 2024-10-21 17:39:38 +08:00
hanhainebula
58b18d56fd disable cross_device negs for m3 embedder example 2024-10-21 17:28:55 +08:00
cfli
626e95123c Merge branch 'new-flagembedding-v1' of https://github.com/hanhainebula/FlagEmbedding into new-flagembedding-v1 2024-10-21 16:13:26 +08:00
cfli
4e9d0b386f update reranker finetune 2024-10-21 16:13:13 +08:00
hanhainebula
48af6d3f98 remove old para for embedder finetune examples
- rm kd_loss_plus_normal_loss
2024-10-21 16:10:07 +08:00
hanhainebula
8f3b1e0c15 decrease num_epochs for embedder finetune examples 2024-10-21 13:38:02 +08:00
hanhainebula
918571ad6e upload example finetune scripts for embedder 2024-10-21 12:56:30 +08:00
hanhainebula
bc99e9a126 upload deepspeed configs for embedder finetune 2024-10-21 12:56:06 +08:00
hanhainebula
94822a897f upload example-data for embedder finetune 2024-10-21 12:55:31 +08:00
hanhainebula
97be9b0f48 simplify example code for embedder inference 2024-10-19 22:31:30 +08:00
hanhainebula
effc2bb352 simplify example code for embedder inference 2024-10-19 22:23:53 +08:00
hanhainebula
33970b899b add expected results for m3 compute_score 2024-10-19 21:56:55 +08:00
hanhainebula
2c4c9629f3 upload m3 embedder compute_score examples 2024-10-19 21:33:16 +08:00
hanhainebula
f4d46ff73a add expected results for embedder inference code 2024-10-19 20:48:46 +08:00
hanhainebula
fce4e46635 del debug code for FlagLLMModel inference 2024-10-19 20:28:04 +08:00
hanhainebula
99dca1d3d2 update example infer code for multilingual-gemma2 2024-10-19 20:03:05 +08:00
hanhainebula
78d1a8727c update example code for embedder 2024-10-19 18:57:56 +08:00
hanhainebula
4d2916cfe6 update m3 example code 2024-10-19 18:01:31 +08:00
hanhainebula
0a18a87e0d update examples code for embedder inferencce 2024-10-19 13:01:48 +08:00
hanhainebula
950cf8ef0a rename BGEM3Model to BGEM3FlagModel 2024-10-19 12:38:56 +08:00
hanhainebula
d4cac4719b update BGEM3Model examples 2024-10-19 12:27:17 +08:00
hanhainebula
cfe14db868 update BGEM3Model multi-device example 2024-10-19 12:26:27 +08:00
hanhainebula
48ebe65232 update BGEM3Model example 2024-10-19 12:24:22 +08:00
hanhainebula
443765a4f1 update BGEM3Model example 2024-10-19 12:22:10 +08:00
hanhainebula
085f4b0755 upload example code for m3 inference 2024-10-19 11:32:44 +08:00
hanhainebula
5fd1048548 upload singe & multi device examples for embedder 2024-10-19 10:14:19 +08:00
hanhainebula
f7ef2ef65c upload example code for embedder base inference 2024-10-19 09:58:20 +08:00
hanhainebula
0a2f77efd7 upload auto_base example for embedder 2024-10-18 11:22:40 +08:00
hanhainebula
3d2c479aa5 add auto_*.py for every class type 2024-10-18 01:04:42 +08:00
hanhainebula
f98328e575 upload empty examples: to be completed 2024-10-18 00:33:31 +08:00
hanhainebula
cda5100f85 revert reranker examples 2024-10-18 00:18:26 +08:00
hanhainebula
26654cae34 mv old examples 2024-10-18 00:11:12 +08:00
shitao
ced5736ee9 update readme 2024-05-23 10:47:34 +08:00
shitao
4a7412d33f evluation local data 2024-05-12 20:02:12 +08:00
shitao
34d24e85e0 temperture<0.1 2024-04-22 21:43:04 +08:00
khazic
a695f54b2f 新增save_steps参数的作用 2024-04-11 09:25:27 +08:00
Lao
327a6a9a39
Update README.md 2024-04-10 19:12:29 +08:00
shitao
95ab52eb9f use logger 2024-03-04 17:25:43 +08:00
shitao
97f57a1b92 update m3 2024-03-02 20:24:42 +08:00