895 Commits

Author SHA1 Message Date
cfli
00a42ccd4f eval beir 2024-10-24 15:48:21 +08:00
cfli
6d71e83cf2 update reranker 2024-10-23 23:35:26 +08:00
cfli
572644857d msmarco eval 2024-10-23 17:58:08 +08:00
cfli
e7ca526a92 msmarco eval 2024-10-23 17:33:29 +08:00
cfli
ac0180575f update args 2024-10-23 15:54:21 +08:00
cfli
cb564425dc update args 2024-10-23 15:04:47 +08:00
cfli
0d8bbfe0b7 update args 2024-10-23 10:41:03 +08:00
cfli
c038a8f962 update desc 2024-10-22 21:20:08 +08:00
cfli
07eef8c828 update reranker arguments 2024-10-22 21:15:22 +08:00
cfli
f4c43312c5 update examples 2024-10-22 18:30:33 +08:00
cfli
b3cc268192 eval arguments 2024-10-22 17:32:55 +08:00
cfli
23fd41436c dataset 2024-10-22 15:57:37 +08:00
cfli
ca5bf23c89 research 2024-10-22 15:53:01 +08:00
cfli
06766f4d8c dataset 2024-10-22 15:36:52 +08:00
cfli
97405e6897 dataset 2024-10-22 15:30:34 +08:00
cfli
60001af55e dataset 2024-10-22 15:28:41 +08:00
cfli
7b7e37dafd update reranker prompt 2024-10-22 12:26:31 +08:00
cfli
46a87a6913 update reranker prompt 2024-10-22 12:22:38 +08:00
cfli
8d50fbd258 update reranker 2024-10-22 12:05:22 +08:00
hanhainebula
7754530c49 update AbsEmbedder.py 2024-10-22 11:03:31 +08:00
cfli
7bf0e56c2c update eval util 2024-10-22 10:55:24 +08:00
cfli
023196950f update reranker examples 2024-10-22 10:51:50 +08:00
cfli
f997bc63b0 update trainer 2024-10-22 10:14:38 +08:00
hanhainebula
f75ae6a0eb clean code for core code
- remove spaces in empty line
- some other formats
2024-10-22 00:42:47 +08:00
hanhainebula
f169159eb8 mv evaluation utils code 2024-10-21 23:07:41 +08:00
hanhainebula
a8763dbc6c init evaluation dataset dir 2024-10-21 23:04:40 +08:00
hanhainebula
fc73e79d22 upload abstract class for evaluation 2024-10-21 23:04:03 +08:00
cfli
529ae31f92 reranker examples 2024-10-21 22:06:49 +08:00
hanhainebula
ebdcaf5325 rm weights_only=True when using torch.load 2024-10-21 21:40:10 +08:00
hanhainebula
2c7da39f2c clean code for embedder abc finetune code 2024-10-21 21:37:08 +08:00
hanhainebula
5f6f6b33ef fix a bug in AbsDataset.py 2024-10-21 21:31:30 +08:00
hanhainebula
4e13ad380e update embedder finetune examples 2024-10-21 21:09:54 +08:00
hanhainebula
d34f86192d fix a bug in icl embedder train_dataset 2024-10-21 20:55:24 +08:00
hanhainebula
2a8da95637 add weights_only=True when using torch.load 2024-10-21 20:47:21 +08:00
hanhainebula
7984974d43 fix a bug for embedder finetune
- enable_input_require_grads when using gradient_checkpointing
2024-10-21 20:33:33 +08:00
hanhainebula
ba86f6e1d1 update decoder-only embedder finetune code
- add warning info when special tokens already in tokenizer
- fix missed arguments: modules_to_save
2024-10-21 19:45:42 +08:00
hanhainebula
323c357bcc update decoder-only embedder finetune examples 2024-10-21 19:43:01 +08:00
hanhainebula
0de596dcd2 debug for EncoderOnlyEmbedderM3Model: done 2024-10-21 19:39:38 +08:00
hanhainebula
e8e772ccc4 debug for EncoderOnlyEmbedderM3Model 2024-10-21 19:35:08 +08:00
hanhainebula
13eb47faeb debug for EncoderOnlyEmbedderM3Model 2024-10-21 19:28:10 +08:00
hanhainebula
320ba5aec2 debug for EncoderOnlyEmbedderM3Model 2024-10-21 18:55:13 +08:00
hanhainebula
ab3dd5510b debug for EncoderOnlyEmbedderM3Model 2024-10-21 18:46:12 +08:00
hanhainebula
f2f15a5eec debug for EncoderOnlyEmbedderM3Model: colbert:done 2024-10-21 18:35:30 +08:00
hanhainebula
45cd82c7b3 debug for EncoderOnlyEmbedderM3Model: colbert:done 2024-10-21 18:32:06 +08:00
hanhainebula
8249bb397d Merge branch 'new-flagembedding-v1' of github.com:hanhainebula/FlagEmbedding into new-flagembedding-v1 2024-10-21 18:14:54 +08:00
hanhainebula
907365e783 debug for EncoderOnlyEmbedderM3Model 2024-10-21 18:14:39 +08:00
cfli
1d5bf7c518 reranker finetune 2024-10-21 18:13:52 +08:00
hanhainebula
a39c766965 debug for EncoderOnlyEmbedderM3Model 2024-10-21 18:11:16 +08:00
hanhainebula
51b7315223 debug for EncoderOnlyEmbedderM3Model 2024-10-21 17:57:53 +08:00
hanhainebula
c2880c32a7 debug for EncoderOnlyEmbedderM3Model 2024-10-21 17:52:43 +08:00