810 Commits

Author SHA1 Message Date
hanhainebula
2c4c9629f3 upload m3 embedder compute_score examples 2024-10-19 21:33:16 +08:00
hanhainebula
7fc9fca908 implement compute_score func for m3 embedder 2024-10-19 21:23:22 +08:00
hanhainebula
02197abddf fix a bug for embedder inference: single input 2024-10-19 21:22:22 +08:00
hanhainebula
f4d46ff73a add expected results for embedder inference code 2024-10-19 20:48:46 +08:00
hanhainebula
ae72acf12c fix a bug in ICLLLMEmbedder inference 2024-10-19 20:28:52 +08:00
hanhainebula
fce4e46635 del debug code for FlagLLMModel inference 2024-10-19 20:28:04 +08:00
hanhainebula
0ba20823a2 fix a bug in ICLLLMEmbedder inference 2024-10-19 20:25:14 +08:00
hanhainebula
39b362112a fix bugs in embedder inference: enable use_fp16 2024-10-19 20:22:52 +08:00
hanhainebula
eb724106ad fix UserWarning: rm max_length para when padding 2024-10-19 20:11:31 +08:00
hanhainebula
99dca1d3d2 update example infer code for multilingual-gemma2 2024-10-19 20:03:05 +08:00
hanhainebula
78d1a8727c update example code for embedder 2024-10-19 18:57:56 +08:00
hanhainebula
baa06bf033 fix UserWarning: rm max_length para when encoding 2024-10-19 18:15:43 +08:00
hanhainebula
2d3b64a43c set weights_only=True when loading m3 linear 2024-10-19 18:09:33 +08:00
hanhainebula
4d2916cfe6 update m3 example code 2024-10-19 18:01:31 +08:00
hanhainebula
052954588a update multi-gpu code for decoder-only embedder 2024-10-19 18:01:08 +08:00
hanhainebula
0a18a87e0d update examples code for embedder inferencce 2024-10-19 13:01:48 +08:00
hanhainebula
d5cd99284b update M3Embedder compute lex scores func 2024-10-19 13:01:01 +08:00
hanhainebula
f3a0638193 update get_model func for M3Runnder 2024-10-19 13:00:08 +08:00
hanhainebula
950cf8ef0a rename BGEM3Model to BGEM3FlagModel 2024-10-19 12:38:56 +08:00
hanhainebula
d4cac4719b update BGEM3Model examples 2024-10-19 12:27:17 +08:00
hanhainebula
cfe14db868 update BGEM3Model multi-device example 2024-10-19 12:26:27 +08:00
hanhainebula
48ebe65232 update BGEM3Model example 2024-10-19 12:24:22 +08:00
hanhainebula
443765a4f1 update BGEM3Model example 2024-10-19 12:22:10 +08:00
hanhainebula
1b4bd85c26 update para for M3Embedder when compute lex scores 2024-10-19 12:19:48 +08:00
hanhainebula
48239045ee update para for M3Embedder when compute lex scores 2024-10-19 12:17:08 +08:00
hanhainebula
4708b4f7ea fix a bug in M3Embedder 2024-10-19 12:11:53 +08:00
hanhainebula
9dbaffbf03 fix a bug: EncoderOnlyEmbedderM3ModelForInference 2024-10-19 12:06:27 +08:00
hanhainebula
ea6537cca9 remove para convert_to_numpy from AbsEmbedder 2024-10-19 12:03:48 +08:00
hanhainebula
b5327dee5d fix a bug in M3Embedder 2024-10-19 11:57:56 +08:00
hanhainebula
f547492b3e Add compute_score method to
EncoderOnlyEmbedderM3Model
2024-10-19 11:55:33 +08:00
hanhainebula
f7cb0d43ef fix a bug in EncoderOnlyEmbedderM3Runner 2024-10-19 11:41:03 +08:00
hanhainebula
085f4b0755 upload example code for m3 inference 2024-10-19 11:32:44 +08:00
hanhainebula
7e54ad8ee3 update embedder inference code: type optm 2024-10-19 11:31:10 +08:00
hanhainebula
5fd1048548 upload singe & multi device examples for embedder 2024-10-19 10:14:19 +08:00
hanhainebula
1a80acac93 fix a bug in embedder multi-gpu inference 2024-10-19 10:02:47 +08:00
hanhainebula
f7ef2ef65c upload example code for embedder base inference 2024-10-19 09:58:20 +08:00
hanhainebula
02212712ef update multi-gpu code for embedder inference 2024-10-19 09:55:18 +08:00
hanhainebula
11041725ad revert to old version: inference code for embedder 2024-10-18 21:35:53 +08:00
cfli
89b98ef23b multi-gpu 2024-10-18 17:09:06 +08:00
cfli
dcf207068d multi-gpu 2024-10-18 16:54:32 +08:00
cfli
c79024cdf3 Merge branch 'new-flagembedding-v1' of https://github.com/hanhainebula/FlagEmbedding into new-flagembedding-v1 2024-10-18 16:08:23 +08:00
cfli
6f9bc67088 multi-gpu 2024-10-18 16:07:25 +08:00
hanhainebula
0817e77068 add cache_dir parameter for embedder inference 2024-10-18 12:31:56 +08:00
hanhainebula
542d3e358b Add batch_size and max_length parameters
- encode_queries and encode_corpus methods
2024-10-18 12:20:41 +08:00
hanhainebula
80cae91389 fix a import bug in embedder-finetune-m3 2024-10-18 11:43:14 +08:00
hanhainebula
9bae15e6b4 fix bugs in auto_embedder.py and auto_reranker.py 2024-10-18 11:38:11 +08:00
hanhainebula
0a2f77efd7 upload auto_base example for embedder 2024-10-18 11:22:40 +08:00
hanhainebula
2df83a00e5 Merge branch 'new-flagembedding-v1' of github.com:hanhainebula/FlagEmbedding into new-flagembedding-v1 2024-10-18 11:15:57 +08:00
hanhainebula
0e26432915 Update model_mapping import in auto_embedder.py 2024-10-18 11:15:26 +08:00
cfli
de9347713d AutoReranker 2024-10-18 10:34:55 +08:00