yujunjun/FlagEmbedding
1
0
Fork 0
mirror of https://github.com/FlagOpen/FlagEmbedding.git synced 2026-01-07 04:33:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #1171 from yjoonjang/master

Browse Source 
fix: fix bug when not using knowledge_distilation in fine-tuning embedder
This commit is contained in:
chaofan 2024-10-31 18:44:34 +08:00 committed by GitHub
commit b0233bf1dc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
FlagEmbedding/abc/finetune/embedder/AbsDataset.py
View File

@ -416,8 +416,9 @@ class AbsEmbedderSameDatasetTrainDataset(AbsEmbedderTrainDataset):
passages.extend(tmp_passages)
if len(teacher_scores) > 0 and len(passages) > 0:
assert len(teacher_scores) == len(passages)
if teacher_scores is not None:
if len(teacher_scores) > 0 and len(passages) > 0:
assert len(teacher_scores) == len(passages)
return queries, passages, teacher_scores