mirror of
https://github.com/deepset-ai/haystack.git
synced 2025-12-14 08:37:42 +00:00
11 lines
368 B
YAML
11 lines
368 B
YAML
|
|
---
|
||
|
|
features:
|
||
|
|
- |
|
||
|
|
Adds support for the Semantic Answer Similarity (SAS) metric to `EvaluationResult.calculate_metrics(...)`:
|
||
|
|
```python
|
||
|
|
from haystack.evaluation.metrics import Metric
|
||
|
|
sas_metric = eval_result.calculate_metrics(
|
||
|
|
Metric.SAS, output_key="answers", model="sentence-transformers/paraphrase-multilingual-mpnet-base-v2"
|
||
|
|
)
|
||
|
|
```
|