haystack/releasenotes/notes/transformers-similarity-update-53a840b31bac4c3d.yaml
Sebastian Husch Lee c294b8ac8c
feat: Add auto device checks and model_kwargs to TransformersSimilarityRanker (#6561)
* Add device checking and model_kwargs like we do in ExtractiveReader

* Add release notes

* Make a utility function for the device checking

* Better warning message and updated ExtractiveReader to use the util function

* Add unit tests for get_device

* Fix pylint
2023-12-18 15:13:42 +01:00

6 lines
280 B
YAML

---
enhancements:
- |
Add new variable model_kwargs to the TransformersSimilarityRanker so we can pass different loading options supported by
HuggingFace. Add device availability checking if the user passes in None to the device init param. Ranking goes, GPU, MPS, CPU.