haystack/releasenotes/notes/sentence-transformers-embedders-new-devices-mgmt-07cb59c6b4a13280.yaml
Stefano Fiorucci d00f171f8b
refactor!: Sentence Transformers Embedders - new devices mgmt (#7033)
* new device mgmt for Sentence Transformers embedders

* reno
2024-02-19 14:52:44 +01:00

21 lines
669 B
YAML

---
upgrade:
- |
Adopt the new framework-agnostic device management in Sentence Transformers Embedders.
Before this change:
```python
from haystack.components.embedders import SentenceTransformersTextEmbedder
embedder = SentenceTransformersTextEmbedder(device="cuda:0")
```
After this change:
```python
from haystack.utils.device import ComponentDevice, Device
from haystack.components.embedders import SentenceTransformersTextEmbedder
device = ComponentDevice.from_single(Device.gpu(id=0))
# or
# device = ComponentDevice.from_str("cuda:0")
embedder = SentenceTransformersTextEmbedder(device=device)
```