Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,7 @@ The model is trained on contexts **up to 2048 tokens** in length, but can be use
|
|
19 |
|
20 |
## Usage
|
21 |
|
22 |
-
**Important**: To load the model correctly, you must enable dowloading code from the model's repository: `trust_remote_code=True`, this will download the **modeling_rope_bert.py** script and load the weights into the correct architecture.
|
23 |
Otherwise, you can download this script manually and use classes from it directly to load the model.
|
24 |
|
25 |
### Basic usage (no efficient attention)
|
@@ -27,7 +27,7 @@ Otherwise, you can download this script manually and use classes from it directl
|
|
27 |
```python
|
28 |
model_name = 'Tochka-AI/ruRoPEBert-classic-base-2k'
|
29 |
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
30 |
-
model = AutoModel.from_pretrained(model_name, trust_remote_code=True)
|
31 |
```
|
32 |
|
33 |
### With SDPA (efficient attention)
|
|
|
19 |
|
20 |
## Usage
|
21 |
|
22 |
+
**Important**: 4.37.2 and higher is the recommended version of `transformers`. To load the model correctly, you must enable dowloading code from the model's repository: `trust_remote_code=True`, this will download the **modeling_rope_bert.py** script and load the weights into the correct architecture.
|
23 |
Otherwise, you can download this script manually and use classes from it directly to load the model.
|
24 |
|
25 |
### Basic usage (no efficient attention)
|
|
|
27 |
```python
|
28 |
model_name = 'Tochka-AI/ruRoPEBert-classic-base-2k'
|
29 |
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
30 |
+
model = AutoModel.from_pretrained(model_name, trust_remote_code=True, attn_implementation='eager')
|
31 |
```
|
32 |
|
33 |
### With SDPA (efficient attention)
|