Update README.md
Browse files
README.md
CHANGED
@@ -13,7 +13,7 @@ This model is nearly identical to [creative-writer-v0.1-alfa-35b](https://huggin
|
|
13 |
|
14 |
- Scaled the pre-softmax logits by `1.1` during training (and then reset after training) to encourage more diverse/creative text generation (ie: increased single-token Entropy).
|
15 |
|
16 |
-
**NOTE**: For the `command-r` models
|
17 |
|
18 |
```json
|
19 |
"logit_scale": 0.06875,
|
|
|
13 |
|
14 |
- Scaled the pre-softmax logits by `1.1` during training (and then reset after training) to encourage more diverse/creative text generation (ie: increased single-token Entropy).
|
15 |
|
16 |
+
**NOTE**: For the `command-r` models, we can use the `logit_scale` parameter to do this scaling:
|
17 |
|
18 |
```json
|
19 |
"logit_scale": 0.06875,
|