Update README.md
Browse files
README.md
CHANGED
|
@@ -520,17 +520,6 @@ $ cargo run --example t5 --release -- \
|
|
| 520 |
--decode --temperature 0
|
| 521 |
```
|
| 522 |
|
| 523 |
-
We also provide a quantized model (1.65 GB vs the original 11.8 GB file):
|
| 524 |
-
|
| 525 |
-
```
|
| 526 |
-
cargo run --example quantized-t5 --release -- \
|
| 527 |
-
--model-id "jbochi/madlad400-7b-mt-bt" --weight-file "model-q4k.gguf" \
|
| 528 |
-
--prompt "<2de> How are you, my friend?" \
|
| 529 |
-
--temperature 0
|
| 530 |
-
...
|
| 531 |
-
Wie geht es dir, mein Freund?
|
| 532 |
-
```
|
| 533 |
-
|
| 534 |
</details>
|
| 535 |
|
| 536 |
|
|
|
|
| 520 |
--decode --temperature 0
|
| 521 |
```
|
| 522 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 523 |
</details>
|
| 524 |
|
| 525 |
|