Update README.md
Browse files
README.md
CHANGED
@@ -24,6 +24,9 @@ TRURL 2 is a collection of fine-tuned generative text models with 7 billion and
|
|
24 |
|
25 |
This is the repository for the 7b fine-tuned QUANTIZED model 8-bit, optimized for dialogue use cases.
|
26 |
Quantization results in a significantly smaller and faster model at a cost of slightly (or sometimes considerably) worse results, depending on the size reduction and provided input.
|
|
|
|
|
|
|
27 |
If you need a full version check it here:
|
28 |
* [TRURL 13b](https://huggingface.co/Voicelab/trurl-2-13b/)
|
29 |
* [TRURL 7b](https://huggingface.co/Voicelab/trurl-2-7b/)
|
|
|
24 |
|
25 |
This is the repository for the 7b fine-tuned QUANTIZED model 8-bit, optimized for dialogue use cases.
|
26 |
Quantization results in a significantly smaller and faster model at a cost of slightly (or sometimes considerably) worse results, depending on the size reduction and provided input.
|
27 |
+
|
28 |
+
This models takes around 8Gb of GPU RAM.
|
29 |
+
|
30 |
If you need a full version check it here:
|
31 |
* [TRURL 13b](https://huggingface.co/Voicelab/trurl-2-13b/)
|
32 |
* [TRURL 7b](https://huggingface.co/Voicelab/trurl-2-7b/)
|