AgaMiko commited on
Commit
611d481
·
1 Parent(s): b3032a6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -24,6 +24,9 @@ TRURL 2 is a collection of fine-tuned generative text models with 7 billion and
24
 
25
  This is the repository for the 7b fine-tuned QUANTIZED model 8-bit, optimized for dialogue use cases.
26
  Quantization results in a significantly smaller and faster model at a cost of slightly (or sometimes considerably) worse results, depending on the size reduction and provided input.
 
 
 
27
  If you need a full version check it here:
28
  * [TRURL 13b](https://huggingface.co/Voicelab/trurl-2-13b/)
29
  * [TRURL 7b](https://huggingface.co/Voicelab/trurl-2-7b/)
 
24
 
25
  This is the repository for the 7b fine-tuned QUANTIZED model 8-bit, optimized for dialogue use cases.
26
  Quantization results in a significantly smaller and faster model at a cost of slightly (or sometimes considerably) worse results, depending on the size reduction and provided input.
27
+
28
+ This models takes around 8Gb of GPU RAM.
29
+
30
  If you need a full version check it here:
31
  * [TRURL 13b](https://huggingface.co/Voicelab/trurl-2-13b/)
32
  * [TRURL 7b](https://huggingface.co/Voicelab/trurl-2-7b/)