mradermacher
commited on
Commit
•
351ec2a
1
Parent(s):
a4cc012
auto-patch README.md
Browse files
README.md
CHANGED
@@ -45,7 +45,6 @@ more details, including on how to concatenate multi-part files.
|
|
45 |
| [GGUF](https://huggingface.co/mradermacher/HyouKan-3x7B-V2-32k-GGUF/resolve/main/HyouKan-3x7B-V2-32k.Q6_K.gguf) | Q6_K | 15.4 | very good quality |
|
46 |
| [GGUF](https://huggingface.co/mradermacher/HyouKan-3x7B-V2-32k-GGUF/resolve/main/HyouKan-3x7B-V2-32k.Q8_0.gguf) | Q8_0 | 19.9 | fast, best quality |
|
47 |
|
48 |
-
|
49 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
50 |
types (lower is better):
|
51 |
|
|
|
45 |
| [GGUF](https://huggingface.co/mradermacher/HyouKan-3x7B-V2-32k-GGUF/resolve/main/HyouKan-3x7B-V2-32k.Q6_K.gguf) | Q6_K | 15.4 | very good quality |
|
46 |
| [GGUF](https://huggingface.co/mradermacher/HyouKan-3x7B-V2-32k-GGUF/resolve/main/HyouKan-3x7B-V2-32k.Q8_0.gguf) | Q8_0 | 19.9 | fast, best quality |
|
47 |
|
|
|
48 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
49 |
types (lower is better):
|
50 |
|