legraphista
commited on
Commit
β’
7f64b49
1
Parent(s):
e2df34a
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -68,7 +68,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/b
|
|
68 |
### All Quants
|
69 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
70 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
71 |
-
| Qwen2.5-32B-Instruct.BF16 | BF16 |
|
72 |
| Qwen2.5-32B-Instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
73 |
| [Qwen2.5-32B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/blob/main/Qwen2.5-32B-Instruct.Q8_0.gguf) | Q8_0 | 34.82GB | β
Available | βͺ Static | π¦ No
|
74 |
| [Qwen2.5-32B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/blob/main/Qwen2.5-32B-Instruct.Q6_K.gguf) | Q6_K | 26.89GB | β
Available | βͺ Static | π¦ No
|
|
|
68 |
### All Quants
|
69 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
70 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
71 |
+
| [Qwen2.5-32B-Instruct.BF16/*](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/tree/main/Qwen2.5-32B-Instruct.BF16) | BF16 | 65.54GB | β
Available | βͺ Static | β Yes
|
72 |
| Qwen2.5-32B-Instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
73 |
| [Qwen2.5-32B-Instruct.Q8_0.gguf](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/blob/main/Qwen2.5-32B-Instruct.Q8_0.gguf) | Q8_0 | 34.82GB | β
Available | βͺ Static | π¦ No
|
74 |
| [Qwen2.5-32B-Instruct.Q6_K.gguf](https://huggingface.co/legraphista/Qwen2.5-32B-Instruct-IMat-GGUF/blob/main/Qwen2.5-32B-Instruct.Q6_K.gguf) | Q6_K | 26.89GB | β
Available | βͺ Static | π¦ No
|