legraphista
commited on
Commit
β’
791db67
1
Parent(s):
8b837a9
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -251,7 +251,7 @@ Link: [here](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-G
|
|
251 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
252 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
253 |
| granite-20b-code-instruct.Q8_0 | Q8_0 | - | β³ Processing | βͺ Static | -
|
254 |
-
| granite-20b-code-instruct.Q6_K | Q6_K |
|
255 |
| granite-20b-code-instruct.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
256 |
| granite-20b-code-instruct.Q3_K | Q3_K | - | β³ Processing | π’ IMatrix | -
|
257 |
| granite-20b-code-instruct.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
@@ -263,7 +263,7 @@ Link: [here](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-G
|
|
263 |
| granite-20b-code-instruct.BF16 | BF16 | - | β³ Processing | βͺ Static | -
|
264 |
| granite-20b-code-instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
265 |
| granite-20b-code-instruct.Q8_0 | Q8_0 | - | β³ Processing | βͺ Static | -
|
266 |
-
| granite-20b-code-instruct.Q6_K | Q6_K |
|
267 |
| granite-20b-code-instruct.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
268 |
| granite-20b-code-instruct.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|
269 |
| granite-20b-code-instruct.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
|
|
251 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
252 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
253 |
| granite-20b-code-instruct.Q8_0 | Q8_0 | - | β³ Processing | βͺ Static | -
|
254 |
+
| [granite-20b-code-instruct.Q6_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q6_K.gguf) | Q6_K | 16.63GB | β
Available | βͺ Static | π¦ No
|
255 |
| granite-20b-code-instruct.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|
256 |
| granite-20b-code-instruct.Q3_K | Q3_K | - | β³ Processing | π’ IMatrix | -
|
257 |
| granite-20b-code-instruct.Q2_K | Q2_K | - | β³ Processing | π’ IMatrix | -
|
|
|
263 |
| granite-20b-code-instruct.BF16 | BF16 | - | β³ Processing | βͺ Static | -
|
264 |
| granite-20b-code-instruct.FP16 | F16 | - | β³ Processing | βͺ Static | -
|
265 |
| granite-20b-code-instruct.Q8_0 | Q8_0 | - | β³ Processing | βͺ Static | -
|
266 |
+
| [granite-20b-code-instruct.Q6_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q6_K.gguf) | Q6_K | 16.63GB | β
Available | βͺ Static | π¦ No
|
267 |
| granite-20b-code-instruct.Q5_K | Q5_K | - | β³ Processing | βͺ Static | -
|
268 |
| granite-20b-code-instruct.Q5_K_S | Q5_K_S | - | β³ Processing | βͺ Static | -
|
269 |
| granite-20b-code-instruct.Q4_K | Q4_K | - | β³ Processing | π’ IMatrix | -
|