Hugging Face's logo

legraphista
/
granite-20b-code-instruct-IMat-GGUF

Text Generation
GGUF
code
granite
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
Eval Results
conversational
Model card Files Community
legraphista commited on
Commit
6f08264
•
1 Parent(s): e9c8eea

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -254,7 +254,7 @@ Link: [here](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-G
254
  | [granite-20b-code-instruct.Q6_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q6_K.gguf) | Q6_K | 16.63GB | ✅ Available | ⚪ Static | 📦 No
255
  | [granite-20b-code-instruct.Q4_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q4_K.gguf) | Q4_K | 12.82GB | ✅ Available | 🟢 IMatrix | 📦 No
256
  | [granite-20b-code-instruct.Q3_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q3_K.gguf) | Q3_K | 10.57GB | ✅ Available | 🟢 IMatrix | 📦 No
257
- | granite-20b-code-instruct.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
258
 
259
 
260
  ### All Quants
@@ -277,7 +277,7 @@ Link: [here](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-G
277
  | granite-20b-code-instruct.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 IMatrix | -
278
  | granite-20b-code-instruct.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟢 IMatrix | -
279
  | granite-20b-code-instruct.IQ3_XXS | IQ3_XXS | - | ⏳ Processing | 🟢 IMatrix | -
280
- | granite-20b-code-instruct.Q2_K | Q2_K | - | ⏳ Processing | 🟢 IMatrix | -
281
  | granite-20b-code-instruct.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -
282
  | granite-20b-code-instruct.IQ2_M | IQ2_M | - | ⏳ Processing | 🟢 IMatrix | -
283
  | granite-20b-code-instruct.IQ2_S | IQ2_S | - | ⏳ Processing | 🟢 IMatrix | -
 
254
  | [granite-20b-code-instruct.Q6_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q6_K.gguf) | Q6_K | 16.63GB | ✅ Available | ⚪ Static | 📦 No
255
  | [granite-20b-code-instruct.Q4_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q4_K.gguf) | Q4_K | 12.82GB | ✅ Available | 🟢 IMatrix | 📦 No
256
  | [granite-20b-code-instruct.Q3_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q3_K.gguf) | Q3_K | 10.57GB | ✅ Available | 🟢 IMatrix | 📦 No
257
+ | [granite-20b-code-instruct.Q2_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q2_K.gguf) | Q2_K | 7.93GB | ✅ Available | 🟢 IMatrix | 📦 No
258
 
259
 
260
  ### All Quants
 
277
  | granite-20b-code-instruct.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 IMatrix | -
278
  | granite-20b-code-instruct.IQ3_XS | IQ3_XS | - | ⏳ Processing | 🟢 IMatrix | -
279
  | granite-20b-code-instruct.IQ3_XXS | IQ3_XXS | - | ⏳ Processing | 🟢 IMatrix | -
280
+ | [granite-20b-code-instruct.Q2_K.gguf](https://huggingface.co/legraphista/granite-20b-code-instruct-IMat-GGUF/blob/main/granite-20b-code-instruct.Q2_K.gguf) | Q2_K | 7.93GB | ✅ Available | 🟢 IMatrix | 📦 No
281
  | granite-20b-code-instruct.Q2_K_S | Q2_K_S | - | ⏳ Processing | 🟢 IMatrix | -
282
  | granite-20b-code-instruct.IQ2_M | IQ2_M | - | ⏳ Processing | 🟢 IMatrix | -
283
  | granite-20b-code-instruct.IQ2_S | IQ2_S | - | ⏳ Processing | 🟢 IMatrix | -