legraphista
commited on
Commit
•
250612f
1
Parent(s):
60417a3
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -18,6 +18,7 @@ tags:
|
|
18 |
- imat
|
19 |
- imatrix
|
20 |
- static
|
|
|
21 |
- 8bit
|
22 |
- 6bit
|
23 |
- 5bit
|
@@ -68,6 +69,8 @@ Link: [here](https://huggingface.co/legraphista/datagemma-rig-27b-it-IMat-GGUF/b
|
|
68 |
### All Quants
|
69 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
70 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
|
|
|
|
71 |
| datagemma-rig-27b-it.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
|
72 |
| [datagemma-rig-27b-it.Q6_K.gguf](https://huggingface.co/legraphista/datagemma-rig-27b-it-IMat-GGUF/blob/main/datagemma-rig-27b-it.Q6_K.gguf) | Q6_K | 22.34GB | ✅ Available | ⚪ Static | 📦 No
|
73 |
| datagemma-rig-27b-it.Q5_K | Q5_K | - | ⏳ Processing | ⚪ Static | -
|
|
|
18 |
- imat
|
19 |
- imatrix
|
20 |
- static
|
21 |
+
- 16bit
|
22 |
- 8bit
|
23 |
- 6bit
|
24 |
- 5bit
|
|
|
69 |
### All Quants
|
70 |
| Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
|
71 |
| -------- | ---------- | --------- | ------ | ------------ | -------- |
|
72 |
+
| datagemma-rig-27b-it.BF16 | BF16 | - | ⏳ Processing | ⚪ Static | -
|
73 |
+
| datagemma-rig-27b-it.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
|
74 |
| datagemma-rig-27b-it.Q8_0 | Q8_0 | - | ⏳ Processing | ⚪ Static | -
|
75 |
| [datagemma-rig-27b-it.Q6_K.gguf](https://huggingface.co/legraphista/datagemma-rig-27b-it-IMat-GGUF/blob/main/datagemma-rig-27b-it.Q6_K.gguf) | Q6_K | 22.34GB | ✅ Available | ⚪ Static | 📦 No
|
76 |
| datagemma-rig-27b-it.Q5_K | Q5_K | - | ⏳ Processing | ⚪ Static | -
|