Update README.md
Browse files
README.md
CHANGED
|
@@ -223,4 +223,16 @@ V5 :
|
|
| 223 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,Thruthful-QA,34.14932681,,817,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 224 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,Winogrande,73.9542,,1267,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 225 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,wikitext,6.2547,512,512,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 226 |
-
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,wikitext,5.2290,4096,4096,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 223 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,Thruthful-QA,34.14932681,,817,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 224 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,Winogrande,73.9542,,1267,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 225 |
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,wikitext,6.2547,512,512,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 226 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf,-,wikitext,5.2290,4096,4096,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 227 |
+
|
| 228 |
+
New quantizations strategies to bundle optimally the last tensor quantizations of Ikawrakow (LlamaCPP b2404 and beyond) and reach the hightest possible quality/size ratio.
|
| 229 |
+
A work in progress.
|
| 230 |
+
Here's one new quant strategy, currently labelled IQ1_FSR, a 3% smaller quant than .IQ1_S v3/v5 with a quality a bit above IQ1_S_v3 but slightly lower than IQ1_S_v5 :
|
| 231 |
+
|
| 232 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,Hellaswag,78.6,1000,,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 233 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,Arc-Challenge,47.49163880,,299,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 234 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,Arc-Easy,70.87719298,,570,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 235 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,MMLU,41.21405751,,313,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 236 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,Thruthful-QA,33.65973072,,817,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 237 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,Winogrande,71.5864,,1267,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|
| 238 |
+
- miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FSR.gguf,-,wikitext,6.5953,512,512,2024-03-13 00:00:00,,70b,Mistral_Medium,32768,,,GGUF,Miqudev,Nexesenex,
|