sophosympatheia
commited on
Commit
•
022fd59
1
Parent(s):
855d2d6
Update README.md
Browse filesAdding links to more quants
README.md
CHANGED
@@ -169,6 +169,8 @@ You could also try ChatML.
|
|
169 |
### Quantizations
|
170 |
* [ooooz/midnight-miqu-70b-v1.0-GGUF](https://huggingface.co/ooooz/midnight-miqu-70b-v1.0-GGUF/tree/main) -- Various GGUF quants
|
171 |
* [mradermacher/Midnight-Miqu-70B-v1.0-GGUF](mradermacher/Midnight-Miqu-70B-v1.0-GGUF) -- Q4_K_M quant so far, maybe more to come
|
|
|
|
|
172 |
* If you don't see something you're looking for, [try searching Hugging Face](https://huggingface.co/models?search=midnight-miqu-70b). There may be newer quants available than what I've documented here.
|
173 |
|
174 |
### Licence and usage restrictions
|
|
|
169 |
### Quantizations
|
170 |
* [ooooz/midnight-miqu-70b-v1.0-GGUF](https://huggingface.co/ooooz/midnight-miqu-70b-v1.0-GGUF/tree/main) -- Various GGUF quants
|
171 |
* [mradermacher/Midnight-Miqu-70B-v1.0-GGUF](mradermacher/Midnight-Miqu-70B-v1.0-GGUF) -- Q4_K_M quant so far, maybe more to come
|
172 |
+
* [Kotokin/sophosympatheia_Midnight-Miqu-70B-v1.0_GPTQ32G](https://huggingface.co/Kotokin/sophosympatheia_Midnight-Miqu-70B-v1.0_GPTQ32G) -- 4-bit 32g GPTQ quant
|
173 |
+
* [altomek/Midnight-Miqu-70B-v1.0-3.75bpw-EXL2](https://huggingface.co/altomek/Midnight-Miqu-70B-v1.0-3.75bpw-EXL2) -- 3.75bpw EXL2 quant
|
174 |
* If you don't see something you're looking for, [try searching Hugging Face](https://huggingface.co/models?search=midnight-miqu-70b). There may be newer quants available than what I've documented here.
|
175 |
|
176 |
### Licence and usage restrictions
|