Text Generation
Transformers
Safetensors
English
mistral
conversational
text-generation-inference
Inference Endpoints
6-bit
exl2
Statuo commited on
Commit
6f80f99
·
verified ·
1 Parent(s): dffac65

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -8,6 +8,15 @@ datasets:
8
  - nothingiisreal/Reddit-Dirty-And-WritingPrompts
9
  license: apache-2.0
10
  ---
 
 
 
 
 
 
 
 
 
11
 
12
  <style>
13
  h1, h2, h3, h4, h5, h6 {
 
8
  - nothingiisreal/Reddit-Dirty-And-WritingPrompts
9
  license: apache-2.0
10
  ---
11
+ Not much to say here. I waited on this one like I did with NemoMix because I got the vibe of constant updates meaning it was pointless to tie my PC up for hours just to quant something that would have a new update the next day.
12
+ <br>
13
+
14
+ [This is the EXL2 6bpw Quant of Celeste v1.9. Find the original model here](https://huggingface.co/nothingiisreal/MN-12B-Celeste-V1.9)
15
+ <br>
16
+ [Find the 8bpw Quant here](https://huggingface.co/Statuo/Celeste-v1.9-8bpw-EXL2)
17
+ <br>
18
+ [Find the 4bpw Quant here](https://huggingface.co/Statuo/Celeste-v1.9-4bpw-EXL2)
19
+ <br>
20
 
21
  <style>
22
  h1, h2, h3, h4, h5, h6 {