Hugging Face's logo

Khetterman
/
DarkAtom-12B-v3-GGUF

Text Generation
Transformers
GGUF
English
Russian
mergekit
Merge
12b
chat
creative
roleplay
conversational
creative-writing
Not-For-All-Audiences
Inference Endpoints
Model card Files Community
Khetterman commited on
Commit
52c2a04
·
verified ·
1 Parent(s): 4c3ae2d

Update README.md

Browse files

![DarkAtomQuantizedLogo256.png](https://cdn-uploads.huggingface.co/production/uploads/673125091920e70ac26c8a2e/qNveivDE4fSDFBaABfPjt.png)

Files changed (1) hide show
  1. README.md +17 -5
README.md CHANGED
@@ -18,6 +18,9 @@ language:
18
 
19
  ---
20
  # DarkAtom-12B-v3 GGUF Quantizations 🗲
 
 
 
21
 
22
  This model was converted to GGUF format using [llama.cpp](https://github.com/ggerganov/llama.cpp).
23
 
@@ -25,10 +28,19 @@ For more information of the model, see the original model card: [Khetterman/Dark
25
 
26
  ## Available Quantizations (◕‿◕)
27
 
28
- | Type | Quantized GGUF Model | Size |
29
- |------|----------------------|------|
30
- | Q4_0 | [Khetterman/DarkAtom-12B-v3-Q4_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_0.gguf) | 6.58 GB |
31
- | Q6_K | [Khetterman/DarkAtom-12B-v3-Q6_K.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q6_K.gguf) | 9.36 GB |
32
- | Q8_0 | [Khetterman/DarkAtom-12B-v3-Q8_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q8_0.gguf) | 12.1 GB |
 
 
 
 
 
 
 
 
 
33
 
34
  Have a good time 🖤
 
18
 
19
  ---
20
  # DarkAtom-12B-v3 GGUF Quantizations 🗲
21
+ *Something that shouldn't exist*
22
+
23
+ ![DarkAtomQuantizedLogo256.png](https://cdn-uploads.huggingface.co/production/uploads/673125091920e70ac26c8a2e/qNveivDE4fSDFBaABfPjt.png)
24
 
25
  This model was converted to GGUF format using [llama.cpp](https://github.com/ggerganov/llama.cpp).
26
 
 
28
 
29
  ## Available Quantizations (◕‿◕)
30
 
31
+ | Type | Quantized GGUF Model | Size |
32
+ |--------|----------------------|------|
33
+ | Q2_K | [Khetterman/DarkAtom-12B-v3-Q2_K.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q2_K.gguf) | 4.46 GiB |
34
+ | Q3_K_S | [Khetterman/DarkAtom-12B-v3-Q3_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_S.gguf) | 5.15 GiB |
35
+ | Q3_K_M | [Khetterman/DarkAtom-12B-v3-Q3_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_M.gguf) | 5.66 GiB |
36
+ | Q3_K_L | [Khetterman/DarkAtom-12B-v3-Q3_K_L.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_L.gguf) | 6.11 GiB |
37
+ | Q4_0 | [Khetterman/DarkAtom-12B-v3-Q4_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_0.gguf) | 6.58 GiB |
38
+ | Q4_K_S | [Khetterman/DarkAtom-12B-v3-Q4_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_K_S.gguf) | 6.63 GiB |
39
+ | Q4_K_M | [Khetterman/DarkAtom-12B-v3-Q4_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_K_M.gguf) | 6.96 GiB |
40
+ | Q4_1 | [Khetterman/DarkAtom-12B-v3-Q4_1.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_1.gguf) | 7.25 GiB |
41
+ | Q5_K_S | [Khetterman/DarkAtom-12B-v3-Q5_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q5_K_S.gguf) | 7.93 GiB |
42
+ | Q5_K_M | [Khetterman/DarkAtom-12B-v3-Q5_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q5_K_M.gguf) | 8.12 GiB |
43
+ | Q6_K | [Khetterman/DarkAtom-12B-v3-Q6_K.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q6_K.gguf) | 9.36 GiB |
44
+ | Q8_0 | [Khetterman/DarkAtom-12B-v3-Q8_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q8_0.gguf) | 12.1 GiB |
45
 
46
  Have a good time 🖤