Hugging Face's logo

Khetterman
/
DarkAtom-12B-v3-GGUF

Text Generation
Transformers
GGUF
English
Russian
mergekit
Merge
12b
chat
creative
roleplay
conversational
creative-writing
Not-For-All-Audiences
Inference Endpoints
Model card Files Community
DarkAtom-12B-v3-GGUF
File size: 2,861 Bytes 
a153af8
 
 
c42ae44
a153af8
867105c
 
 
4f126e5
 
867105c
 
 
 
 
 
 
 
a153af8
 
 
1852b0c
 
52c2a04
 
a153af8
 
 
 
 
 
 
52c2a04
 
 
 
 
 
 
 
 
 
 
 
 
 
a153af8
c42ae44
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
 
---
base_model: Khetterman/DarkAtom-12B-v3
pipeline_tag: text-generation
library_name: transformers
quantized_by: Khetterman
tags:
- mergekit
- merge
- 12b
- chat
- creative
- roleplay
- conversational
- creative-writing
- not-for-all-audiences
language:
- en
- ru

---
# DarkAtom-12B-v3 GGUF Quantizations 🗲

>Something that shouldn't exist.

![DarkAtomQuantizedLogo256.png](https://cdn-uploads.huggingface.co/production/uploads/673125091920e70ac26c8a2e/qNveivDE4fSDFBaABfPjt.png)

This model was converted to GGUF format using [llama.cpp](https://github.com/ggerganov/llama.cpp).

For more information of the model, see the original model card: [Khetterman/DarkAtom-12B-v3](https://huggingface.co/Khetterman/DarkAtom-12B-v3).

## Available Quantizations (◕‿◕) 

|  Type  | Quantized GGUF Model | Size |
|--------|----------------------|------|
| Q2_K   | [Khetterman/DarkAtom-12B-v3-Q2_K.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q2_K.gguf)     | 4.46 GiB |
| Q3_K_S | [Khetterman/DarkAtom-12B-v3-Q3_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_S.gguf) | 5.15 GiB |
| Q3_K_M | [Khetterman/DarkAtom-12B-v3-Q3_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_M.gguf) | 5.66 GiB |
| Q3_K_L | [Khetterman/DarkAtom-12B-v3-Q3_K_L.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q3_K_L.gguf) | 6.11 GiB |
| Q4_0   | [Khetterman/DarkAtom-12B-v3-Q4_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_0.gguf)     | 6.58 GiB |
| Q4_K_S | [Khetterman/DarkAtom-12B-v3-Q4_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_K_S.gguf) | 6.63 GiB |
| Q4_K_M | [Khetterman/DarkAtom-12B-v3-Q4_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_K_M.gguf) | 6.96 GiB |
| Q4_1   | [Khetterman/DarkAtom-12B-v3-Q4_1.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q4_1.gguf)     | 7.25 GiB |
| Q5_K_S | [Khetterman/DarkAtom-12B-v3-Q5_K_S.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q5_K_S.gguf) | 7.93 GiB |
| Q5_K_M | [Khetterman/DarkAtom-12B-v3-Q5_K_M.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q5_K_M.gguf) | 8.12 GiB |
| Q6_K   | [Khetterman/DarkAtom-12B-v3-Q6_K.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q6_K.gguf)     | 9.36 GiB |
| Q8_0   | [Khetterman/DarkAtom-12B-v3-Q8_0.gguf](https://huggingface.co/Khetterman/DarkAtom-12B-v3-GGUF/blob/main/DarkAtom-12B-v3-Q8_0.gguf)     | 12.1 GiB |

>My thanks to the authors of the original models, your work is incredible. Have a good time 🖤