mradermacher
/

Llama-3.2-3B-Instruct-abliterated-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.2-3B-Instruct-abliterated-GGUF

1 contributor

History: 18 commits

mradermacher's picture

auto-patch README.md

49c63ae verified 9 days ago

.gitattributes

2.58 kB

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.IQ4_XS.gguf

2.05 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q2_K.gguf

1.49 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q3_K_L.gguf

1.98 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q3_K_M.gguf

1.86 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q3_K_S.gguf

1.71 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q4_0_4_4.gguf

2.14 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q4_K_M.gguf

2.24 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q4_K_S.gguf

2.15 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q5_K_M.gguf

2.59 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q5_K_S.gguf

2.54 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q6_K.gguf

2.97 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.Q8_0.gguf

3.84 GB
LFS

uploaded from db1 9 days ago
Llama-3.2-3B-Instruct-abliterated.f16.gguf

7.22 GB
LFS

uploaded from db1 9 days ago
README.md

3.88 kB

auto-patch README.md 9 days ago