l3utterfly
/

WizardLM-2-7B-abliterated-gguf

Inference Endpoints

Model card Files Files and versions Community

WizardLM-2-7B-abliterated-gguf

1 contributor

History: 2 commits

l3utterfly's picture

Add quantised GGUF files

8e64c2a 5 months ago

.gitattributes

1.56 kB

Add quantised GGUF files 5 months ago
README.md

31 Bytes

initial commit 5 months ago
WizardLM-2-7B-abliterated-Q2_K.gguf

2.72 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q4_0_4_4.gguf

4.11 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q4_0_4_8.gguf

4.11 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q4_0_8_8.gguf

4.11 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q4_K_M.gguf

4.37 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q6_K.gguf

5.94 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-Q8_0.gguf

7.7 GB
LFS

Add quantised GGUF files 5 months ago
WizardLM-2-7B-abliterated-f16.gguf

14.5 GB
LFS

Add quantised GGUF files 5 months ago