Not-For-All-Audiences

text-generation-inference

Model card Files Files and versions Community

Thespis-Mistral-7B-v0.6-GGUF

1 contributor

History: 28 commits

TheBloke

GGUF model commit (made with llama.cpp commit a6fc554)

c253315 10 months ago

.gitattributes

2.37 kB

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
README.md

19 kB

Upload README.md 10 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago
thespis-mistral-7b-v0.6.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit a6fc554) 10 months ago