GGUF model commit (made with llama.cpp commit edd1ab7)

b02204e 10 months ago

.gitattributes

2.09 kB

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
README.md

18.4 kB

Upload README.md 10 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q2_K.gguf

15.6 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q3_K_M.gguf

20.4 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q4_0.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf

26.4 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q5_0.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q5_K_M.gguf

32.2 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q6_K.gguf

38.4 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago
dolphin-2.7-mixtral-8x7b.Q8_0.gguf

49.6 GB
LFS

GGUF model commit (made with llama.cpp commit edd1ab7) 10 months ago