Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
TheBloke
/
Nous-Hermes-2-Yi-34B-GGUF
like
41
Transformers
GGUF
English
yi
instruct
finetune
chatml
gpt4
synthetic data
distillation
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
a1108c2
Nous-Hermes-2-Yi-34B-GGUF
1 contributor
History:
15 commits
TheBloke
Upload README.md
a1108c2
10 months ago
.gitattributes
Safe
2.34 kB
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
README.md
Safe
29.4 kB
Upload README.md
10 months ago
config.json
Safe
26 Bytes
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q2_K.gguf
Safe
14.6 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q3_K_L.gguf
Safe
18.1 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q3_K_M.gguf
Safe
16.6 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q3_K_S.gguf
Safe
15 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q4_0.gguf
Safe
19.5 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q4_K_M.gguf
Safe
20.7 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q4_K_S.gguf
Safe
19.5 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q5_0.gguf
Safe
23.7 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q5_K_M.gguf
Safe
24.3 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q5_K_S.gguf
Safe
23.7 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q6_K.gguf
Safe
28.2 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago
nous-hermes-2-yi-34b.Q8_0.gguf
Safe
36.5 GB
LFS
GGUF model commit (made with llama.cpp commit a206137)
10 months ago