Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
dolphin-mistral-instruct-7b-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
caee832
dolphin-mistral-instruct-7b-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
f08cf607574faed3aa0e1b76a3b00094699f571cfe0dea9a66644996fa18995c
caee832
verified
5 months ago
.gitattributes
2.27 kB
ac4068cfec0937dc2ef3dd2c05d0f37eb9be1381ac86903d67be4e876c3fa9ea
5 months ago
README.md
3.41 kB
f08cf607574faed3aa0e1b76a3b00094699f571cfe0dea9a66644996fa18995c
5 months ago
dolphin-mistral-instruct-7b.Q2_K.gguf
2.72 GB
LFS
7971671c93713f21ce24e9e92100a96b3d561854ed7b539b15c4e2643905d913
5 months ago
dolphin-mistral-instruct-7b.Q3_K_L.gguf
3.82 GB
LFS
e578825e126bd38e519ac293c368f92ccbe2dc6ee9227f960798bca549fcdecd
5 months ago
dolphin-mistral-instruct-7b.Q3_K_M.gguf
3.52 GB
LFS
5eeb98dc395dbf95d39d6e3eaf84d6ac486c0a2403802b19ce0b8811cec9f140
5 months ago
dolphin-mistral-instruct-7b.Q3_K_S.gguf
3.16 GB
LFS
93a0f733e80508b7e04cf7ea0fdcf9948ec18218049bcce208e38eb8c55aa194
5 months ago
dolphin-mistral-instruct-7b.Q4_K_M.gguf
4.37 GB
LFS
d0d17af90ac654262d6daa27fe09326c4a78ba3c04a782bede4ada491618a7f7
5 months ago
dolphin-mistral-instruct-7b.Q4_K_S.gguf
4.14 GB
LFS
c3a1df7b5fbba6a8f2058cf21fbdc34dfdc804a79c862315aedf371c0f9fe3a2
5 months ago
dolphin-mistral-instruct-7b.Q5_K_M.gguf
5.13 GB
LFS
add4a213fd74d6397bdb705f7e70e7dd167c7488a66169759793208a8b87009e
5 months ago
dolphin-mistral-instruct-7b.Q5_K_S.gguf
5 GB
LFS
2fa58bf313a441c150fd659d4b626bcbd076d29753c1fc8d0d79b796f317054f
5 months ago
dolphin-mistral-instruct-7b.Q6_K.gguf
5.94 GB
LFS
d847ccf637732c6f0ac768180797e9e8139493562d85d252b75055f21e3e3981
5 months ago
dolphin-mistral-instruct-7b.Q8_0.gguf
7.7 GB
LFS
ac4068cfec0937dc2ef3dd2c05d0f37eb9be1381ac86903d67be4e876c3fa9ea
5 months ago
