Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-14B-Instruct-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
95024d3
Qwen2.5-14B-Instruct-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
1d1150edbb106c67fad07beb8d37e9579fbdb8926bac5ac2db9250af34f9adbf
95024d3
verified
2 months ago
.gitattributes
2.55 kB
1d1150edbb106c67fad07beb8d37e9579fbdb8926bac5ac2db9250af34f9adbf
2 months ago
Qwen2.5-14B-Instruct.IQ1_M.gguf
3.87 GB
LFS
58921dce9808db69c818cd7ef2253c92511b450bfb753a7429c463ced1ab6ad1
2 months ago
Qwen2.5-14B-Instruct.IQ1_S.gguf
3.61 GB
LFS
0fc28181d54f0c7a46c386019e0d243ca13e6c1a8cfa1176e31fb88c0bc0c66e
2 months ago
Qwen2.5-14B-Instruct.IQ2_XS.gguf
4.7 GB
LFS
440e7af9efadc0cae9aaea3a2b2d2437d81f0da04f89c9daea4fa9c4ff0768f7
2 months ago
Qwen2.5-14B-Instruct.IQ3_XS.gguf
6.38 GB
LFS
7c190992f9dfd49b8c22e7fbe87faadf151c9c81a6a55d6d04c3cd6c9c1e272d
2 months ago
Qwen2.5-14B-Instruct.IQ4_XS.gguf
8.12 GB
LFS
08d5eb66889a053a86a0e0fc5d4502660cfbbc0536a0e9c46e8fb409dbe26f34
2 months ago
Qwen2.5-14B-Instruct.Q2_K.gguf
5.77 GB
LFS
bd8d0650ee7da4375206c40ed1d9c545eb0628a84e5e67d5a3cc2c47ed338aa5
2 months ago
Qwen2.5-14B-Instruct.Q3_K_L.gguf
7.92 GB
LFS
5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3
2 months ago
Qwen2.5-14B-Instruct.Q3_K_M.gguf
7.34 GB
LFS
df55af329e2942fc594678c12825bf9b10f89fc71dfe7976df0d65bd7a777c12
2 months ago
Qwen2.5-14B-Instruct.Q3_K_S.gguf
6.66 GB
LFS
761d84ba2805fb01959fc61401bc125f9fcc1c50dfb81e95f102baffbcc21208
2 months ago
Qwen2.5-14B-Instruct.Q4_K_M.gguf
8.99 GB
LFS
ef1aee639c192b832c0e596f416082d3e1e942d26fbae89df3b85ebc8896a691
2 months ago
Qwen2.5-14B-Instruct.Q4_K_S.gguf
8.57 GB
LFS
bbb61fb1b9abf4297b0f1210caa30b467ba6ead6e735c6b81c129d714ea34eee
2 months ago
Qwen2.5-14B-Instruct.Q5_K_M.gguf
10.5 GB
LFS
aa10533090e7cbb3596037b9ebd1fb8b714edd625e31fce094a7b04cc91fa24b
2 months ago
Qwen2.5-14B-Instruct.Q5_K_S.gguf
10.3 GB
LFS
e89a01b26463adff4fdfb12196d54324d69d1b82b5ef01fdd93c7d3137a85273
2 months ago
Qwen2.5-14B-Instruct.Q6_K.gguf
12.1 GB
LFS
a495a4b1f1cc828c434e6d5cf19b7745f200368646364da4c7d5fbe64b9bde4f
2 months ago
Qwen2.5-14B-Instruct.Q8_0.gguf
15.7 GB
LFS
1d1150edbb106c67fad07beb8d37e9579fbdb8926bac5ac2db9250af34f9adbf
2 months ago
