Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama3.1-8B-Chinese-Chat-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
a154eab
Llama3.1-8B-Chinese-Chat-GGUF
1 contributor
History:
16 commits
MaziyarPanahi
eb9e67ea8b3e5fc4692591b3a5e09a2866c6c6999546e58868d6390f71326aa6
a154eab
verified
about 1 month ago
.gitattributes
2.61 kB
eb9e67ea8b3e5fc4692591b3a5e09a2866c6c6999546e58868d6390f71326aa6
about 1 month ago
Llama3.1-8B-Chinese-Chat.IQ1_M.gguf
2.16 GB
LFS
63b0efee153bc79b9d42021d8707af6a71543f6f193edac6c024470a037ef117
about 1 month ago
Llama3.1-8B-Chinese-Chat.IQ2_XS.gguf
2.61 GB
LFS
2f3f2fa18f2b58d3d881353a22aac744f9ba109497f500243802fb97198af8dd
about 1 month ago
Llama3.1-8B-Chinese-Chat.IQ3_XS.gguf
3.52 GB
LFS
d155dd9fae67f3ded4680951beb0e768ee7569694b41529fba765c6e04431d66
about 1 month ago
Llama3.1-8B-Chinese-Chat.IQ4_XS.gguf
4.45 GB
LFS
efc04e52f4e8476eeae700176d0ca8cf83605d28ae607c886bb752d7089457d2
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q2_K.gguf
3.18 GB
LFS
6b43115b03eac0becfb66c9ab66b34089df6450cd76811c8234582607099d468
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q3_K_L.gguf
4.32 GB
LFS
977da4aa54c6afe4ffd3468ceb1a986af7742ac45d7103eb1ca04224cc3c88c7
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q3_K_M.gguf
4.02 GB
LFS
4a4152c48d4b16d6180d2ae526e6b1bbdba5b0e67af273e7a2a43e4fa6491ba5
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q3_K_S.gguf
3.66 GB
LFS
2aa5ae69c506eb459187c68bdad25dc9221fbf78b55a03160bf29c2c9ac58d91
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q4_K_M.gguf
4.92 GB
LFS
e79acb53277f08b41a8c8a867b73e94a3dab99c4b6b5ee5d91d49c6f7a51e5b7
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q4_K_S.gguf
4.69 GB
LFS
29541a6e0712b8893640606f518a1a6e31b8849f22cdc5e848bd819169cf1cfa
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q5_K_M.gguf
5.73 GB
LFS
413543d193d0a497cf58f8b2ff6b8fc2f5e5f5a20337cfa65518c69deb68ef32
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q5_K_S.gguf
5.6 GB
LFS
a76f9199719b6ff437c7341e9320c7707b2ff9c1e3db3b6bdcc0c75586597041
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q6_K.gguf
6.6 GB
LFS
130e1683d3d52a2edc2f4c3971a8905239346bd4cca6814b9018ce3d55251874
about 1 month ago
Llama3.1-8B-Chinese-Chat.Q8_0.gguf
8.54 GB
LFS
efe112dc5be7c5c5d7ab37ddc764d2f3563d0aceb48581667433f12c9ec5f70e
about 1 month ago
Llama3.1-8B-Chinese-Chat.fp16.gguf
16.1 GB
LFS
eb9e67ea8b3e5fc4692591b3a5e09a2866c6c6999546e58868d6390f71326aa6
about 1 month ago
