Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.5-GGUF
like
4
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
llama-3
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
71a8023
Llama-3-8B-Instruct-v0.5-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
29bb70a2f11a1e4fcd38fc54a8389934b440e622828c72359b9007949aeb42b7
71a8023
verified
3 months ago
.gitattributes
2.24 kB
29bb70a2f11a1e4fcd38fc54a8389934b440e622828c72359b9007949aeb42b7
3 months ago
Llama-3-8B-Instruct-v0.5.Q2_K.gguf
3.18 GB
LFS
304cc377d429baa4cd88e82d5c27bf80858e785f2342d5f6778d914f5ba38058
3 months ago
Llama-3-8B-Instruct-v0.5.Q3_K_L.gguf
4.32 GB
LFS
42712c5a9fee32971bdab514233f52c66ac7dd3c9264a2cea9e193e9857c36bb
3 months ago
Llama-3-8B-Instruct-v0.5.Q3_K_M.gguf
4.02 GB
LFS
f0a2fdefca88b00b7a35672fab653ab81b072eb116812fbb42866ddddcb23f1e
3 months ago
Llama-3-8B-Instruct-v0.5.Q3_K_S.gguf
3.66 GB
LFS
b7a80ed1d1a3afdf1f21bb5b42752454cd53fd6885c0663ee863ebbc5165b208
3 months ago
Llama-3-8B-Instruct-v0.5.Q4_K_M.gguf
4.92 GB
LFS
a90421ae6ab2e2bae46c9f8bfb4aca0feee0adbee82689b56e2380db429b5ea7
3 months ago
Llama-3-8B-Instruct-v0.5.Q4_K_S.gguf
4.69 GB
LFS
eeac7b2ba91a66672ce554523bc884eaa4af48a03ce0767d049bf1e013b19afb
3 months ago
Llama-3-8B-Instruct-v0.5.Q5_K_M.gguf
5.73 GB
LFS
7b4a70ec85c0fd94e6652d5158c82312f01d00c4354ad0e67e1964388610700a
3 months ago
Llama-3-8B-Instruct-v0.5.Q5_K_S.gguf
5.6 GB
LFS
9e215acdd49672df91c098435f39e7a2750a435be8c337a07b2f7604d31694e2
3 months ago
Llama-3-8B-Instruct-v0.5.Q6_K.gguf
6.6 GB
LFS
068857e2164eee9fd86f9d8ef3627ef081aae43a9bf92a59d4a78c982bd3b610
3 months ago
Llama-3-8B-Instruct-v0.5.Q8_0.gguf
8.54 GB
LFS
29bb70a2f11a1e4fcd38fc54a8389934b440e622828c72359b9007949aeb42b7
3 months ago
