Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.9-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Llama-3-8B-Instruct-v0.9-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
e293a6c51cd3d66becb20b0975ace17ab20a0ea8bc53b26ad07ea7bcef9b12e0
196bc1e
verified
about 1 month ago
.gitattributes
2.73 kB
e293a6c51cd3d66becb20b0975ace17ab20a0ea8bc53b26ad07ea7bcef9b12e0
about 1 month ago
Llama-3-8B-Instruct-v0.9.IQ1_M.gguf
2.16 GB
LFS
8ef7f5017d66af671e1d702e23ce05a96aeb5b81d60a267570aed963edcc550d
about 1 month ago
Llama-3-8B-Instruct-v0.9.IQ1_S.gguf
2.02 GB
LFS
e293a6c51cd3d66becb20b0975ace17ab20a0ea8bc53b26ad07ea7bcef9b12e0
about 1 month ago
Llama-3-8B-Instruct-v0.9.IQ2_XS.gguf
2.61 GB
LFS
586a586a2233bc35020f0b191235efeabcd323baf0d0c29d690edf52eb167b37
about 1 month ago
Llama-3-8B-Instruct-v0.9.IQ3_XS.gguf
3.52 GB
LFS
f7aacdbbe6363b034211e76138b8757c6d86cff2b8ab158407a20bff4db23292
about 1 month ago
Llama-3-8B-Instruct-v0.9.IQ4_XS.gguf
4.45 GB
LFS
05202e68ad15b42727abc0acb2cff349bd3b8da08ad864329c5002fb3b9b69e0
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q2_K.gguf
3.18 GB
LFS
20b7bb558706a8189750ccb594ca3d26f415b52bb33ce1313d8f194c85baa6e9
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q3_K_L.gguf
4.32 GB
LFS
dbd722ff8d77984ebf9a4b90daa15a6dd783e9fdb100519988cfeed0ecec45d3
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q3_K_M.gguf
4.02 GB
LFS
c4b7418849fb03a1209fd873a33778af6c447ae0fe4488f5fb248175dc7edf4e
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q3_K_S.gguf
3.66 GB
LFS
7e99768172d18a57a0b17a23898101a46c452448c0c130267083534bb77b0289
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q4_K_M.gguf
4.92 GB
LFS
60613fde9fec137ec639e148668e4f7446f3d029c886be6a63bc1ef37160d3d0
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q4_K_S.gguf
4.69 GB
LFS
c3f5da97c2b85362c2060fd445e797975d458b30e53ceb7ac6f030f4d7086f93
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q5_K_M.gguf
5.73 GB
LFS
5e065e749ea489812ef2e09352c98d5d4c4deaf85aea1aa65ff6acfc79119b42
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q5_K_S.gguf
5.6 GB
LFS
783d6f34e2faa67d1b227d5757b93e6c0055dd3e6d9e693a3b93a8f605873608
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q6_K.gguf
6.6 GB
LFS
c5acf2973a4c246fdd9030ed29a176a7d66213469eb9d69b7b1a032e98b052a4
about 1 month ago
Llama-3-8B-Instruct-v0.9.Q8_0.gguf
8.54 GB
LFS
2c66938ae7f9584ed24423907556ff35f99d71c685ef84b2089090570f376039
about 1 month ago
Llama-3-8B-Instruct-v0.9.fp16.gguf
16.1 GB
LFS
9fc9aa7f02d4e628cc6092304c67890bb9e2164ff7927dc4b510ebbdb4c6193b
about 1 month ago
README.md
3.08 kB
e293a6c51cd3d66becb20b0975ace17ab20a0ea8bc53b26ad07ea7bcef9b12e0
about 1 month ago
imatrix.dat
4.99 MB
LFS
e293a6c51cd3d66becb20b0975ace17ab20a0ea8bc53b26ad07ea7bcef9b12e0
about 1 month ago
