Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-8B-Instruct-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
mistral
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
conversational
Model card Files Community
20

Upload folder using huggingface_hub

#18
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/18
Discussion Files changed
+15
-15
Files changed (15) hide show
  1. Meta-Llama-3-8B-Instruct.IQ1_M.gguf +1 -1
  2. Meta-Llama-3-8B-Instruct.IQ1_S.gguf +1 -1
  3. Meta-Llama-3-8B-Instruct.IQ2_XS.gguf +1 -1
  4. Meta-Llama-3-8B-Instruct.IQ3_XS.gguf +1 -1
  5. Meta-Llama-3-8B-Instruct.IQ4_XS.gguf +1 -1
  6. Meta-Llama-3-8B-Instruct.Q2_K.gguf +1 -1
  7. Meta-Llama-3-8B-Instruct.Q3_K_L.gguf +1 -1
  8. Meta-Llama-3-8B-Instruct.Q3_K_M.gguf +1 -1
  9. Meta-Llama-3-8B-Instruct.Q3_K_S.gguf +1 -1
  10. Meta-Llama-3-8B-Instruct.Q4_K_M.gguf +1 -1
  11. Meta-Llama-3-8B-Instruct.Q4_K_S.gguf +1 -1
  12. Meta-Llama-3-8B-Instruct.Q5_K_M.gguf +1 -1
  13. Meta-Llama-3-8B-Instruct.Q5_K_S.gguf +1 -1
  14. Meta-Llama-3-8B-Instruct.Q6_K.gguf +1 -1
  15. Meta-Llama-3-8B-Instruct.Q8_0.gguf +1 -1
Meta-Llama-3-8B-Instruct.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:886bf0c6349f932eae9f1e3c686bf16adac5595917d482619cb9b164cac02b7e
3
  size 2162484448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d2b981d2d3ff8b76c40c25b30d16e23683986a81b3fae394979c5f12d8987ac
3
  size 2162484448
Meta-Llama-3-8B-Instruct.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:128dab50191c78d4c6a8a79e5d30ea88f2660f9baa9f04e011f7dbf438928c57
3
  size 2020140256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a35d34a9f9ce5372192bba69f8637df55375ebcbfcba9594edb2a2b8a415b93
3
  size 2020140256
Meta-Llama-3-8B-Instruct.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:218a8653c8d5fa5ad38fbf59130087da043596f40abc35f49339069d5f14adfc
3
  size 2606294240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d994b4285ddac4e00f69e36aacf9a84a7f3f9e6679508c3baecf8a1d35503e10
3
  size 2606294240
Meta-Llama-3-8B-Instruct.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94962d23cce8a147584bd7334963ec3882f92ddc6010525286ab1698beba233b
3
  size 3519259872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62fbd5cba536b03e45dc82a78fc9ac33c979129a3d386422b127bc7085af8b6
3
  size 3519259872
Meta-Llama-3-8B-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c55043630605bbd95d82976c0de10e61d740338fb25f6ca59b7ba138a42e3ce5
3
  size 4448175328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f38c59ec1abcd428d2c3ab2c9c63798c2aeac5bbdf3e708f4998a69ac50dfba1
3
  size 4448175328
Meta-Llama-3-8B-Instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a564e4020cbaa28faec8f247ab12226eb160e1d6489aa05c35a0cfeb20f902e
3
  size 3179644128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc6f3ac3758ac698bad1cadaf98e6cf0dcf28ea0d7b5111379378882ce7a8be2
3
  size 3179644128
Meta-Llama-3-8B-Instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d70ee06ade813f391aba2e9417044b1702c6aac9b9ba3ec15caf5cf8c7831fc4
3
  size 4322469088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e68e1867c60526f2b4664850a53db1cf469af8e1d0e7fc055c2ed2db7190582b
3
  size 4322469088
Meta-Llama-3-8B-Instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fc9c49f555a50fd528e0b7db6b5d7037de391c520ecc6a1d1cf0b886cb5d75ff
3
  size 4019430624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c48b75dcb6ffda0f1d8225b2313f86860ded09703731a27e8b924faf5b621cb
3
  size 4019430624
Meta-Llama-3-8B-Instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0654ac8e6dcd17b9ba11172c7919c2ff961f1ac62e7c5ac05e1d052925071466
3
  size 3665011936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f79b99ba3f2b666b0527591622a18a4d2a06b186f86ae82d123bfe86bf2d2b80
3
  size 3665011936
Meta-Llama-3-8B-Instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b00210329b64e27072b26a2e04ab2c87bdc7319b4963c3a41f91e1ad5ad13094
3
  size 4921246944
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4903067381e3753e2629f9d20c52df0e43b675bed2735bc3efea351c7d07454d
3
  size 4921246944
Meta-Llama-3-8B-Instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:92402603e7e0caafe93ea529399a24180c904940645b341f041dd7e68199195a
3
  size 4693181664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5eddeeb4b46b88cedf0a30ff3769cbf9167785cbbb4b336aa13347f0c94f1b3c
3
  size 4693181664
Meta-Llama-3-8B-Instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:63083796fd9db7146f26f3f72391ab44cb50d7e7c68e358d0a5518416c388be5
3
  size 5733500128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:740c575a3ceb1f1be4031797feee415db9b0595d88c5a7a18a83d9a1d741dbd7
3
  size 5733500128
Meta-Llama-3-8B-Instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0bfea7a3b0a3e56b90d2c27d42798678f1019d9e35997fb1f7978f5fb31ef5ef
3
  size 5599806688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d183c51c016730d1d3a501a3208c21ea8fc0c5f9856845294faf4819993579b
3
  size 5599806688
Meta-Llama-3-8B-Instruct.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f99b633f92be9d45bb5bc6816dec05fa92dcbf1678520fbc775477e544979d6e
3
  size 6596519136
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2ca99d853de276fb25a13e369a0db2fd3782eff8d28973404ffa5ffca0b9267
3
  size 6596519136
Meta-Llama-3-8B-Instruct.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a663dedd14ce0b19255ec907800e1e15963b7465e8183616623b9e8cb6372f3b
3
  size 8541283552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7efa06c16dc522fe7e6a48e36d17cc42dcadfe581ae1cdf7be9f51734eaf85d
3
  size 8541283552