Hugging Face's logo

secretmoon
/
Llama-3-8B-MLP-gguf

Text Generation
Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
secretmoon commited on
Commit
1f0fda1
·
verified ·
1 Parent(s): 2b219c0

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Llama-3-8B-MLP_Q4_K_M.gguf +3 -0
  3. Llama-3-8B-MLP_Q5_K_M.gguf +3 -0
  4. Llama-3-8B-MLP_Q6_K.gguf +3 -0
  5. Llama-3-8B-MLP_Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Llama-3-8B-MLP_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Llama-3-8B-MLP_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Llama-3-8B-MLP_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Llama-3-8B-MLP_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-MLP_Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7efd077be3434d9e77601a7aef4e224a18cd9d97f5caf30606d0ba84cfed4c1
3
+ size 4920734016
Llama-3-8B-MLP_Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aef9f377572dbd98d901b7b930b3110d84fb40859148b97282e74c55a2505a07
3
+ size 5732987200
Llama-3-8B-MLP_Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa83e02b81358e73fa0d6231701fc46710f4a615617c154ffdf18a386aa8dbb1
3
+ size 6596006208
Llama-3-8B-MLP_Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad0f29214dd9b66b83ad768cf91bae546b1abe17da8e9d50685aec61b848d0ce
3
+ size 8540770624