Hugging Face's logo

l3utterfly
/
Llama-3.1-8B-Stheno-v3.4-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
aadd0cd
·
1 Parent(s): 40352b4

Add quantised GGUF files

Browse files
Files changed (9) hide show
  1. .gitattributes +1 -0
  2. Llama-3.1-8B-Stheno-v3.4-Q2_K.gguf +3 -0
  3. Llama-3.1-8B-Stheno-v3.4-Q4_0_4_4.gguf +3 -0
  4. Llama-3.1-8B-Stheno-v3.4-Q4_0_4_8.gguf +3 -0
  5. Llama-3.1-8B-Stheno-v3.4-Q4_0_8_8.gguf +3 -0
  6. Llama-3.1-8B-Stheno-v3.4-Q4_K_M.gguf +3 -0
  7. Llama-3.1-8B-Stheno-v3.4-Q6_K.gguf +3 -0
  8. Llama-3.1-8B-Stheno-v3.4-Q8_0.gguf +3 -0
  9. Llama-3.1-8B-Stheno-v3.4-f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Stheno-v3.4-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19f33f52b62a90f7c08c7adeaaca11c51c447c8a848072f0c3a6fdfdcfcef860
3
+ size 3179132128
Llama-3.1-8B-Stheno-v3.4-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:acdea104f45d140f7191cc424588c3bb55efbe33d3eb8959ef9bf76f18885650
3
+ size 4661212384
Llama-3.1-8B-Stheno-v3.4-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:383e654a41b630910b2674b00b302a0039054978375951d57a3772d61f5d26c0
3
+ size 4661212384
Llama-3.1-8B-Stheno-v3.4-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a606d66de1539aa0e70559c6c082b3428f72c6bcfb8a007914ab5a8b0c3ec2e8
3
+ size 4661212384
Llama-3.1-8B-Stheno-v3.4-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6387dc66ee56189224327aa169160c7721b2f94e651b2cf6373bdb893d67e2c
3
+ size 4920734944
Llama-3.1-8B-Stheno-v3.4-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49d2b3d9c23da56ec520df32fd4e6b95eb8fa10b220531456990f58ece1f7417
3
+ size 6596007136
Llama-3.1-8B-Stheno-v3.4-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f5621a3f1aac7d0a57b3ba0b683a536c09ac181bfcaed174553dd200c360aef
3
+ size 8540771552
Llama-3.1-8B-Stheno-v3.4-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:407a74c4b2f45a7673af6118ab60868514ac8664641468f42417cd64416b2959
3
+ size 16068891872