Hugging Face's logo

BeaverAI
/
Toaster-2.4B-v1b-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
TheDrummer commited on
Commit
d2f76be
•
1 Parent(s): 57b730e

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Toaster-2.4B-v1b-BF16.gguf +3 -0
  3. Toaster-2.4B-v1b-Q2_K.gguf +3 -0
  4. Toaster-2.4B-v1b-Q3_K_M.gguf +3 -0
  5. Toaster-2.4B-v1b-Q4_K_M.gguf +3 -0
  6. Toaster-2.4B-v1b-Q5_K_M.gguf +3 -0
  7. Toaster-2.4B-v1b-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Toaster-2.4B-v1b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Toaster-2.4B-v1b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Toaster-2.4B-v1b-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Toaster-2.4B-v1b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Toaster-2.4B-v1b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Toaster-2.4B-v1b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Toaster-2.4B-v1b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Toaster-2.4B-v1b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Toaster-2.4B-v1b-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93624ddb5d804582983fbe893fa8d506548d40278ef26f4d6cd76b29f55c8c88
3
+ size 4815165920
Toaster-2.4B-v1b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06d802fa0a26d7ec606118ff20ab619c314997fb90075fcaf2f70c432fb7d5a3
3
+ size 1010442720
Toaster-2.4B-v1b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8ea6e71762e151b4a9d15ba8fcb117b0f55708b3855934f98a29b0d4b4fd696
3
+ size 1249152480
Toaster-2.4B-v1b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:debfe919bfc90e1454b11b5f6de881046b053f7a62c66fc786b01489291b86bd
3
+ size 1497462240
Toaster-2.4B-v1b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f10ffff1d1c2b5ae1e6a9a248ebb33356b261192a569667309250e5ff07625f
3
+ size 1730360800
Toaster-2.4B-v1b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ef1099eb276404c753172aa212a341de8a5132f608af6a1521f81e7cfd46b5
3
+ size 1977815520