Hugging Face's logo

Lewdiculous
/
llama3-8B-aifeifei-1.0-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
Lewdiculous commited on
Commit
aaeccfe
•
1 Parent(s): 527feef

Quants

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. llama3-8B-aifeifei-1.0-IQ3_XXS-imat.gguf +3 -0
  3. llama3-8B-aifeifei-1.0-IQ4_XS-imat.gguf +3 -0
  4. llama3-8B-aifeifei-1.0-Q4_K_M-imat.gguf +3 -0
  5. llama3-8B-aifeifei-1.0-Q4_K_S-imat.gguf +3 -0
  6. llama3-8B-aifeifei-1.0-Q5_K_M-imat.gguf +3 -0
  7. llama3-8B-aifeifei-1.0-Q5_K_S-imat.gguf +3 -0
  8. llama3-8B-aifeifei-1.0-Q6_K-imat.gguf +3 -0
  9. llama3-8B-aifeifei-1.0-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  llama3-8B-aifeifei-1.0-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  llama3-8B-aifeifei-1.0-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  llama3-8B-aifeifei-1.0-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
  llama3-8B-aifeifei-1.0-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ llama3-8B-aifeifei-1.0-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ llama3-8B-aifeifei-1.0-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ llama3-8B-aifeifei-1.0-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ llama3-8B-aifeifei-1.0-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ llama3-8B-aifeifei-1.0-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ llama3-8B-aifeifei-1.0-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ llama3-8B-aifeifei-1.0-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ llama3-8B-aifeifei-1.0-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
llama3-8B-aifeifei-1.0-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45a4b74cba0f132c930dc7ac62c1401289252f52a3a1de3715575ef1765bfe3c
3
+ size 3274912352
llama3-8B-aifeifei-1.0-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07c80435a6ebaf5c868a6613aa4c85922e2c1ffa1b491ba51c70746858074617
3
+ size 4447662688
llama3-8B-aifeifei-1.0-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bc21be5894c2e252ff938ba908bb702774b7de53daca864d707d41f0f98a833
3
+ size 4920734304
llama3-8B-aifeifei-1.0-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15867a76ddedd1b76de9eebe943d9005bdd88b2923dc80f7a15b864675069881
3
+ size 4692669024
llama3-8B-aifeifei-1.0-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3b0793178298e9c633e866b6bf1a6bb615d4dc815b6c2565bbc59e5113ca5eb
3
+ size 5732987488
llama3-8B-aifeifei-1.0-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34546a491573465c894012307ce86b4109d9271a4fbc0d5d38acd58d9df40afb
3
+ size 5599294048
llama3-8B-aifeifei-1.0-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24c6e9cf83ed284065d177b4fcd7fe12e74053ed1f9a04df34648de49fb08c47
3
+ size 6596006496
llama3-8B-aifeifei-1.0-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:313de0d3266311ab600ed329ab88eadcce36a2d8758072dc9691f65017f25374
3
+ size 8540770912