Hugging Face's logo

leafspark
/
Reflection-Llama-3.1-70B-GGUF

Text Generation
GGUF
ggml
llama
Inference Endpoints
conversational
Model card Files Community
3

Add in progress imatrix

#3
by leafspark - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+6
-0
Files changed (2) hide show
  1. .gitattributes +3 -0
  2. imatrix_q6_k.dat +3 -0
.gitattributes CHANGED
@@ -61,3 +61,6 @@ Reflection-Llama-3.1-70B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
61
  Reflection-Llama-3.1-70B.Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Reflection-Llama-3.1-70B.Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
63
  Reflection-Llama-3.1-70B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
61
  Reflection-Llama-3.1-70B.Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Reflection-Llama-3.1-70B.Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
63
  Reflection-Llama-3.1-70B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Reflection-Llama-3.1-70B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Reflection-Llama-3.1-70B.fp16-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Reflection-Llama-3.1-70B.fp16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
imatrix_q6_k.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77c5d8648cab3ece6757b234b9f325e4fd14f0aa2a0470c9957ab8e98c83ec68
3
+ size 24922297