Hugging Face's logo

Lewdiculous
/
MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

Transformers
GGUF
English
mistral
arm
i8mm
mobile
roleplay
Inference Endpoints
imatrix
conversational
Model card Files Community
1
Lewdiculous commited on
Commit
2971c06
•
1 Parent(s): 4dd2542

IQ3 Q3 31.8 GB

Browse files
Files changed (9) hide show
  1. .gitattributes +7 -0
  2. MN-BackyardAI-Party-12B-v1-IQ3_M-imat.gguf +3 -0
  3. MN-BackyardAI-Party-12B-v1-IQ3_S-imat.gguf +3 -0
  4. MN-BackyardAI-Party-12B-v1-IQ3_XS-imat.gguf +3 -0
  5. MN-BackyardAI-Party-12B-v1-IQ3_XXS-imat.gguf +3 -0
  6. MN-BackyardAI-Party-12B-v1-Q3_K_L-imat.gguf +3 -0
  7. MN-BackyardAI-Party-12B-v1-Q3_K_M-imat.gguf +3 -0
  8. imatrix-with-rp-v3.txt +0 -0
  9. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ MN-BackyardAI-Party-12B-v1-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ MN-BackyardAI-Party-12B-v1-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ MN-BackyardAI-Party-12B-v1-IQ3_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ MN-BackyardAI-Party-12B-v1-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ MN-BackyardAI-Party-12B-v1-Q3_K_L-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ MN-BackyardAI-Party-12B-v1-Q3_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
MN-BackyardAI-Party-12B-v1-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbf42cc87fffbffc0fbeeb2b04ff748d36cbc79620ee5b0f3d06aadef490864f
3
+ size 5722232000
MN-BackyardAI-Party-12B-v1-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d96460d531af123241ab20e0c31f47dfa56fd933c09853537cd9ae958d137aa0
3
+ size 5562078400
MN-BackyardAI-Party-12B-v1-IQ3_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd58d3864f928c1efab31044e46d43563b059becb26f2d94a17a2c8fefe5736d
3
+ size 5306488000
MN-BackyardAI-Party-12B-v1-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96de04189c870a00f996e50cdf64ecbf281687d121edd3f887a517ec85984e40
3
+ size 4945384640
MN-BackyardAI-Party-12B-v1-Q3_K_L-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4983cf2aaf2d2e18d8f59b7b08a8a762b6e53bfbd41d9253c8468390eb0a59df
3
+ size 6561502400
MN-BackyardAI-Party-12B-v1-Q3_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7529e79385badfbbe53ae0c3d3dd40bbb55d493976fcb2cc95041a05bceab8bc
3
+ size 6083089600
imatrix-with-rp-v3.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83d925b03b7e2ad6bed33cfe9f85974930ef12d9913f6d85590bf22e4c2a0a6e
3
+ size 7054419