africalimedrop
commited on
Commit
•
82840a3
1
Parent(s):
199194c
Update README.md
Browse filesRemove references to Q6_K being split.
README.md
CHANGED
@@ -120,18 +120,13 @@ Refer to the Provided Files table below to see what files use which methods, and
|
|
120 |
|
121 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
122 |
|
123 |
-
###
|
124 |
|
125 |
-
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the
|
126 |
|
127 |
<details>
|
128 |
-
<summary>Click for instructions regarding
|
129 |
|
130 |
-
### q6_K
|
131 |
-
Please download:
|
132 |
-
* `mixtral_34bx2_moe_60b.Q6_K.gguf-split-a`
|
133 |
-
* `mixtral_34bx2_moe_60b.Q6_K.gguf-split-b`
|
134 |
-
|
135 |
### q8_0
|
136 |
Please download:
|
137 |
* `mixtral_34bx2_moe_60b.Q8_0.gguf-split-a`
|
@@ -141,14 +136,10 @@ To join the files, do the following:
|
|
141 |
|
142 |
Linux and macOS:
|
143 |
```
|
144 |
-
cat mixtral_34bx2_moe_60b.Q6_K.gguf-split-* > mixtral_34bx2_moe_60b.Q6_K.gguf && rm mixtral_34bx2_moe_60b.Q6_K.gguf-split-*
|
145 |
cat mixtral_34bx2_moe_60b.Q8_0.gguf-split-* > mixtral_34bx2_moe_60b.Q8_0.gguf && rm mixtral_34bx2_moe_60b.Q8_0.gguf-split-*
|
146 |
```
|
147 |
Windows command line:
|
148 |
```
|
149 |
-
COPY /B mixtral_34bx2_moe_60b.Q6_K.gguf-split-a + mixtral_34bx2_moe_60b.Q6_K.gguf-split-b mixtral_34bx2_moe_60b.Q6_K.gguf
|
150 |
-
del mixtral_34bx2_moe_60b.Q6_K.gguf-split-a mixtral_34bx2_moe_60b.Q6_K.gguf-split-b
|
151 |
-
|
152 |
COPY /B mixtral_34bx2_moe_60b.Q8_0.gguf-split-a + mixtral_34bx2_moe_60b.Q8_0.gguf-split-b mixtral_34bx2_moe_60b.Q8_0.gguf
|
153 |
del mixtral_34bx2_moe_60b.Q8_0.gguf-split-a mixtral_34bx2_moe_60b.Q8_0.gguf-split-b
|
154 |
```
|
|
|
120 |
|
121 |
**Note**: the above RAM figures assume no GPU offloading. If layers are offloaded to the GPU, this will reduce RAM usage and use VRAM instead.
|
122 |
|
123 |
+
### Q8_0 files are split and require joining
|
124 |
|
125 |
+
**Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the Q8_0 files as split files.
|
126 |
|
127 |
<details>
|
128 |
+
<summary>Click for instructions regarding Q8_0 files</summary>
|
129 |
|
|
|
|
|
|
|
|
|
|
|
130 |
### q8_0
|
131 |
Please download:
|
132 |
* `mixtral_34bx2_moe_60b.Q8_0.gguf-split-a`
|
|
|
136 |
|
137 |
Linux and macOS:
|
138 |
```
|
|
|
139 |
cat mixtral_34bx2_moe_60b.Q8_0.gguf-split-* > mixtral_34bx2_moe_60b.Q8_0.gguf && rm mixtral_34bx2_moe_60b.Q8_0.gguf-split-*
|
140 |
```
|
141 |
Windows command line:
|
142 |
```
|
|
|
|
|
|
|
143 |
COPY /B mixtral_34bx2_moe_60b.Q8_0.gguf-split-a + mixtral_34bx2_moe_60b.Q8_0.gguf-split-b mixtral_34bx2_moe_60b.Q8_0.gguf
|
144 |
del mixtral_34bx2_moe_60b.Q8_0.gguf-split-a mixtral_34bx2_moe_60b.Q8_0.gguf-split-b
|
145 |
```
|