wolfram commited on
Commit
505f9a4
1 Parent(s): d2a47e9

Update README.md

Browse files

Q4_K_M and Q5_K_M files are split and require joining

Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -29,6 +29,48 @@ Thanks for the support, [CopilotKit](https://github.com/CopilotKit/CopilotKit)
29
 
30
  Also available: [miqu-1-120b](https://huggingface.co/wolfram/miqu-1-120b) – Miquliz's older, purer sister; only Miqu, inflated to 120B.
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  ## Model Details
33
 
34
  - Max Context: 32768 tokens
 
29
 
30
  Also available: [miqu-1-120b](https://huggingface.co/wolfram/miqu-1-120b) – Miquliz's older, purer sister; only Miqu, inflated to 120B.
31
 
32
+ ### ❗ Q4_K_M and Q5_K_M files are split and require joining
33
+
34
+ **Note:** HF does not support uploading files larger than 50GB. Therefore I have uploaded the Q4_K_M and Q5_K_M files as split files.
35
+
36
+ <details><summary>Click for instructions regarding Q4_K_M and Q5_K_M files</summary>
37
+
38
+ #### Q4_K_M
39
+
40
+ Please download:
41
+
42
+ - `miquliz-120b-v2.0.Q4_K_M.gguf-split-a`
43
+ - `miquliz-120b-v2.0.Q4_K_M.gguf-split-b`
44
+
45
+ #### Q5_K_M
46
+
47
+ Please download:
48
+
49
+ - `miquliz-120b-v2.0.Q5_K_M.gguf-split-a`
50
+ - `miquliz-120b-v2.0.Q5_K_M.gguf-split-b`
51
+
52
+ To join the files, do the following:
53
+
54
+ Linux and macOS:
55
+
56
+ ```sh
57
+ cat miquliz-120b-v2.0.Q4_K_M.gguf-split-* > miquliz-120b-v2.0.Q4_K_M.gguf && rm miquliz-120b-v2.0.Q4_K_M.gguf-split-*
58
+
59
+ cat miquliz-120b-v2.0.Q5_K_M.gguf-split-* > miquliz-120b-v2.0.Q5_K_M.gguf && rm miquliz-120b-v2.0.Q5_K_M.gguf-split-*
60
+ ```
61
+
62
+ Windows command line:
63
+
64
+ ```cmd
65
+ COPY /B miquliz-120b-v2.0.Q4_K_M.gguf-split-a + miquliz-120b-v2.0.Q4_K_M.gguf-split-b miquliz-120b-v2.0.Q4_K_M.gguf
66
+ DEL miquliz-120b-v2.0.Q4_K_M.gguf-split-a miquliz-120b-v2.0.Q4_K_M.gguf-split-b
67
+
68
+ COPY /B miquliz-120b-v2.0.Q5_K_M.gguf-split-a + miquliz-120b-v2.0.Q5_K_M.gguf-split-b miquliz-120b-v2.0.Q5_K_M.gguf
69
+ DEL miquliz-120b-v2.0.Q5_K_M.gguf-split-a miquliz-120b-v2.0.Q5_K_M.gguf-split-b
70
+ ```
71
+
72
+ </details>
73
+
74
  ## Model Details
75
 
76
  - Max Context: 32768 tokens