DavidAU commited on
Commit
0804c42
1 Parent(s): 225d0d5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +151 -0
README.md ADDED
@@ -0,0 +1,151 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - zh
5
+ license: apache-2.0
6
+ tags:
7
+ - Mixtral
8
+ - openbmb/MiniCPM-2B-sft-bf16-llama-format
9
+ - MoE
10
+ - merge
11
+ - mergekit
12
+ - moerge
13
+ - MiniCPM
14
+ - llama-cpp
15
+ - gguf-my-repo
16
+ base_model:
17
+ - openbmb/MiniCPM-2B-sft-bf16-llama-format
18
+ model-index:
19
+ - name: MoECPM-Untrained-4x2b
20
+ results:
21
+ - task:
22
+ type: text-generation
23
+ name: Text Generation
24
+ dataset:
25
+ name: AI2 Reasoning Challenge (25-Shot)
26
+ type: ai2_arc
27
+ config: ARC-Challenge
28
+ split: test
29
+ args:
30
+ num_few_shot: 25
31
+ metrics:
32
+ - type: acc_norm
33
+ value: 46.76
34
+ name: normalized accuracy
35
+ source:
36
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
37
+ name: Open LLM Leaderboard
38
+ - task:
39
+ type: text-generation
40
+ name: Text Generation
41
+ dataset:
42
+ name: HellaSwag (10-Shot)
43
+ type: hellaswag
44
+ split: validation
45
+ args:
46
+ num_few_shot: 10
47
+ metrics:
48
+ - type: acc_norm
49
+ value: 72.58
50
+ name: normalized accuracy
51
+ source:
52
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
53
+ name: Open LLM Leaderboard
54
+ - task:
55
+ type: text-generation
56
+ name: Text Generation
57
+ dataset:
58
+ name: MMLU (5-Shot)
59
+ type: cais/mmlu
60
+ config: all
61
+ split: test
62
+ args:
63
+ num_few_shot: 5
64
+ metrics:
65
+ - type: acc
66
+ value: 53.21
67
+ name: accuracy
68
+ source:
69
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
70
+ name: Open LLM Leaderboard
71
+ - task:
72
+ type: text-generation
73
+ name: Text Generation
74
+ dataset:
75
+ name: TruthfulQA (0-shot)
76
+ type: truthful_qa
77
+ config: multiple_choice
78
+ split: validation
79
+ args:
80
+ num_few_shot: 0
81
+ metrics:
82
+ - type: mc2
83
+ value: 38.41
84
+ source:
85
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
86
+ name: Open LLM Leaderboard
87
+ - task:
88
+ type: text-generation
89
+ name: Text Generation
90
+ dataset:
91
+ name: Winogrande (5-shot)
92
+ type: winogrande
93
+ config: winogrande_xl
94
+ split: validation
95
+ args:
96
+ num_few_shot: 5
97
+ metrics:
98
+ - type: acc
99
+ value: 65.51
100
+ name: accuracy
101
+ source:
102
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
103
+ name: Open LLM Leaderboard
104
+ - task:
105
+ type: text-generation
106
+ name: Text Generation
107
+ dataset:
108
+ name: GSM8k (5-shot)
109
+ type: gsm8k
110
+ config: main
111
+ split: test
112
+ args:
113
+ num_few_shot: 5
114
+ metrics:
115
+ - type: acc
116
+ value: 44.58
117
+ name: accuracy
118
+ source:
119
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=Inv/MoECPM-Untrained-4x2b
120
+ name: Open LLM Leaderboard
121
+ ---
122
+
123
+ # DavidAU/MoECPM-Untrained-4x2b-Q8_0-GGUF
124
+ This model was converted to GGUF format from [`Inv/MoECPM-Untrained-4x2b`](https://huggingface.co/Inv/MoECPM-Untrained-4x2b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
125
+ Refer to the [original model card](https://huggingface.co/Inv/MoECPM-Untrained-4x2b) for more details on the model.
126
+ ## Use with llama.cpp
127
+
128
+ Install llama.cpp through brew.
129
+
130
+ ```bash
131
+ brew install ggerganov/ggerganov/llama.cpp
132
+ ```
133
+ Invoke the llama.cpp server or the CLI.
134
+
135
+ CLI:
136
+
137
+ ```bash
138
+ llama-cli --hf-repo DavidAU/MoECPM-Untrained-4x2b-Q8_0-GGUF --model moecpm-untrained-4x2b.Q8_0.gguf -p "The meaning to life and the universe is"
139
+ ```
140
+
141
+ Server:
142
+
143
+ ```bash
144
+ llama-server --hf-repo DavidAU/MoECPM-Untrained-4x2b-Q8_0-GGUF --model moecpm-untrained-4x2b.Q8_0.gguf -c 2048
145
+ ```
146
+
147
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
148
+
149
+ ```
150
+ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make && ./main -m moecpm-untrained-4x2b.Q8_0.gguf -n 128
151
+ ```