Mayank Mishra commited on
Commit
daf4cd5
1 Parent(s): d08cc52

upload model

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ granite-34b-code-instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,222 @@
1
  ---
 
 
 
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ base_model: ibm-granite/granite-34b-code-instruct
4
+ inference: false
5
  license: apache-2.0
6
+ datasets:
7
+ - bigcode/commitpackft
8
+ - TIGER-Lab/MathInstruct
9
+ - meta-math/MetaMathQA
10
+ - glaiveai/glaive-code-assistant-v3
11
+ - glaive-function-calling-v2
12
+ - bugdaryan/sql-create-context-instruction
13
+ - garage-bAInd/Open-Platypus
14
+ - nvidia/HelpSteer
15
+ metrics:
16
+ - code_eval
17
+ library_name: transformers
18
+ tags:
19
+ - code
20
+ - granite
21
+ model-index:
22
+ - name: granite-34b-code-instruct
23
+ results:
24
+ - task:
25
+ type: text-generation
26
+ dataset:
27
+ type: bigcode/humanevalpack
28
+ name: HumanEvalSynthesis(Python)
29
+ metrics:
30
+ - name: pass@1
31
+ type: pass@1
32
+ value: 62.2
33
+ veriefied: false
34
+ - task:
35
+ type: text-generation
36
+ dataset:
37
+ type: bigcode/humanevalpack
38
+ name: HumanEvalSynthesis(JavaScript)
39
+ metrics:
40
+ - name: pass@1
41
+ type: pass@1
42
+ value: 56.7
43
+ veriefied: false
44
+ - task:
45
+ type: text-generation
46
+ dataset:
47
+ type: bigcode/humanevalpack
48
+ name: HumanEvalSynthesis(Java)
49
+ metrics:
50
+ - name: pass@1
51
+ type: pass@1
52
+ value: 62.8
53
+ veriefied: false
54
+ - task:
55
+ type: text-generation
56
+ dataset:
57
+ type: bigcode/humanevalpack
58
+ name: HumanEvalSynthesis(Go)
59
+ metrics:
60
+ - name: pass@1
61
+ type: pass@1
62
+ value: 47.6
63
+ veriefied: false
64
+ - task:
65
+ type: text-generation
66
+ dataset:
67
+ type: bigcode/humanevalpack
68
+ name: HumanEvalSynthesis(C++)
69
+ metrics:
70
+ - name: pass@1
71
+ type: pass@1
72
+ value: 57.9
73
+ veriefied: false
74
+ - task:
75
+ type: text-generation
76
+ dataset:
77
+ type: bigcode/humanevalpack
78
+ name: HumanEvalSynthesis(Rust)
79
+ metrics:
80
+ - name: pass@1
81
+ type: pass@1
82
+ value: 41.5
83
+ veriefied: false
84
+ - task:
85
+ type: text-generation
86
+ dataset:
87
+ type: bigcode/humanevalpack
88
+ name: HumanEvalExplain(Python)
89
+ metrics:
90
+ - name: pass@1
91
+ type: pass@1
92
+ value: 53.0
93
+ veriefied: false
94
+ - task:
95
+ type: text-generation
96
+ dataset:
97
+ type: bigcode/humanevalpack
98
+ name: HumanEvalExplain(JavaScript)
99
+ metrics:
100
+ - name: pass@1
101
+ type: pass@1
102
+ value: 45.1
103
+ veriefied: false
104
+ - task:
105
+ type: text-generation
106
+ dataset:
107
+ type: bigcode/humanevalpack
108
+ name: HumanEvalExplain(Java)
109
+ metrics:
110
+ - name: pass@1
111
+ type: pass@1
112
+ value: 50.6
113
+ veriefied: false
114
+ - task:
115
+ type: text-generation
116
+ dataset:
117
+ type: bigcode/humanevalpack
118
+ name: HumanEvalExplain(Go)
119
+ metrics:
120
+ - name: pass@1
121
+ type: pass@1
122
+ value: 36.0
123
+ veriefied: false
124
+ - task:
125
+ type: text-generation
126
+ dataset:
127
+ type: bigcode/humanevalpack
128
+ name: HumanEvalExplain(C++)
129
+ metrics:
130
+ - name: pass@1
131
+ type: pass@1
132
+ value: 42.7
133
+ veriefied: false
134
+ - task:
135
+ type: text-generation
136
+ dataset:
137
+ type: bigcode/humanevalpack
138
+ name: HumanEvalExplain(Rust)
139
+ metrics:
140
+ - name: pass@1
141
+ type: pass@1
142
+ value: 23.8
143
+ veriefied: false
144
+ - task:
145
+ type: text-generation
146
+ dataset:
147
+ type: bigcode/humanevalpack
148
+ name: HumanEvalFix(Python)
149
+ metrics:
150
+ - name: pass@1
151
+ type: pass@1
152
+ value: 54.9
153
+ veriefied: false
154
+ - task:
155
+ type: text-generation
156
+ dataset:
157
+ type: bigcode/humanevalpack
158
+ name: HumanEvalFix(JavaScript)
159
+ metrics:
160
+ - name: pass@1
161
+ type: pass@1
162
+ value: 47.6
163
+ veriefied: false
164
+ - task:
165
+ type: text-generation
166
+ dataset:
167
+ type: bigcode/humanevalpack
168
+ name: HumanEvalFix(Java)
169
+ metrics:
170
+ - name: pass@1
171
+ type: pass@1
172
+ value: 55.5
173
+ veriefied: false
174
+ - task:
175
+ type: text-generation
176
+ dataset:
177
+ type: bigcode/humanevalpack
178
+ name: HumanEvalFix(Go)
179
+ metrics:
180
+ - name: pass@1
181
+ type: pass@1
182
+ value: 51.2
183
+ veriefied: false
184
+ - task:
185
+ type: text-generation
186
+ dataset:
187
+ type: bigcode/humanevalpack
188
+ name: HumanEvalFix(C++)
189
+ metrics:
190
+ - name: pass@1
191
+ type: pass@1
192
+ value: 47.0
193
+ veriefied: false
194
+ - task:
195
+ type: text-generation
196
+ dataset:
197
+ type: bigcode/humanevalpack
198
+ name: HumanEvalFix(Rust)
199
+ metrics:
200
+ - name: pass@1
201
+ type: pass@1
202
+ value: 45.1
203
+ veriefied: false
204
  ---
205
+
206
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/62cd5057674cdb524450093d/1hzxoPwqkBJXshKVVe6_9.png)
207
+
208
+ # ibm-granite/granite-34b-code-instruct-GGUF
209
+ This is the Q4_K_M converted version of the original [`ibm-granite/granite-34b-code-instruct`](https://huggingface.co/ibm-granite/granite-34b-code-instruct).
210
+ Refer to the [original model card](https://huggingface.co/ibm-granite/granite-34b-code-instruct) for more details.
211
+
212
+ ## Use with llama.cpp
213
+ ```shell
214
+ git clone https://github.com/ggerganov/llama.cpp
215
+ cd llama.cpp
216
+
217
+ # install
218
+ make
219
+
220
+ # run generation
221
+ ./main -m granite-34b-code-instruct-GGUF/granite-34b-code-instruct.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color
222
+ ```
granite-34b-code-instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd9d561154525255511356632782f09046c77355cf0c99cced464e1f7da523cc
3
+ size 21383628160