puneeshkhanna commited on
Commit
4cf1db0
1 Parent(s): 43ca5d0

Update README.md

Browse files

Correct Math score and rounding

Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -20,7 +20,7 @@ license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
20
 
21
  **Falcon3** family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
22
 
23
- This repository contains the **Falcon3-7B-Instruct**. It achieves state of art results (at release's time) on reasoning, language understanding, instruction following, code and mathematics tasks.
24
  Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
25
 
26
  ## Model Details
@@ -146,7 +146,7 @@ We report in the following table our internal pipeline benchmarks:
146
  <td>MATH Lvl-5 (4-shot)</td>
147
  <td>10.4</td>
148
  <td>26</td>
149
- <td><b>33.1</b></td>
150
  </tr>
151
  <tr>
152
  <td rowspan="5">Reasoning</td>
@@ -207,15 +207,15 @@ We report in the following table our internal pipeline benchmarks:
207
  <tr>
208
  <td rowspan="2">Instructions following</td>
209
  <td>MT-Bench (avg)</td>
210
- <td>7.86</td>
211
- <td><b>8.54</b></td>
212
- <td>8.36</td>
213
  </tr>
214
  <tr>
215
  <td>Alpaca (WC)</td>
216
- <td>26.57</td>
217
  <td><b>31.5</b></td>
218
- <td>26.13</td>
219
  </tr>
220
  <tr>
221
  <td>Tool use</td>
 
20
 
21
  **Falcon3** family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B.
22
 
23
+ This repository contains the **Falcon3-7B-Instruct**. It achieves state of art results (at the time of release) on reasoning, language understanding, instruction following, code and mathematics tasks.
24
  Falcon3-7B-Instruct supports 4 languages (english, french, spanish, portuguese) and a context length up to 32K.
25
 
26
  ## Model Details
 
146
  <td>MATH Lvl-5 (4-shot)</td>
147
  <td>10.4</td>
148
  <td>26</td>
149
+ <td><b>29.4</b></td>
150
  </tr>
151
  <tr>
152
  <td rowspan="5">Reasoning</td>
 
207
  <tr>
208
  <td rowspan="2">Instructions following</td>
209
  <td>MT-Bench (avg)</td>
210
+ <td>7.9</td>
211
+ <td><b>8.5</b></td>
212
+ <td>8.4</td>
213
  </tr>
214
  <tr>
215
  <td>Alpaca (WC)</td>
216
+ <td>26.6</td>
217
  <td><b>31.5</b></td>
218
+ <td>26.1</td>
219
  </tr>
220
  <tr>
221
  <td>Tool use</td>