OPEA
/

Falcon3-7B-Base-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

cicdatopea commited on 5 days ago

Commit

3039495

•

1 Parent(s): 4d4fb5b

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -77,7 +77,7 @@ auto-round --model "OPEA/Falcon3-7B-Base-int4-sym-inc" --eval --eval_bs 16  --ta
 | Metric                      |  BF16  |  INT4  |
 | :-------------------------- | :----: | :----: |
-| Avg            | 62.43 | 61.69 |
 | mmlu           | 67.43 | 66.41 |
 | lambada_opeai  | 68.52 | 68.12 |
 | hellaswage     | 56.41 | 55.88 |
@@ -88,6 +88,9 @@ auto-round --model "OPEA/Falcon3-7B-Base-int4-sym-inc" --eval --eval_bs 16  --ta
 | boolq          | 81.56 | 80.58 |
 | arc_easy       | 80.81 | 79.80 |
 | arc_challenge  | 51.11 | 49.57 |
 ### Generate the model

 | Metric                      |  BF16  |  INT4  |
 | :-------------------------- | :----: | :----: |
+| Avg            | 59.70 | 58.81 |
 | mmlu           | 67.43 | 66.41 |
 | lambada_opeai  | 68.52 | 68.12 |
 | hellaswage     | 56.41 | 55.88 |
 | boolq          | 81.56 | 80.58 |
 | arc_easy       | 80.81 | 79.80 |
 | arc_challenge  | 51.11 | 49.57 |
+| mmlu_pro       | 40.97 | 39.89 |
+| ifeval         | 32.49 | 30.45 |
+| gsm8k          | 75.66 | 74.45 |
 ### Generate the model