Hugging Face's logo

MediaTek-Research
/
Breeze-7B-Instruct-v0_1

Text Generation
Transformers
PyTorch
Safetensors
Chinese
English
mistral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
5
YC-Chen commited on
Commit
0b6ab67
·
verified ·
1 Parent(s): 3234179

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -36,7 +36,7 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
36
  | [Qwen-14B](https://huggingface.co/01-ai/Qwen/Qwen-14B)| 14B | 51.30 | 16.95 * | 68.83 |
37
  | [Yi-6B](https://huggingface.co/01-ai/Yi-6B) | 6B | 49.63 | 76.61 | 65.35 |
38
  | [Qwen-7B](https://huggingface.co/01-ai/Qwen/Qwen-7B)| 7B | 42.84 | 0.0 * | 61.00 |
39
- | [Breeze-7B-Base-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Base-v0.1) | 7B | 40.35 | 81.13 | 61.63 |
40
  | [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)| 7B | 36.93 | 79.27 | 64.89 |
41
 
42
 
@@ -48,7 +48,7 @@ and is comparable with Mistral-7B-Instruct-v0.1 on MMLU and MT-Bench in English.
48
  | Qwen-14B | 46.51 | 58.20 | 51.12 | 49.38 |
49
  | Yi-6B | 41.14 | 57.77 | 50.22 | 49.39 |
50
  | Qwen-7B | 28.25 | 47.80 | 43.14 | 42.17 |
51
- | Breeze-7B-Base-v0.1 | 35.74 | 46.08 | 40.29 | 39.27 |
52
  | Mistral-7B-v0.1 | 33.01 | 42.23 | 35.86 | 37.63 |
53
 
54
 
@@ -59,7 +59,7 @@ The max_new_tokens is set to 1000 (except Qwen/Qwen-7B, which is set to 400). Al
59
  | Models | Speed (char/sec) |Estimated Max Input Length (TC Char)|
60
  |--------------------------------------------------------------------|-------------------|--------------------------|
61
  | Yi-6B | 62.08 | 4.4k |
62
- | Breeze-7B-Base-v0.1 | 59.57 | 10.1k |
63
  | Qwen-7B | 55.00 | 9.7k |
64
  | Qwen-14B | 51.12 | 9.7k |
65
  | Mistral-7B-v0.1 | 45.31 | 6.3k |
@@ -78,8 +78,8 @@ The max_new_tokens is set to 1000 (except Qwen/Qwen-7B, which is set to 400). Al
78
  | [Yi-34B-Chat](https://huggingface.co/01-ai/Yi-34B-Chat)| 34B | 54.87 | | | 6.9 | 71.04 | | 7.6 |
79
  | [Qwen-14B-Chat](https://huggingface.co/Qwen/Qwen-14B-Chat)| 14B | 48.41 | | | 6.4 | 64.91 | | 7.2 |
80
  | [Yi-6B](https://huggingface.co/01-ai/Yi-6B)| 6B | 44.79 | | | 5.0 | 59.45 | | 6.0 |
81
- | [Breeze-7B-Instruct-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0.1)| 7B | 41.61 | | | 5.7 | 63.26 | | 7.1 |
82
- | [Breeze-7B-Instruct-64k-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1)| 7B | 40.99 | | | | 63.68 | | 7.1 |
83
  | [Qwen-7B-Chat](https://huggingface.co/Qwen/Qwen-7B-Chat) | 7B | 40.02 | | | 5.4 | 55.94 | | 6.2 |
84
  | [Taiwan-LLM-13B-v2.0-chat](https://huggingface.co/yentinglin/Taiwan-LLM-13B-v2.0-chat) | 13B | 29.47 | | | 5.0 | 50.50 | | -* |
85
  | [Taiwan-LLM-7B-v2.1-chat](https://huggingface.co/yentinglin/Taiwan-LLM-7B-v2.1-chat) | 7B | 28.08 | | | 4.2 | 42.72 | | -* |
@@ -93,8 +93,8 @@ The max_new_tokens is set to 1000 (except Qwen/Qwen-7B, which is set to 400). Al
93
  | Yi-34B-Chat | 47.65 | 64.25 | 52.73 | 54.91 |
94
  | Qwen-14B-Chat | 43.83 | 55.00 | 48.55 | 46.22 |
95
  | Yi-6B-Chat | 37.80 | 51.74 | 45.36 | 44.25 |
96
- | Breeze-7B-Instruct-v0.1 | 37.41 | 46.81 | 42.06 | 40.16 |
97
- | Breeze-7B-Instruct-64k-v0.1 | 37.88 | 46.35 | 40.31 | 39.40 |
98
  | Qwen-7B-Chat | 35.44 | 46.22 | 38.35 | 40.06 |
99
  | Taiwan-LLM-13B-v2.0-chat | 27.74 | 33.69 | 27.03 | 29.43 |
100
  | Taiwan-LLM-7B-v2.1-chat | 25.58 | 31.76 | 27.36 | 27.61 |
 
36
  | [Qwen-14B](https://huggingface.co/01-ai/Qwen/Qwen-14B)| 14B | 51.30 | 16.95 * | 68.83 |
37
  | [Yi-6B](https://huggingface.co/01-ai/Yi-6B) | 6B | 49.63 | 76.61 | 65.35 |
38
  | [Qwen-7B](https://huggingface.co/01-ai/Qwen/Qwen-7B)| 7B | 42.84 | 0.0 * | 61.00 |
39
+ | [**Breeze-7B-Base-v0.1**](https://huggingface.co/MediaTek-Research/Breeze-7B-Base-v0.1) | 7B | 40.35 | 81.13 | 61.63 |
40
  | [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)| 7B | 36.93 | 79.27 | 64.89 |
41
 
42
 
 
48
  | Qwen-14B | 46.51 | 58.20 | 51.12 | 49.38 |
49
  | Yi-6B | 41.14 | 57.77 | 50.22 | 49.39 |
50
  | Qwen-7B | 28.25 | 47.80 | 43.14 | 42.17 |
51
+ | **Breeze-7B-Base-v0.1** | 35.74 | 46.08 | 40.29 | 39.27 |
52
  | Mistral-7B-v0.1 | 33.01 | 42.23 | 35.86 | 37.63 |
53
 
54
 
 
59
  | Models | Speed (char/sec) |Estimated Max Input Length (TC Char)|
60
  |--------------------------------------------------------------------|-------------------|--------------------------|
61
  | Yi-6B | 62.08 | 4.4k |
62
+ | **Breeze-7B-Base-v0.1** | 59.57 | 10.1k |
63
  | Qwen-7B | 55.00 | 9.7k |
64
  | Qwen-14B | 51.12 | 9.7k |
65
  | Mistral-7B-v0.1 | 45.31 | 6.3k |
 
78
  | [Yi-34B-Chat](https://huggingface.co/01-ai/Yi-34B-Chat)| 34B | 54.87 | | | 6.9 | 71.04 | | 7.6 |
79
  | [Qwen-14B-Chat](https://huggingface.co/Qwen/Qwen-14B-Chat)| 14B | 48.41 | | | 6.4 | 64.91 | | 7.2 |
80
  | [Yi-6B](https://huggingface.co/01-ai/Yi-6B)| 6B | 44.79 | | | 5.0 | 59.45 | | 6.0 |
81
+ | [**Breeze-7B-Instruct-v0.1**](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0.1)| 7B | 41.61 | | | 5.7 | 63.26 | | 7.1 |
82
+ | [**Breeze-7B-Instruct-64k-v0.1**](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1)| 7B | 40.99 | | | | 63.68 | | 7.1 |
83
  | [Qwen-7B-Chat](https://huggingface.co/Qwen/Qwen-7B-Chat) | 7B | 40.02 | | | 5.4 | 55.94 | | 6.2 |
84
  | [Taiwan-LLM-13B-v2.0-chat](https://huggingface.co/yentinglin/Taiwan-LLM-13B-v2.0-chat) | 13B | 29.47 | | | 5.0 | 50.50 | | -* |
85
  | [Taiwan-LLM-7B-v2.1-chat](https://huggingface.co/yentinglin/Taiwan-LLM-7B-v2.1-chat) | 7B | 28.08 | | | 4.2 | 42.72 | | -* |
 
93
  | Yi-34B-Chat | 47.65 | 64.25 | 52.73 | 54.91 |
94
  | Qwen-14B-Chat | 43.83 | 55.00 | 48.55 | 46.22 |
95
  | Yi-6B-Chat | 37.80 | 51.74 | 45.36 | 44.25 |
96
+ | **Breeze-7B-Instruct-v0.1** | 37.41 | 46.81 | 42.06 | 40.16 |
97
+ | **Breeze-7B-Instruct-64k-v0.1** | 37.88 | 46.35 | 40.31 | 39.40 |
98
  | Qwen-7B-Chat | 35.44 | 46.22 | 38.35 | 40.06 |
99
  | Taiwan-LLM-13B-v2.0-chat | 27.74 | 33.69 | 27.03 | 29.43 |
100
  | Taiwan-LLM-7B-v2.1-chat | 25.58 | 31.76 | 27.36 | 27.61 |