Hugging Face's logo

byroneverson
/
Yi-1.5-9B-Chat-16K-abliterated

Text Generation
Transformers
Safetensors
Chinese
English
llama
llm
long context
yi
chat
it
abliterated
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
1

Adding Evaluation Results

#1
by leaderboard-pr-bot - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+113
-5
Files changed (1) hide show
  1. README.md +113 -5
README.md CHANGED
@@ -1,10 +1,9 @@
1
  ---
2
- base_model: 01-ai/Yi-1.5-9B-Chat-16K
3
- license: apache-2.0
4
- pipeline_tag: text-generation
5
  language:
6
  - zh
7
  - en
 
 
8
  tags:
9
  - llm
10
  - long context
@@ -12,7 +11,103 @@ tags:
12
  - chat
13
  - it
14
  - abliterated
15
- library_name: transformers
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ---
17
 
18
 
@@ -21,4 +116,17 @@ library_name: transformers
21
 
22
  Check out the <a href="https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-16K-abliterated/blob/main/abliterate-yi-1-5-9b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from Yi-1.5-9B-Chat-16K.
23
 
24
- ![Logo](https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-16K-abliterated/resolve/main/logo.png "Logo")
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
 
2
  language:
3
  - zh
4
  - en
5
+ license: apache-2.0
6
+ library_name: transformers
7
  tags:
8
  - llm
9
  - long context
 
11
  - chat
12
  - it
13
  - abliterated
14
+ base_model: 01-ai/Yi-1.5-9B-Chat-16K
15
+ pipeline_tag: text-generation
16
+ model-index:
17
+ - name: Yi-1.5-9B-Chat-16K-abliterated
18
+ results:
19
+ - task:
20
+ type: text-generation
21
+ name: Text Generation
22
+ dataset:
23
+ name: IFEval (0-Shot)
24
+ type: HuggingFaceH4/ifeval
25
+ args:
26
+ num_few_shot: 0
27
+ metrics:
28
+ - type: inst_level_strict_acc and prompt_level_strict_acc
29
+ value: 55.28
30
+ name: strict accuracy
31
+ source:
32
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
33
+ name: Open LLM Leaderboard
34
+ - task:
35
+ type: text-generation
36
+ name: Text Generation
37
+ dataset:
38
+ name: BBH (3-Shot)
39
+ type: BBH
40
+ args:
41
+ num_few_shot: 3
42
+ metrics:
43
+ - type: acc_norm
44
+ value: 32.84
45
+ name: normalized accuracy
46
+ source:
47
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
48
+ name: Open LLM Leaderboard
49
+ - task:
50
+ type: text-generation
51
+ name: Text Generation
52
+ dataset:
53
+ name: MATH Lvl 5 (4-Shot)
54
+ type: hendrycks/competition_math
55
+ args:
56
+ num_few_shot: 4
57
+ metrics:
58
+ - type: exact_match
59
+ value: 10.65
60
+ name: exact match
61
+ source:
62
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
63
+ name: Open LLM Leaderboard
64
+ - task:
65
+ type: text-generation
66
+ name: Text Generation
67
+ dataset:
68
+ name: GPQA (0-shot)
69
+ type: Idavidrein/gpqa
70
+ args:
71
+ num_few_shot: 0
72
+ metrics:
73
+ - type: acc_norm
74
+ value: 8.39
75
+ name: acc_norm
76
+ source:
77
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
78
+ name: Open LLM Leaderboard
79
+ - task:
80
+ type: text-generation
81
+ name: Text Generation
82
+ dataset:
83
+ name: MuSR (0-shot)
84
+ type: TAUR-Lab/MuSR
85
+ args:
86
+ num_few_shot: 0
87
+ metrics:
88
+ - type: acc_norm
89
+ value: 19.68
90
+ name: acc_norm
91
+ source:
92
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
93
+ name: Open LLM Leaderboard
94
+ - task:
95
+ type: text-generation
96
+ name: Text Generation
97
+ dataset:
98
+ name: MMLU-PRO (5-shot)
99
+ type: TIGER-Lab/MMLU-Pro
100
+ config: main
101
+ split: test
102
+ args:
103
+ num_few_shot: 5
104
+ metrics:
105
+ - type: acc
106
+ value: 31.37
107
+ name: accuracy
108
+ source:
109
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=byroneverson/Yi-1.5-9B-Chat-16K-abliterated
110
+ name: Open LLM Leaderboard
111
  ---
112
 
113
 
 
116
 
117
  Check out the <a href="https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-16K-abliterated/blob/main/abliterate-yi-1-5-9b-chat.ipynb">jupyter notebook</a> for details of how this model was abliterated from Yi-1.5-9B-Chat-16K.
118
 
119
+ ![Logo](https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-16K-abliterated/resolve/main/logo.png "Logo")
120
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
121
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_byroneverson__Yi-1.5-9B-Chat-16K-abliterated)
122
+
123
+ | Metric |Value|
124
+ |-------------------|----:|
125
+ |Avg. |26.37|
126
+ |IFEval (0-Shot) |55.28|
127
+ |BBH (3-Shot) |32.84|
128
+ |MATH Lvl 5 (4-Shot)|10.65|
129
+ |GPQA (0-shot) | 8.39|
130
+ |MuSR (0-shot) |19.68|
131
+ |MMLU-PRO (5-shot) |31.37|
132
+