EleutherAI/Hermes-RWKV-v5-7B-HF
Text Generation
•
Updated
•
30
•
4
wassname
wassname
AI & ML interests
None yet
Recent Activity
liked
a model
about 1 month ago
EleutherAI/Hermes-RWKV-v5-7B-HF
liked
a dataset
about 2 months ago
jdpressman/retro-easy-prose-repair-diffs-v0.1
Organizations
None yet
wassname's activity
liked
a
model
about 1 month ago
liked
a
dataset
about 2 months ago
remove hard coded base model
1
#1 opened 2 months ago
by
wassname
liked
a
model
2 months ago
requesting 1B version
6
#1 opened 3 months ago
by
Hasaranga85
liked
2
models
3 months ago
updated
a
model
3 months ago
liked
2
models
3 months ago
updated
7
datasets
3 months ago
wassname/genies_preferences
Viewer
•
Updated
•
118k
•
837
wassname/imdb_preferences
Viewer
•
Updated
•
100k
•
45
wassname/ethics_expression_preferences
Viewer
•
Updated
•
45.3k
•
141
•
2
wassname/ethics_qna_preferences
Viewer
•
Updated
•
113k
•
98
wassname/helpsteer2_dpo_nonverbose
Viewer
•
Updated
•
20k
•
74
wassname/truthful_qa_preferences
Viewer
•
Updated
•
817
•
37
wassname/mmlu_preferences
Viewer
•
Updated
•
15.9k
•
915
liked
a
model
3 months ago
reacted to
grimjim's
post with 👍
4 months ago
Post
2804
I've observed that the layers targeted in various abliteration notebooks (e.g., https://colab.research.google.com/drive/1VYm3hOcvCpbGiqKZb141gJwjdmmCcVpR?usp=sharing ) appear to be arbitrary, reflecting probable brute-force exploration. This doesn't need to be the case.
Taking a cue from the paper "The Unreasonable Ineffectiveness of the Deeper Layers" ( https://arxiv.org/abs/2403.17887 ) and PruneMe (https://github.com/arcee-ai/PruneMe), it seems reasonable to target deeper layers identified as more redundant given measured similarity across layers, as the result should be less damaging to models, reducing the need for subsequent fine-tuning. Intuitively, one should expect the resulting intervention layers to be deep but not final. The only uncertainty is if the redundancy successfully encodes refusals, something which is almost certainly model-dependent. This approach only requires the redundancy to be computed once per model, and the result used as a starting point for which layer range to restrict intervention to.
Taking a cue from the paper "The Unreasonable Ineffectiveness of the Deeper Layers" ( https://arxiv.org/abs/2403.17887 ) and PruneMe (https://github.com/arcee-ai/PruneMe), it seems reasonable to target deeper layers identified as more redundant given measured similarity across layers, as the result should be less damaging to models, reducing the need for subsequent fine-tuning. Intuitively, one should expect the resulting intervention layers to be deep but not final. The only uncertainty is if the redundancy successfully encodes refusals, something which is almost certainly model-dependent. This approach only requires the redundancy to be computed once per model, and the result used as a starting point for which layer range to restrict intervention to.
liked
a
model
5 months ago