Blackroot commited on
Commit
dacd9b9
1 Parent(s): ee92430

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -31,7 +31,7 @@ tags:
31
  Too moralizing, really simple as that. I did not find much upside to this model in general, and the downsides are pretty clear.
32
 
33
  # Add PKU-Alignment/ProgressGym-HistLlama3-70B-C013-pretrain-v0.1
34
- I wanted another base model to regularize, typically the inclusion of base models is purely for regularization and that's the case here.
35
 
36
  # Add NousResearch/Hermes-3-Llama-3.1-70B
37
  The inclusion of this seemed fine, potentially helped fix some of the issues with early-ctx instruct following. I could not find any real negatives to this add.
 
31
  Too moralizing, really simple as that. I did not find much upside to this model in general, and the downsides are pretty clear.
32
 
33
  # Add PKU-Alignment/ProgressGym-HistLlama3-70B-C013-pretrain-v0.1
34
+ I wanted another base model to regularize, typically the inclusion of base models is purely for regularization and that's the case here. (This model is already somewhat represented in the histmerge, so this should act more as weak regularization)
35
 
36
  # Add NousResearch/Hermes-3-Llama-3.1-70B
37
  The inclusion of this seemed fine, potentially helped fix some of the issues with early-ctx instruct following. I could not find any real negatives to this add.