Suggestion for Instruction Following Model
#1
by
PrimeD
- opened
About 3 months ago, I tried this series of models from Ensemble. It seemed to me at that point that they were really good at following instructions and remembering things. They even had good literal prose, yet they were SFW.
- https://huggingface.co/TheBloke/Llama-2-70B-Ensemble-v5-GGUF/tree/main
- https://huggingface.co/TheBloke/Llama-2-13B-Ensemble-v5-GGUF
- https://huggingface.co/TheBloke/Llama-2-13B-Ensemble-v6-GGUF
Just bringing it to your attention, in case it's of help, you can check them out here. 😄
Danger is that that may cause issues like the inclusion of xwin does. Using their instruct format will then provide you good instruction following but will bring out the alignment to the top.
Ideally training on their dataset minus the safety in the manner they did is the solution but it's an expensive one.