| This is the test version for pruning. This model is a base model that will be pruned and quantized for on-device purpose. | |
| I used mergekit for merging two models: | |
| https://github.com/cg123/mergekit | |
| The two models I combined are: | |
| https://huggingface.co/jeonsworld/CarbonVillain-en-10.7B-v2 | |
| https://huggingface.co/kyujinpy/Sakura-SOLAR-Instruct-DPO-v2 | |
| I used GGUF quantization. |