Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
@@ -33,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.GGUF filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,49 @@
 ---
+base_model:
+- SanjiWatsuki/Kunoichi-7B
+- SanjiWatsuki/Kunoichi-DPO-v2-7B
+library_name: transformers
+tags:
+- mergekit
+- merge
 license: cc-by-nc-4.0
 ---
+# kuno-kunoichi-v1-DPO-v2-SLERP-7B
+
+kuno-kunoichi-v1-DPO-v2-SLERP-7B is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+I'm hoping that the result is more robust against errors or when merging due to "denseness", as the two models likely implement comparable reasoning at least somewhat differently.
+
+I've performed some testing with ChatML format prompting using temperature=1.1 and minP=0.03. The model also supports Alpaca format prompts.
+
+[GGUF-IQ-Imatrix quants helpfully provided by Lewdiculous.](https://huggingface.co/Lewdiculous/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF-IQ-Imatrix)
+
+## Merge Details
+### Merge Method
+
+This model was merged using the SLERP merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [SanjiWatsuki/Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B)
+* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+  - sources:
+    - model: SanjiWatsuki/Kunoichi-7B
+      layer_range: [0,32]
+    - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
+      layer_range: [0,32]
+merge_method: slerp
+base_model: SanjiWatsuki/Kunoichi-7B
+parameters:
+  t:
+    - value: 0.5
+dtype: float16
+
+```

kuno-kunoichi-v1-DPO-v2-SLERP-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a39bb5da986ec3c5566fa43fe00323a408ebbcb3c4e82db4acd92dfea00e048c
+size 7695857376