Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text

Magot-v2-Gemma2-8k-9B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9f5d332deb06a6625e66a8712633afe8904186e382ddea5c722bbc341e6b44f
+size 5761058336

Magot-v2-Gemma2-8k-9B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d6c9f8576c41d47513ed462e37367b86952d053211a91d7292998aff9162a530
+size 6647367200

Magot-v2-Gemma2-8k-9B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:206155f9b4eb1f304dd8b1c9e4be0aa5845e41e0ec3f63f6f48048e1c5bb793f
+size 7589070368

Magot-v2-Gemma2-8k-9B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c716ecddca3450a392952d2ccace5348439c26ae6759a786658bca67e0d70e41
+size 9827149344

README.md

@@ -1,3 +1,55 @@
 ---
+base_model:
+- grimjim/Magot-v2-Gemma2-8k-9B
+library_name: transformers
+tags:
+- mergekit
+- merge
 license: gemma
+quanted_by: grimjim
+pipeline_tag: text-generation
 ---
+# Magot-v2-Gemma2-8k-9B
+
+This repo contains a GGUF quants of a pre-trained language model created using [mergekit](https://github.com/cg123/mergekit).
+
+There is still some damage to the model from merging, but that has been partially mitigated by retaining embed_tokens and lm_head weights from the base model. This approach has proven to be more stable than task arithmetic merger.
+
+Tested at temp=1, minP=0.01. Coherence is moderately high, though not perfect. The low weight (0.01) infusion of the Magnum model provided variety to text generation. This model is being released because it is "good enough" and interesting. Inherent model safety is still strong due to Instruct base, but narratives are less bounded by positivity.
+
+There appear to be some melodramatic motifs that the model inherently steers toward when allowed to go its own way. The notion of favored tropes baked into a model is likely understudied, and is another lens through which model explainability can be viewed.
+
+## Merge Details
+### Merge Method
+
+This model was merged using the SLERP merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [anthracite-org/magnum-v3-9b-customgemma2](https://huggingface.co/anthracite-org/magnum-v3-9b-customgemma2)
+* [grimjim/Kitsunebi-v1-Gemma2-8k-9B](https://huggingface.co/grimjim/Kitsunebi-v1-Gemma2-8k-9B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+- sources:
+  - model: grimjim/Kitsunebi-v1-Gemma2-8k-9B
+    layer_range: [0, 42]
+  - model: anthracite-org/magnum-v3-9b-customgemma2
+    layer_range: [0, 42]
+merge_method: slerp
+base_model: grimjim/Kitsunebi-v1-Gemma2-8k-9B
+parameters:
+  t:
+    - filter: embed_tokens
+      value: 0.0
+    - filter: lm_head
+      value: 0.0
+    - value: 0.01
+dtype: bfloat16
+
+```