Upload folder using huggingface_hub

README.md

@@ -0,0 +1,29 @@
+---
+license: apache-2.0
+tags:
+- merge
+- mergekit
+- lazymergekit
+- TinyLlama/TinyLlama-1.1B-Chat-v1.0
+- TinyLlama/TinyLlama-1.1B-intermediate-step-715k-1.5T
+---
+
+# tinyllama_merged
+
+tinyllama_merged is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
+* [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
+* [TinyLlama/TinyLlama-1.1B-intermediate-step-715k-1.5T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-715k-1.5T)
+
+## 🧩 Configuration
+
+```yaml
+slices:
+  - sources:
+    - model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
+      layer_range: [0, 16]
+  - sources:
+    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-715k-1.5T
+      layer_range: [12, 24]
+merge_method: passthrough
+dtype: bfloat16
+```