Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,11 @@ tags:
|
|
| 9 |
inference: true
|
| 10 |
license: other
|
| 11 |
---
|
| 12 |
-
This model is a merge/fusion of [Aryanne/Astridboros-3B](https://huggingface.co/Aryanne/Astridboros-3B) and [stabilityai/stablelm-zephyr-3b](https://huggingface.co/stabilityai/stablelm-zephyr-3b) , 28 layers of Zephyr + 12 of Astridboros together(see zephyr-3.43b.yml or below).
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
|
| 15 |
```yaml
|
|
@@ -26,6 +30,16 @@ slices:
|
|
| 26 |
merge_method: passthrough
|
| 27 |
dtype: float16
|
| 28 |
```
|
|
|
|
| 29 |
I recommend the use of the Zephyr prompt format.
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
GGUF Quants: [notyet](not yet)
|
|
|
|
| 9 |
inference: true
|
| 10 |
license: other
|
| 11 |
---
|
| 12 |
+
This model is a merge/fusion of [Aryanne/Astridboros-3B](https://huggingface.co/Aryanne/Astridboros-3B) and [stabilityai/stablelm-zephyr-3b](https://huggingface.co/stabilityai/stablelm-zephyr-3b) , 28 layers of Zephyr + 12 layers of Astridboros together(see zephyr-3.43b.yml or below).
|
| 13 |
+
|
| 14 |
+
A total of 40 layers, with 3.43B of parameters.
|
| 15 |
+
|
| 16 |
+
License it's the same as Zephyr cause it has 70% of it.
|
| 17 |
|
| 18 |
|
| 19 |
```yaml
|
|
|
|
| 30 |
merge_method: passthrough
|
| 31 |
dtype: float16
|
| 32 |
```
|
| 33 |
+
|
| 34 |
I recommend the use of the Zephyr prompt format.
|
| 35 |
|
| 36 |
+
```
|
| 37 |
+
<|user|>
|
| 38 |
+
List 3 synonyms for the word "tiny"<|endoftext|>
|
| 39 |
+
<|assistant|>
|
| 40 |
+
1. Dwarf
|
| 41 |
+
2. Little
|
| 42 |
+
3. Petite<|endoftext|>
|
| 43 |
+
```
|
| 44 |
+
|
| 45 |
GGUF Quants: [notyet](not yet)
|