File size: 2,742 Bytes
562d547 8835980 562d547 a30e168 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 8835980 562d547 0a6a08c 562d547 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- MediaTek-Research/Breeze-7B-32k-Base-v1_0
---
# 我的DC sever
https://discord.gg/yaTfFF6Ut2
# 我正在計畫微調64K指令模型，請幫助我進行計畫
Support me here if you're interested:
Ko-fi: https://ko-fi.com/ogodwin10。
# 更大的模型
是的，一但有資源我就會開始完成更大的模型，並微調這些模型。
如果您想要其他模型或是其他服務，請在DC上給我留言。我們可以談。
# Breeze-13B-32k-Base-v1_0
Breeze-13B-32k-Base-v1_0 is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
* [MediaTek-Research/Breeze-7B-32k-Base-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-32k-Base-v1_0)
## 🧩 Configuration
```yaml
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 8]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [0, 8]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [4, 12]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [4, 12]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [8, 16]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [8, 16]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [12, 20]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [12, 20]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [16, 24]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [16, 24]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [20, 28]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [20, 28]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- sources:
- layer_range: [24, 32]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
- layer_range: [24, 32]
model: MediaTek-Research/Breeze-7B-32k-Base-v1_0
``` |