alpindale commited on
Commit
d6ea85a
·
verified ·
1 Parent(s): b50b699

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -32
README.md CHANGED
@@ -1,38 +1,8 @@
1
  ---
2
  base_model:
3
- - Qwen/Qwen2.5-0.5B
4
  library_name: transformers
5
- tags:
6
- - mergekit
7
- - merge
8
 
9
  ---
10
- # merged
11
 
12
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
-
14
- ## Merge Details
15
- ### Merge Method
16
-
17
- This model was merged using the passthrough merge method.
18
-
19
- ### Models Merged
20
-
21
- The following models were included in the merge:
22
- * [Qwen/Qwen2.5-0.5B](https://huggingface.co/Qwen/Qwen2.5-0.5B)
23
-
24
- ### Configuration
25
-
26
- The following YAML configuration was used to produce this model:
27
-
28
- ```yaml
29
- dtype: bfloat16
30
- merge_method: passthrough
31
- slices:
32
- - sources:
33
- - layer_range: [0, 1]
34
- model: Qwen/Qwen2.5-0.5B
35
- - sources:
36
- - layer_range: [19, 24]
37
- model: Qwen/Qwen2.5-0.5B
38
- ```
 
1
  ---
2
  base_model:
3
+ - alpindale/Qwen2.5-0.2B
4
  library_name: transformers
 
 
 
5
 
6
  ---
 
7
 
8
+ Pruned from [Qwen2.5-0.5B](https://huggingface.co/Qwen/Qwen2.5-0.5B)