karrelin commited on
Commit
9fd613f
·
verified ·
1 Parent(s): a551682

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  base_model:
3
- - Sao10K/L3.1-8B-Niitama-v1.1
4
  - akjindal53244/Llama-3.1-Storm-8B
 
5
  library_name: transformers
6
  tags:
7
  - mergekit
@@ -15,12 +15,11 @@ This is a merge of pre-trained language models created using [mergekit](https://
15
  ## Merge Details
16
  ### Merge Method
17
 
18
- This model was merged using the SLERP merge method.
19
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1)
24
  * [akjindal53244/Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
25
 
26
  ### Configuration
@@ -32,7 +31,7 @@ The following YAML configuration was used to produce this model:
32
  models:
33
  - model: Sao10K/L3.1-8B-Niitama-v1.1
34
  - model: akjindal53244/Llama-3.1-Storm-8B
35
- merge_method: slerp
36
  base_model: Sao10K/L3.1-8B-Niitama-v1.1
37
  parameters:
38
  t: 0.0001
 
1
  ---
2
  base_model:
 
3
  - akjindal53244/Llama-3.1-Storm-8B
4
+ - Sao10K/L3.1-8B-Niitama-v1.1
5
  library_name: transformers
6
  tags:
7
  - mergekit
 
15
  ## Merge Details
16
  ### Merge Method
17
 
18
+ This model was merged using the nearswap merge method using [Sao10K/L3.1-8B-Niitama-v1.1](https://huggingface.co/Sao10K/L3.1-8B-Niitama-v1.1) as a base.
19
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
 
23
  * [akjindal53244/Llama-3.1-Storm-8B](https://huggingface.co/akjindal53244/Llama-3.1-Storm-8B)
24
 
25
  ### Configuration
 
31
  models:
32
  - model: Sao10K/L3.1-8B-Niitama-v1.1
33
  - model: akjindal53244/Llama-3.1-Storm-8B
34
+ merge_method: nearswap
35
  base_model: Sao10K/L3.1-8B-Niitama-v1.1
36
  parameters:
37
  t: 0.0001
mergekit_config.yml CHANGED
@@ -2,7 +2,7 @@
2
  models:
3
  - model: Sao10K/L3.1-8B-Niitama-v1.1
4
  - model: akjindal53244/Llama-3.1-Storm-8B
5
- merge_method: slerp
6
  base_model: Sao10K/L3.1-8B-Niitama-v1.1
7
  parameters:
8
  t: 0.0001
 
2
  models:
3
  - model: Sao10K/L3.1-8B-Niitama-v1.1
4
  - model: akjindal53244/Llama-3.1-Storm-8B
5
+ merge_method: nearswap
6
  base_model: Sao10K/L3.1-8B-Niitama-v1.1
7
  parameters:
8
  t: 0.0001
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af9a5b2faf534b3436326bdbeefa80b0fd86f2bbd8e7f0928c00159d377fb203
3
  size 4953586384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fc0b18bd918f51e96e79e4d53a6283da0c2115ef9ba8c5b7f3b57bf4ef274ad
3
  size 4953586384
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:847a742e9d75abd2a5a0e5dc5115a49ad2a65eca3d7fc892cda15562279eaf6b
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2f4310fd08d993e1244efbf2f8c8896a39a6bab2b9a3689dbe50af61dc51b05
3
  size 4999819336
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:751446ae7557167d61feda071f498d9dfe92724c3edd0369d155d0d3f41d6032
3
  size 4915916144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:571fd23e2307329fd702dd6438887d348f2b195721215bb5ff51ea0de05d091d
3
  size 4915916144
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c10b6ad7984b33e5b85099c8efca491933b98159eef931b841690e769d8e52aa
3
  size 1191234472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e26f9a4b1a6b84bca3564155e29edf8b009de4db36245937ffe0962a96abed69
3
  size 1191234472