Hjgugugjhuhjggg commited on
Commit
34ac96f
·
verified ·
1 Parent(s): 5cac5bb

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -1,10 +1,10 @@
1
  ---
2
  base_model:
 
3
  - meta-llama/Llama-3.2-3B-Instruct
4
  - chuanli11/Llama-3.2-3B-Instruct-uncensored
5
- - huihui-ai/Llama-3.2-3B-Instruct-abliterated
6
- - meta-llama/Llama-3.2-3B
7
  - bunnycore/Llama-3.2-3B-ProdigyPlusPlus
 
8
  library_name: transformers
9
  tags:
10
  - mergekit
@@ -18,15 +18,15 @@ This is a merge of pre-trained language models created using [mergekit](https://
18
  ## Merge Details
19
  ### Merge Method
20
 
21
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [bunnycore/Llama-3.2-3B-ProdigyPlusPlus](https://huggingface.co/bunnycore/Llama-3.2-3B-ProdigyPlusPlus) as a base.
22
 
23
  ### Models Merged
24
 
25
  The following models were included in the merge:
 
26
  * [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct)
27
  * [chuanli11/Llama-3.2-3B-Instruct-uncensored](https://huggingface.co/chuanli11/Llama-3.2-3B-Instruct-uncensored)
28
- * [huihui-ai/Llama-3.2-3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated)
29
- * [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B)
30
 
31
  ### Configuration
32
 
@@ -34,9 +34,9 @@ The following YAML configuration was used to produce this model:
34
 
35
  ```yaml
36
  base_model:
37
- model: bunnycore/Llama-3.2-3B-ProdigyPlusPlus
38
  dtype: float16
39
- merge_method: ties
40
  merge_method_sequence:
41
  - dare_ties
42
  - ties
 
1
  ---
2
  base_model:
3
+ - meta-llama/Llama-3.2-3B
4
  - meta-llama/Llama-3.2-3B-Instruct
5
  - chuanli11/Llama-3.2-3B-Instruct-uncensored
 
 
6
  - bunnycore/Llama-3.2-3B-ProdigyPlusPlus
7
+ - huihui-ai/Llama-3.2-3B-Instruct-abliterated
8
  library_name: transformers
9
  tags:
10
  - mergekit
 
18
  ## Merge Details
19
  ### Merge Method
20
 
21
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [huihui-ai/Llama-3.2-3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated) as a base.
22
 
23
  ### Models Merged
24
 
25
  The following models were included in the merge:
26
+ * [meta-llama/Llama-3.2-3B](https://huggingface.co/meta-llama/Llama-3.2-3B)
27
  * [meta-llama/Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct)
28
  * [chuanli11/Llama-3.2-3B-Instruct-uncensored](https://huggingface.co/chuanli11/Llama-3.2-3B-Instruct-uncensored)
29
+ * [bunnycore/Llama-3.2-3B-ProdigyPlusPlus](https://huggingface.co/bunnycore/Llama-3.2-3B-ProdigyPlusPlus)
 
30
 
31
  ### Configuration
32
 
 
34
 
35
  ```yaml
36
  base_model:
37
+ model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
38
  dtype: float16
39
+ merge_method: dare_ties
40
  merge_method_sequence:
41
  - dare_ties
42
  - ties
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "bunnycore/Llama-3.2-3B-ProdigyPlusPlus",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
 
1
  {
2
+ "_name_or_path": "huihui-ai/Llama-3.2-3B-Instruct-abliterated",
3
  "architectures": [
4
  "LlamaForCausalLM"
5
  ],
mergekit_config.yml CHANGED
@@ -1,7 +1,7 @@
1
  base_model:
2
- model: bunnycore/Llama-3.2-3B-ProdigyPlusPlus
3
  dtype: float16
4
- merge_method: ties
5
  merge_method_sequence:
6
  - dare_ties
7
  - ties
 
1
  base_model:
2
+ model: huihui-ai/Llama-3.2-3B-Instruct-abliterated
3
  dtype: float16
4
+ merge_method: dare_ties
5
  merge_method_sequence:
6
  - dare_ties
7
  - ties
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a912a44fc0022a36e49beb59c5a6f2d3db36dcb5803079caab04900f2854c167
3
  size 4998794808
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb365cdd09c449af34cff4fd35e112c037c3d4993a00cc4bdc0819c40f8dd9fe
3
  size 4998794808
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:186db3644ffe2e65b859971d8f6b06677e7078da924701171e8ba81a486fe336
3
  size 2214738976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8763842ec8aa4cf5b6e971197032826f9f5523b036b927e03d137d2072d54ed7
3
  size 2214738976