antiven0m commited on
Commit
9f25c0e
·
verified ·
1 Parent(s): 201eb65

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -3
README.md CHANGED
@@ -13,13 +13,25 @@ library_name: transformers
13
 
14
  ![Finch](https://i.imgur.com/xGpoByi.jpeg)
15
 
16
- # Finch
17
-
18
  ## A SLERP merge of my two current fav 7B models
 
19
  [macadeliccc/WestLake-7B-v2-laser-truthy-dpo](https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo) & [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
20
 
21
  A 6bpw EXL2 quant of [Finch](https://huggingface.co/antiven0m/finch)
22
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ```yaml
24
  base_model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
25
  dtype: float16
@@ -37,4 +49,4 @@ slices:
37
  model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
38
  - layer_range: [0, 32]
39
  model: SanjiWatsuki/Kunoichi-DPO-v2-7B
40
- ```
 
13
 
14
  ![Finch](https://i.imgur.com/xGpoByi.jpeg)
15
 
16
+ # **Finch 7b Merge**
 
17
  ## A SLERP merge of my two current fav 7B models
18
+
19
  [macadeliccc/WestLake-7B-v2-laser-truthy-dpo](https://huggingface.co/macadeliccc/WestLake-7B-v2-laser-truthy-dpo) & [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
20
 
21
  A 6bpw EXL2 quant of [Finch](https://huggingface.co/antiven0m/finch)
22
 
23
+ I'm open to doing others quants, just ask.
24
+
25
+ - [GGUF Quants](https://huggingface.co/antiven0m/finch-gguf)
26
+
27
+ ## Settings
28
+ I reccomend using the **ChatML** format. As for samplers, I reccomend the following:
29
+ ```yml
30
+ Temperature: 1.2
31
+ Min P: 0.2
32
+ Smoothing Factor: 0.2
33
+ ```
34
+ ## Mergekit Config
35
  ```yaml
36
  base_model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
37
  dtype: float16
 
49
  model: macadeliccc/WestLake-7B-v2-laser-truthy-dpo
50
  - layer_range: [0, 32]
51
  model: SanjiWatsuki/Kunoichi-DPO-v2-7B
52
+ ```