asiansoul commited on
Commit
653f22f
ยท
verified ยท
1 Parent(s): ec90c12

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -57
README.md CHANGED
@@ -19,58 +19,15 @@ tags:
19
  ---
20
  # YACHT-Llama-3-KoEn-8B
21
 
22
- <a href="https://ibb.co/tHkMB64"><img src="https://i.ibb.co/Zft6drV/Screenshot-2024-05-07-at-2-45-38-AM.png" alt="Screenshot-2024-05-07-at-2-45-38-AM" border="0"></a>
23
- <a href="https://ibb.co/JtsN25B"><img src="https://i.ibb.co/V9qdD2j/Screenshot-2024-05-07-at-2-45-55-AM.png" alt="Screenshot-2024-05-07-at-2-45-55-AM" border="0"></a>
24
- <a href="https://ibb.co/X8JhVMk"><img src="https://i.ibb.co/3zhDkQY/Screenshot-2024-05-07-at-2-46-11-AM.png" alt="Screenshot-2024-05-07-at-2-46-11-AM" border="0"></a>
25
- <a href="https://ibb.co/XFZfvLm"><img src="https://i.ibb.co/qmMLPjb/Screenshot-2024-05-07-at-2-46-18-AM.png" alt="Screenshot-2024-05-07-at-2-46-18-AM" border="0"></a>
26
- <a href="https://ibb.co/7Khf8B3"><img src="https://i.ibb.co/YhgCYJ5/Screenshot-2024-05-07-at-2-51-23-AM.png" alt="Screenshot-2024-05-07-at-2-51-23-AM" border="0"></a>
27
- <a href="https://ibb.co/9tsDj40"><img src="https://i.ibb.co/sHyfr14/Screenshot-2024-05-07-at-2-46-48-AM.png" alt="Screenshot-2024-05-07-at-2-46-48-AM" border="0"></a>
28
- <a href="https://ibb.co/z8FmLRz"><img src="https://i.ibb.co/HNCKMzj/Screenshot-2024-05-07-at-2-49-45-AM.png" alt="Screenshot-2024-05-07-at-2-49-45-AM" border="0"></a>
29
 
30
- ### Merge Method
31
 
32
- ```
33
- jaylee@lees-MacBook-Pro-2 youtube % ./ollama create yahht_v1 -f ./gguf/hf_hub/Modelfile_Q5_K_M
34
- transferring model data
35
- creating model layer
36
- creating template layer
37
- creating system layer
38
- creating parameters layer
39
- creating config layer
40
- using already created layer sha256:2def4bed3c8fe78c1698dd1231f7171d0d2bf486f32f176363355407ade95662
41
- using already created layer sha256:a6f440dc634252d55a441bbe8710e373456b37a594eb309b765e4ddb03b0872c
42
- using already created layer sha256:ae2974c64ea5d6f488eeb1b10717a270f48fb3452432589db6f5e60472ae96ac
43
- writing layer sha256:65439eabce8efb44a58abcb17283801575b1dab665fc6827fb671ce2ab9dc68f
44
- writing layer sha256:8f48c0791f5b8c657d90f572145ab01ece1309cd1538e25209d2190a9bab5c83
45
- writing manifest
46
- success
47
 
48
- ```
49
-
50
- ```
51
- FROM yacht-llama-3-koen-8b-Q5_K_M.gguf
52
- TEMPLATE """
53
- {{- if .System }}
54
- system
55
- <s>{{ .System }}</s>
56
- {{- end }}
57
- user
58
- <s>Human:
59
- {{ .Prompt }}</s>
60
- assistant
61
- <s>Assistant:
62
- """
63
 
64
- SYSTEM """
65
- ์นœ์ ˆํ•œ ์ฑ—๋ด‡์œผ๋กœ์„œ ์ƒ๋Œ€๋ฐฉ์˜ ์š”์ฒญ์— ์ตœ๋Œ€ํ•œ ์ž์„ธํ•˜๊ณ  ์นœ์ ˆํ•˜๊ฒŒ ๋‹ตํ•˜์ž. ๋ชจ๋“  ๋Œ€๋‹ต์€ ํ•œ๊ตญ์–ด(Korean)์œผ๋กœ ๋Œ€๋‹ตํ•ด์ค˜.
66
- """
67
-
68
- PARAMETER temperature 0.7
69
- PARAMETER num_predict 3000
70
- PARAMETER num_ctx 4096
71
- PARAMETER stop "<s>"
72
- PARAMETER stop "</s>"
73
- ```
74
 
75
  ### Merge Method
76
 
@@ -96,7 +53,6 @@ The following YAML configuration was used to produce this model:
96
  ```yaml
97
  models:
98
  - model: NousResearch/Meta-Llama-3-8B
99
-
100
  - model: NousResearch/Meta-Llama-3-8B-Instruct
101
  parameters:
102
  density: 0.60
@@ -116,37 +72,38 @@ models:
116
  parameters:
117
  density: 0.55
118
  weight: 0.15
119
-
120
  - model: nvidia/Llama3-ChatQA-1.5-8B
121
  parameters:
122
  density: 0.55
123
  weight: 0.1
124
-
125
  - model: cognitivecomputations/dolphin-2.9-llama3-8b
126
  parameters:
127
  density: 0.55
128
  weight: 0.05
129
-
130
  - model: Danielbrdz/Barcenas-Llama3-8b-ORPO
131
  parameters:
132
  density: 0.55
133
  weight: 0.05
134
-
135
  - model: abacusai/Llama-3-Smaug-8B
136
  parameters:
137
  density: 0.55
138
  weight: 0.05
139
-
140
  - model: aaditya/Llama3-OpenBioLLM-8B
141
  parameters:
142
  density: 0.55
143
  weight: 0.1
144
-
145
  merge_method: dare_ties
146
  base_model: NousResearch/Meta-Llama-3-8B
147
  parameters:
148
  int8_mask: true
149
  dtype: bfloat16
150
-
151
-
152
  ```
 
 
 
 
 
 
 
 
 
 
19
  ---
20
  # YACHT-Llama-3-KoEn-8B
21
 
22
+ <a href="https://ibb.co/SyT5vj5"><img src="https://i.ibb.co/DWXzKJz/Screenshot-2024-05-07-at-3-04-45-AM.png" alt="Screenshot-2024-05-07-at-3-04-45-AM" border="0"></a>
 
 
 
 
 
 
23
 
24
+ ๐ŸŽต *[JayLee LLMs Signature Tag] : โœ๏ธ "I need a Jay Jay chat boy"* ๐ŸŽต
25
 
26
+ โœจ *Navigating the High Seas of Data: Crafting the Ultimate Yacht Insights with Merged LLMs* โœจ
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
+ โœจ *Arenโ€™t you sometimes tired of just doing LLM & RAG & Normal Chat app? I'll show you a cool app soon integrating this my merged one(Tuned car). It wouldn't be fun if we only developed cars, so life is ultimately about driving cars and socializing with people.* โœจ
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
 
30
+ ๐Ÿงจ *When using the Merge model for commercial purposes, a lot of care is needed. A mix of many models can be good, but it can also pose many risks.* ๐Ÿงจ
 
 
 
 
 
 
 
 
 
31
 
32
  ### Merge Method
33
 
 
53
  ```yaml
54
  models:
55
  - model: NousResearch/Meta-Llama-3-8B
 
56
  - model: NousResearch/Meta-Llama-3-8B-Instruct
57
  parameters:
58
  density: 0.60
 
72
  parameters:
73
  density: 0.55
74
  weight: 0.15
 
75
  - model: nvidia/Llama3-ChatQA-1.5-8B
76
  parameters:
77
  density: 0.55
78
  weight: 0.1
 
79
  - model: cognitivecomputations/dolphin-2.9-llama3-8b
80
  parameters:
81
  density: 0.55
82
  weight: 0.05
 
83
  - model: Danielbrdz/Barcenas-Llama3-8b-ORPO
84
  parameters:
85
  density: 0.55
86
  weight: 0.05
 
87
  - model: abacusai/Llama-3-Smaug-8B
88
  parameters:
89
  density: 0.55
90
  weight: 0.05
 
91
  - model: aaditya/Llama3-OpenBioLLM-8B
92
  parameters:
93
  density: 0.55
94
  weight: 0.1
 
95
  merge_method: dare_ties
96
  base_model: NousResearch/Meta-Llama-3-8B
97
  parameters:
98
  int8_mask: true
99
  dtype: bfloat16
 
 
100
  ```
101
+
102
+ ### Test
103
+ <a href="https://ibb.co/tHkMB64"><img src="https://i.ibb.co/Zft6drV/Screenshot-2024-05-07-at-2-45-38-AM.png" alt="Screenshot-2024-05-07-at-2-45-38-AM" border="0"></a>
104
+ <a href="https://ibb.co/JtsN25B"><img src="https://i.ibb.co/V9qdD2j/Screenshot-2024-05-07-at-2-45-55-AM.png" alt="Screenshot-2024-05-07-at-2-45-55-AM" border="0"></a>
105
+ <a href="https://ibb.co/X8JhVMk"><img src="https://i.ibb.co/3zhDkQY/Screenshot-2024-05-07-at-2-46-11-AM.png" alt="Screenshot-2024-05-07-at-2-46-11-AM" border="0"></a>
106
+ <a href="https://ibb.co/XFZfvLm"><img src="https://i.ibb.co/qmMLPjb/Screenshot-2024-05-07-at-2-46-18-AM.png" alt="Screenshot-2024-05-07-at-2-46-18-AM" border="0"></a>
107
+ <a href="https://ibb.co/7Khf8B3"><img src="https://i.ibb.co/YhgCYJ5/Screenshot-2024-05-07-at-2-51-23-AM.png" alt="Screenshot-2024-05-07-at-2-51-23-AM" border="0"></a>
108
+ <a href="https://ibb.co/9tsDj40"><img src="https://i.ibb.co/sHyfr14/Screenshot-2024-05-07-at-2-46-48-AM.png" alt="Screenshot-2024-05-07-at-2-46-48-AM" border="0"></a>
109
+ <a href="https://ibb.co/z8FmLRz"><img src="https://i.ibb.co/HNCKMzj/Screenshot-2024-05-07-at-2-49-45-AM.png" alt="Screenshot-2024-05-07-at-2-49-45-AM" border="0"></a>