Update README.md
Browse files
README.md
CHANGED
@@ -19,58 +19,15 @@ tags:
|
|
19 |
---
|
20 |
# YACHT-Llama-3-KoEn-8B
|
21 |
|
22 |
-
<a href="https://ibb.co/
|
23 |
-
<a href="https://ibb.co/JtsN25B"><img src="https://i.ibb.co/V9qdD2j/Screenshot-2024-05-07-at-2-45-55-AM.png" alt="Screenshot-2024-05-07-at-2-45-55-AM" border="0"></a>
|
24 |
-
<a href="https://ibb.co/X8JhVMk"><img src="https://i.ibb.co/3zhDkQY/Screenshot-2024-05-07-at-2-46-11-AM.png" alt="Screenshot-2024-05-07-at-2-46-11-AM" border="0"></a>
|
25 |
-
<a href="https://ibb.co/XFZfvLm"><img src="https://i.ibb.co/qmMLPjb/Screenshot-2024-05-07-at-2-46-18-AM.png" alt="Screenshot-2024-05-07-at-2-46-18-AM" border="0"></a>
|
26 |
-
<a href="https://ibb.co/7Khf8B3"><img src="https://i.ibb.co/YhgCYJ5/Screenshot-2024-05-07-at-2-51-23-AM.png" alt="Screenshot-2024-05-07-at-2-51-23-AM" border="0"></a>
|
27 |
-
<a href="https://ibb.co/9tsDj40"><img src="https://i.ibb.co/sHyfr14/Screenshot-2024-05-07-at-2-46-48-AM.png" alt="Screenshot-2024-05-07-at-2-46-48-AM" border="0"></a>
|
28 |
-
<a href="https://ibb.co/z8FmLRz"><img src="https://i.ibb.co/HNCKMzj/Screenshot-2024-05-07-at-2-49-45-AM.png" alt="Screenshot-2024-05-07-at-2-49-45-AM" border="0"></a>
|
29 |
|
30 |
-
|
31 |
|
32 |
-
|
33 |
-
jaylee@lees-MacBook-Pro-2 youtube % ./ollama create yahht_v1 -f ./gguf/hf_hub/Modelfile_Q5_K_M
|
34 |
-
transferring model data
|
35 |
-
creating model layer
|
36 |
-
creating template layer
|
37 |
-
creating system layer
|
38 |
-
creating parameters layer
|
39 |
-
creating config layer
|
40 |
-
using already created layer sha256:2def4bed3c8fe78c1698dd1231f7171d0d2bf486f32f176363355407ade95662
|
41 |
-
using already created layer sha256:a6f440dc634252d55a441bbe8710e373456b37a594eb309b765e4ddb03b0872c
|
42 |
-
using already created layer sha256:ae2974c64ea5d6f488eeb1b10717a270f48fb3452432589db6f5e60472ae96ac
|
43 |
-
writing layer sha256:65439eabce8efb44a58abcb17283801575b1dab665fc6827fb671ce2ab9dc68f
|
44 |
-
writing layer sha256:8f48c0791f5b8c657d90f572145ab01ece1309cd1538e25209d2190a9bab5c83
|
45 |
-
writing manifest
|
46 |
-
success
|
47 |
|
48 |
-
|
49 |
-
|
50 |
-
```
|
51 |
-
FROM yacht-llama-3-koen-8b-Q5_K_M.gguf
|
52 |
-
TEMPLATE """
|
53 |
-
{{- if .System }}
|
54 |
-
system
|
55 |
-
<s>{{ .System }}</s>
|
56 |
-
{{- end }}
|
57 |
-
user
|
58 |
-
<s>Human:
|
59 |
-
{{ .Prompt }}</s>
|
60 |
-
assistant
|
61 |
-
<s>Assistant:
|
62 |
-
"""
|
63 |
|
64 |
-
|
65 |
-
์น์ ํ ์ฑ๋ด์ผ๋ก์ ์๋๋ฐฉ์ ์์ฒญ์ ์ต๋ํ ์์ธํ๊ณ ์น์ ํ๊ฒ ๋ตํ์. ๋ชจ๋ ๋๋ต์ ํ๊ตญ์ด(Korean)์ผ๋ก ๋๋ตํด์ค.
|
66 |
-
"""
|
67 |
-
|
68 |
-
PARAMETER temperature 0.7
|
69 |
-
PARAMETER num_predict 3000
|
70 |
-
PARAMETER num_ctx 4096
|
71 |
-
PARAMETER stop "<s>"
|
72 |
-
PARAMETER stop "</s>"
|
73 |
-
```
|
74 |
|
75 |
### Merge Method
|
76 |
|
@@ -96,7 +53,6 @@ The following YAML configuration was used to produce this model:
|
|
96 |
```yaml
|
97 |
models:
|
98 |
- model: NousResearch/Meta-Llama-3-8B
|
99 |
-
|
100 |
- model: NousResearch/Meta-Llama-3-8B-Instruct
|
101 |
parameters:
|
102 |
density: 0.60
|
@@ -116,37 +72,38 @@ models:
|
|
116 |
parameters:
|
117 |
density: 0.55
|
118 |
weight: 0.15
|
119 |
-
|
120 |
- model: nvidia/Llama3-ChatQA-1.5-8B
|
121 |
parameters:
|
122 |
density: 0.55
|
123 |
weight: 0.1
|
124 |
-
|
125 |
- model: cognitivecomputations/dolphin-2.9-llama3-8b
|
126 |
parameters:
|
127 |
density: 0.55
|
128 |
weight: 0.05
|
129 |
-
|
130 |
- model: Danielbrdz/Barcenas-Llama3-8b-ORPO
|
131 |
parameters:
|
132 |
density: 0.55
|
133 |
weight: 0.05
|
134 |
-
|
135 |
- model: abacusai/Llama-3-Smaug-8B
|
136 |
parameters:
|
137 |
density: 0.55
|
138 |
weight: 0.05
|
139 |
-
|
140 |
- model: aaditya/Llama3-OpenBioLLM-8B
|
141 |
parameters:
|
142 |
density: 0.55
|
143 |
weight: 0.1
|
144 |
-
|
145 |
merge_method: dare_ties
|
146 |
base_model: NousResearch/Meta-Llama-3-8B
|
147 |
parameters:
|
148 |
int8_mask: true
|
149 |
dtype: bfloat16
|
150 |
-
|
151 |
-
|
152 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
---
|
20 |
# YACHT-Llama-3-KoEn-8B
|
21 |
|
22 |
+
<a href="https://ibb.co/SyT5vj5"><img src="https://i.ibb.co/DWXzKJz/Screenshot-2024-05-07-at-3-04-45-AM.png" alt="Screenshot-2024-05-07-at-3-04-45-AM" border="0"></a>
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
|
24 |
+
๐ต *[JayLee LLMs Signature Tag] : โ๏ธ "I need a Jay Jay chat boy"* ๐ต
|
25 |
|
26 |
+
โจ *Navigating the High Seas of Data: Crafting the Ultimate Yacht Insights with Merged LLMs* โจ
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
|
28 |
+
โจ *Arenโt you sometimes tired of just doing LLM & RAG & Normal Chat app? I'll show you a cool app soon integrating this my merged one(Tuned car). It wouldn't be fun if we only developed cars, so life is ultimately about driving cars and socializing with people.* โจ
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
|
30 |
+
๐งจ *When using the Merge model for commercial purposes, a lot of care is needed. A mix of many models can be good, but it can also pose many risks.* ๐งจ
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
|
32 |
### Merge Method
|
33 |
|
|
|
53 |
```yaml
|
54 |
models:
|
55 |
- model: NousResearch/Meta-Llama-3-8B
|
|
|
56 |
- model: NousResearch/Meta-Llama-3-8B-Instruct
|
57 |
parameters:
|
58 |
density: 0.60
|
|
|
72 |
parameters:
|
73 |
density: 0.55
|
74 |
weight: 0.15
|
|
|
75 |
- model: nvidia/Llama3-ChatQA-1.5-8B
|
76 |
parameters:
|
77 |
density: 0.55
|
78 |
weight: 0.1
|
|
|
79 |
- model: cognitivecomputations/dolphin-2.9-llama3-8b
|
80 |
parameters:
|
81 |
density: 0.55
|
82 |
weight: 0.05
|
|
|
83 |
- model: Danielbrdz/Barcenas-Llama3-8b-ORPO
|
84 |
parameters:
|
85 |
density: 0.55
|
86 |
weight: 0.05
|
|
|
87 |
- model: abacusai/Llama-3-Smaug-8B
|
88 |
parameters:
|
89 |
density: 0.55
|
90 |
weight: 0.05
|
|
|
91 |
- model: aaditya/Llama3-OpenBioLLM-8B
|
92 |
parameters:
|
93 |
density: 0.55
|
94 |
weight: 0.1
|
|
|
95 |
merge_method: dare_ties
|
96 |
base_model: NousResearch/Meta-Llama-3-8B
|
97 |
parameters:
|
98 |
int8_mask: true
|
99 |
dtype: bfloat16
|
|
|
|
|
100 |
```
|
101 |
+
|
102 |
+
### Test
|
103 |
+
<a href="https://ibb.co/tHkMB64"><img src="https://i.ibb.co/Zft6drV/Screenshot-2024-05-07-at-2-45-38-AM.png" alt="Screenshot-2024-05-07-at-2-45-38-AM" border="0"></a>
|
104 |
+
<a href="https://ibb.co/JtsN25B"><img src="https://i.ibb.co/V9qdD2j/Screenshot-2024-05-07-at-2-45-55-AM.png" alt="Screenshot-2024-05-07-at-2-45-55-AM" border="0"></a>
|
105 |
+
<a href="https://ibb.co/X8JhVMk"><img src="https://i.ibb.co/3zhDkQY/Screenshot-2024-05-07-at-2-46-11-AM.png" alt="Screenshot-2024-05-07-at-2-46-11-AM" border="0"></a>
|
106 |
+
<a href="https://ibb.co/XFZfvLm"><img src="https://i.ibb.co/qmMLPjb/Screenshot-2024-05-07-at-2-46-18-AM.png" alt="Screenshot-2024-05-07-at-2-46-18-AM" border="0"></a>
|
107 |
+
<a href="https://ibb.co/7Khf8B3"><img src="https://i.ibb.co/YhgCYJ5/Screenshot-2024-05-07-at-2-51-23-AM.png" alt="Screenshot-2024-05-07-at-2-51-23-AM" border="0"></a>
|
108 |
+
<a href="https://ibb.co/9tsDj40"><img src="https://i.ibb.co/sHyfr14/Screenshot-2024-05-07-at-2-46-48-AM.png" alt="Screenshot-2024-05-07-at-2-46-48-AM" border="0"></a>
|
109 |
+
<a href="https://ibb.co/z8FmLRz"><img src="https://i.ibb.co/HNCKMzj/Screenshot-2024-05-07-at-2-49-45-AM.png" alt="Screenshot-2024-05-07-at-2-49-45-AM" border="0"></a>
|