Update README.md
Browse files
README.md
CHANGED
@@ -4,74 +4,61 @@ license: cc-by-nc-4.0
|
|
4 |
|
5 |
# 42dot_LLM-PLM-1.3B_GGUF #
|
6 |
|
7 |
-
*
|
8 |
-
*
|
9 |
|
10 |
-
##
|
11 |
|
12 |
-
|
13 |
-
of 42dot's
|
14 |
-
[42dot_LLM-PLM-1.3B](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B) model - ready
|
15 |
-
to be used with [llama.cpp](https://github.com/ggerganov/llama.cpp) and similar
|
16 |
-
applications.
|
17 |
|
18 |
-
|
19 |
|
20 |
-
|
21 |
-
the original GGUF conversion has been made available
|
22 |
|
23 |
-
|
|
|
|
|
24 |
|
25 |
-
|
26 |
|
27 |
-
* [42dot_LLM-
|
28 |
-
* [42dot_LLM-
|
29 |
-
* [42dot_LLM-SFT-1.3B-Q6_K](https://huggingface.co/rozek/42dot_LLM-SFT-1.3B_GGUF/blob/main/42dot_LLM-SFT-1.3B_Q6_0.gguf)
|
30 |
-
* [42dot_LLM-SFT-1.3B-Q8_K](https://huggingface.co/rozek/42dot_LLM-SFT-1.3B_GGUF/blob/main/42dot_LLM-SFT-1.3B_Q8_0.gguf)
|
31 |
|
32 |
-
|
33 |
|
34 |
-
##
|
35 |
|
36 |
-
Any technical details can be found on the
|
37 |
-
[original model card](https://huggingface.co/42dot/42dot_LLM-SFT-1.3B)
|
38 |
-
The most important ones for using this model are
|
39 |
|
40 |
-
|
41 |
-
* there does not seem to be a specific prompt structure - just provide the text
|
42 |
-
you want to be completed
|
43 |
|
44 |
-
|
|
|
|
|
|
|
45 |
|
46 |
For simple inferencing, use a command similar to
|
47 |
|
48 |
```
|
49 |
-
./main -m
|
50 |
```
|
51 |
|
52 |
-
###
|
53 |
|
54 |
To get a list of tokens, use a command similar to
|
55 |
|
56 |
```
|
57 |
-
./tokenization -m
|
58 |
```
|
59 |
|
60 |
-
###
|
61 |
|
62 |
Text embeddings are calculated with a command similar to
|
63 |
|
64 |
```
|
65 |
-
./embedding -m
|
66 |
```
|
67 |
|
68 |
## License ##
|
69 |
|
70 |
-
|
71 |
-
|
72 |
-
license was also chosen for the conversions found in this repository.
|
73 |
-
|
74 |
-
So, in order to be fair and give credits to whom they belong:
|
75 |
-
|
76 |
-
* the original model was created and published by [42dot](https://huggingface.co/42dot)
|
77 |
-
* besides quantization, no changes were applied to the model itself
|
|
|
4 |
|
5 |
# 42dot_LLM-PLM-1.3B_GGUF #
|
6 |
|
7 |
+
* ๋ชจ๋ธ ๋ง๋ ์ฌ๋: [42dot](https://huggingface.co/42dot)
|
8 |
+
* ์๋ณธ ๋ชจ๋ธ: [42dot_LLM-PLM-1.3B](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B)
|
9 |
|
10 |
+
## ์ค๋ช
##
|
11 |
|
12 |
+
42dot ๋ชจ๋ธ์ GGUF ๊ฒฝ๋ํ ๋ชจ๋ธ์ ๋ง๋ค์ด ๋์ต๋๋ค.
|
|
|
|
|
|
|
|
|
13 |
|
14 |
+
[42dot_LLM-PLM-1.3B](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B)
|
15 |
|
16 |
+
## ํ์ผ ##
|
|
|
17 |
|
18 |
+
๋งํฌ์ ์ฐ๊ฒฐ ํด๋์์ผ๋ ํ์ํ์ ๋ถ์ ํํธ ์ฃผ๊ณ ์ฑ๊ฒจ ๊ฐ์ธ์.
|
19 |
+
gguf ์๋ณธ ํ์ผ
|
20 |
+
* [42dot_LLM-PLM-1.3B.gguf](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/ggml-model-f32.gguf?download=true)
|
21 |
|
22 |
+
Q4, Q8 ๊ฒฝ๋ํ ํ์ผ
|
23 |
|
24 |
+
* [42dot_LLM-PLM-1.3B-Q4_K_M](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/gguf-q4_k_m.gguf?download=true)
|
25 |
+
* [42dot_LLM-PLM-1.3B-Q8_K](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/gguf-q8_k_m.gguf?download=true)
|
|
|
|
|
26 |
|
27 |
+
์ด์ธ ๋ชจ๋ธ์ ๊ทผ๋ณธ ์์ด์ ์ฌ๋ฆด๊น ํ๋ค๊ฐ ์ ์ฌ๋ฆฌ๋ ค๊ณ ํฉ๋๋ค.
|
28 |
|
29 |
+
## ์ฌ์ฉ๋ฒ ##
|
30 |
|
|
|
|
|
|
|
31 |
|
32 |
+
[์๋ณธ](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B)
|
|
|
|
|
33 |
|
34 |
+
์๋ณธ ๋งํฌ์์ ์ฌ์ฉ ๋ฒ์ ํ์ธํ์ธ์.
|
35 |
+
|
36 |
+
|
37 |
+
### Llama.cpp๋ก ์ฌ์ฉ๋ฒ ์ํ ###
|
38 |
|
39 |
For simple inferencing, use a command similar to
|
40 |
|
41 |
```
|
42 |
+
./main -m gguf-q4_k_m.gguf --temp 0 --top-k 4 --prompt "who was Joseph Weizenbaum?"
|
43 |
```
|
44 |
|
45 |
+
### Llama.cpp๋ก ํ ํฌ๋์ด์ง ์ํ ###
|
46 |
|
47 |
To get a list of tokens, use a command similar to
|
48 |
|
49 |
```
|
50 |
+
./tokenization -m gguf-q4_k_m.gguf --prompt "who was Joseph Weizenbaum?"
|
51 |
```
|
52 |
|
53 |
+
### Llama.cpp๋ก ์๋ฒ ๋ฉ ์ํ ###
|
54 |
|
55 |
Text embeddings are calculated with a command similar to
|
56 |
|
57 |
```
|
58 |
+
./embedding -m gguf-q4_k_m.gguf --prompt "who was Joseph Weizenbaum?"
|
59 |
```
|
60 |
|
61 |
## License ##
|
62 |
|
63 |
+
์๋ณธ ๋ชจ๋ธ ๋ผ์ด์ผ์ค๋ Creative Commons Attribution-NonCommercial 4.0 (CC BY-NC 4.0)
|
64 |
+
์ฐธ๊ณ ํ์ธ์.
|
|
|
|
|
|
|
|
|
|
|
|