File size: 1,812 Bytes
14fb9b2
 
58cb505
 
 
 
 
 
14fb9b2
ff34844
 
 
b587822
 
ff34844
b587822
ff34844
b587822
ff34844
b587822
ff34844
b587822
ff34844
b587822
 
 
ff34844
b587822
ff34844
b587822
 
ff34844
b587822
ff34844
b587822
ff34844
 
b587822
ff34844
b587822
 
 
 
ff34844
 
 
 
b587822
ff34844
 
b587822
ff34844
 
 
 
b587822
ff34844
 
b587822
ff34844
 
 
 
b587822
ff34844
 
 
 
b587822
58cb505
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
---
license: cc-by-nc-4.0
language:
- ko
- en
tags:
- 42dot
- PLM
---

# 42dot_LLM-PLM-1.3B_GGUF #

* ๋ชจ๋ธ ๋งŒ๋“  ์‚ฌ๋žŒ: [42dot](https://huggingface.co/42dot)
* ์›๋ณธ ๋ชจ๋ธ: [42dot_LLM-PLM-1.3B](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B)

## ์„ค๋ช… ## 

42dot ๋ชจ๋ธ์˜ GGUF ๊ฒฝ๋Ÿ‰ํ™” ๋ชจ๋ธ์„ ๋งŒ๋“ค์–ด ๋’€์Šต๋‹ˆ๋‹ค.

[42dot_LLM-PLM-1.3B](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B) 

## ํŒŒ์ผ ##

๋งํฌ์— ์—ฐ๊ฒฐ ํ•ด๋‘์—ˆ์œผ๋‹ˆ ํ•„์š”ํ•˜์‹  ๋ถ„์€ ํ•˜ํŠธ ์ฃผ๊ณ  ์ฑ™๊ฒจ ๊ฐ€์„ธ์š”.
gguf ์›๋ณธ ํŒŒ์ผ
* [42dot_LLM-PLM-1.3B.gguf](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/ggml-model-f32.gguf?download=true)

Q4, Q8 ๊ฒฝ๋Ÿ‰ํ™” ํŒŒ์ผ

* [42dot_LLM-PLM-1.3B-Q4_K_M](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/gguf-q4_k_m.gguf?download=true)
* [42dot_LLM-PLM-1.3B-Q8_K](https://huggingface.co/StatPan/42dot_LLM-PLM-1.3B_GGUF/resolve/main/gguf-q8_k_m.gguf?download=true)

์ด์™ธ ๋ชจ๋ธ์€ ๊ทผ๋ณธ ์—†์–ด์„œ ์˜ฌ๋ฆด๊นŒ ํ•˜๋‹ค๊ฐ€ ์•ˆ ์˜ฌ๋ฆฌ๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค.

## ์‚ฌ์šฉ๋ฒ• ##


[์›๋ณธ](https://huggingface.co/42dot/42dot_LLM-PLM-1.3B)

์›๋ณธ ๋งํฌ์—์„œ ์‚ฌ์šฉ ๋ฒ•์„ ํ™•์ธํ•˜์„ธ์š”.


### Llama.cpp๋กœ ์‚ฌ์šฉ๋ฒ• ์ƒ˜ํ”Œ ###

For simple inferencing, use a command similar to 

```
./main -m gguf-q4_k_m.gguf --temp 0 --top-k 4 --prompt "who was Joseph Weizenbaum?"
```

### Llama.cpp๋กœ ํ† ํฌ๋‚˜์ด์ง• ์ƒ˜ํ”Œ ###

To get a list of tokens, use a command similar to 

```
./tokenization -m gguf-q4_k_m.gguf --prompt "who was Joseph Weizenbaum?"
```

### Llama.cpp๋กœ ์ž„๋ฒ ๋”ฉ ์ƒ˜ํ”Œ ###

Text embeddings are calculated with a command similar to 

```
./embedding -m gguf-q4_k_m.gguf --prompt "who was Joseph Weizenbaum?"
```

## License ##

์›๋ณธ ๋ชจ๋ธ ๋ผ์ด์„ผ์Šค๋Š” Creative Commons Attribution-NonCommercial 4.0 (CC BY-NC 4.0)
์ฐธ๊ณ ํ•˜์„ธ์š”.