blueapple8259 commited on
Commit
735cbc4
ยท
verified ยท
1 Parent(s): a3e0309

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -8,3 +8,15 @@ language:
8
  [TinyKo-v5-a](https://huggingface.co/blueapple8259/TinyKo-v5-a)๋ชจ๋ธ์—์„œ ์•ฝ๊ฐ„์˜ ํŒŒ์ธํŠœ๋‹์„ ํ•œ ์ง„ํ–‰ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
9
 
10
  ์ฃผ์˜: ์„ฑ๋Šฅ์ด ๋งค์šฐ ๋–จ์–ด์ง€๋ฉฐ ํ• ๋ฃจ์‹œ๋„ค์ด์…˜์ด ๋งค์šฐ ์‹ฌํ•ฉ๋‹ˆ๋‹ค.
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  [TinyKo-v5-a](https://huggingface.co/blueapple8259/TinyKo-v5-a)๋ชจ๋ธ์—์„œ ์•ฝ๊ฐ„์˜ ํŒŒ์ธํŠœ๋‹์„ ํ•œ ์ง„ํ–‰ํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
9
 
10
  ์ฃผ์˜: ์„ฑ๋Šฅ์ด ๋งค์šฐ ๋–จ์–ด์ง€๋ฉฐ ํ• ๋ฃจ์‹œ๋„ค์ด์…˜์ด ๋งค์šฐ ์‹ฌํ•ฉ๋‹ˆ๋‹ค.
11
+
12
+ ## ๋ชจ๋ธ ์ •๋ณด
13
+
14
+ model type: llama
15
+
16
+ hidden size: 6
17
+
18
+ hidden size: 127
19
+
20
+ num attention heads: 16
21
+
22
+ num key value heads: 4