DopeorNope commited on
Commit
10303ba
โ€ข
1 Parent(s): a8ca302

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -1,3 +1,13 @@
1
  ---
2
  license: cc-by-nc-sa-4.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-sa-4.0
3
+ ---
4
+
5
+
6
+ ์ด ๋ชจ๋ธ์€ Mistral Base์˜ ์ƒˆ๋กœ์šด ์•„ํ‚คํ…์ณ์ด๋ฉฐ, 10.7B์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋กœ ๊ตฌ์„ฑ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. (Solar๋‚˜, ์‹œ๋‚˜ํŠธ๋ผ ๋ฒ ์ด์Šค ๋ชจ๋ธ์ด ์•„๋‹™๋‹ˆ๋‹ค.)
7
+
8
+ ์•ฝ 1.5B์˜ ํ† ํฐ์œผ๋กœ pretrain ๋˜์—ˆ์œผ๋‚˜, ์‹คํ—˜๋‹จ๊ณ„๋กœ ํ–ฅํ›„ ๋‹ค์‹œ ํ›ˆ๋ จ๋˜์–ด ์ƒˆ๋กญ๊ฒŒ ๋‚˜์˜ฌ ์˜ˆ์ •์ž…๋‹ˆ๋‹ค.
9
+
10
+ ํ…Œ์ŠคํŠธ์šฉ์œผ๋กœ ์˜ฌ๋ ค๋ด…๋‹ˆ๋‹ค.
11
+
12
+ Context length๊ฐ€ 32k ๊นŒ์ง€์ง€์› ๊ฐ€๋Šฅํ•œ ๋ชจ๋ธ์ด๋ฉฐ, ํ–ฅํ›„ ๋” ์™„๋ฒฝํ•˜๊ฒŒ ์„ค๊ณ„ํ•˜์—ฌ ์˜ฌ๋ฆฌ๋„๋ก ํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.
13
+