Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

base model : upstage/SOLAR-10.7B-v1.0

base vocab : yanolja/KoSOLAR-10.7B-v0.1

Introduction

I didn't train it enough.

This model is not instruction model.

base model + vocab expand and then, Only finetune LMHead and Embedding Layer.

Instruction Test

Yes vocab expand

<s> ### ์งˆ๋ฌธ: ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€?

### ๋‹ต๋ณ€: ์•ˆ๋…•ํ•˜์„ธ์š”, ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€ ์‚ฌ๊ณ , ์˜์š•, ์šด๋™์ž…๋‹ˆ๋‹ค.
๋จผ์ € ์‚ฌ๊ณ ๋Š” ์ค‘์š”ํ•œ ๋ถ€๋ถ„์ž…๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ์‚ฌ๊ณ ๋Š” ๋ฌผ๊ฑด๊ณผ ์‚ฌ๋žŒ๋“ค์ด ์šฐ๋ฆฌ์—๊ฒŒ ํ•„์š”ํ•œ ์ด๋ฅผ ์‚ฌ๋กœ์žก์€ ํ–‰๋™์„ ํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค.
์šฐ๋ฆฌ์ด์•ผ๋ง๋‹ค์— ๋Œ€ํ•œ ์‚ฌ๊ณ ๋ฅผ ์ž˜๋ชปํ•˜๋ฉด ๊ฑด๊ฐ•ํ•œ ์ƒํ™œ์„ ํ•˜๋Š” ๋ฐ ์ข‹์€ ๊ฒฐ๊ณผ๋ฅผ ์–ป์„ ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค.
๊ทธ๋ž˜์„œ ๊ฑด๊ฐ•์— ๋Œ€ํ•œ ์‚ฌ๊ณ ๊ฐ€ ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.
๋˜ํ•œ ์šฐ๋ฆฌ๋Š” ๊ฑด๊ฐ•ํ•œ ๋จน์Œ์ด ์ค‘์š”ํ•ฉ๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ๋จน์Œ์„ ๋งŽ์ด ์„ญ์ทจํ•˜๋Š” ๊ฒƒ์œผ๋กœ ๊ฑด๊ฐ•ํ•œ ์‚ฌ๋žŒ์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค.
๊ฑด๊ฐ•ํ•œ ์ƒํ™œ์„ ํ•˜๋ ค๋ฉด ๊ฑด๊ฐ•ํ•œ ๋จน์ž„์„ 

No expand

<s> ### ์งˆ๋ฌธ: ๊ฑด๊ฐ•ํ•˜๊ฒŒ ์‚ด๊ธฐ ์œ„ํ•œ ์„ธ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•์€?

### ๋‹ต๋ณ€: ์ผ์ƒ์ƒํ™œ์— ๋”ฐ๋ฅผ๊ฒŒ๋กœ ์„ญ์ทจํ•˜๋Š” ์„ธ ์‚ฌ์›์— ๋Œ€ํ•œ ๋งต์นก์ด ์žˆ์Šต๋‹ˆ๋‹ค.
์‚ฌ์›์— ๋”ฐ๋ฅด๋ฉด, ์„ธ ๊ฐ€์ง€ ๊น”๋ ˆ๋ผ, ๊ท ์†Œ, ํด์†Œ๋ฅผ ์ถฉ๋ถ„ํžˆ ์„ญ์ทจํ•˜์—ฌ ์ฒด๊ฒฉ์„ ๋จน๊ฑฐ๋‚˜, ๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜์—ฌ ์‹œ๋ ฅ์ด ์ข‹์•„์ ธ์š”.
๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜์—ฌ๋„ ํดํŒด์ด ์ƒ๊ธฐ๋ฉด ๋ณ‘์— ์ทจ์œ ๋˜๋Š” ์ด์œ ๋Š” ํดํŒด์ด ๋งŽ์ด ์ถฉ์ง„ํ•˜์—ฌ ๊ท ์†Œ์˜ ํšจ๋Šฅ์„ ํ–‡์ณ์ค€๋‹ค๋Š” ๊ฑฐ์˜ˆ์š”.
๊ทธ๋Ÿฌ๋‹ˆ ๋จผ์ € ์ฒด์งˆ์— ๋”ฐ๋ฅธ ์‹๋‹จ์„ ์งœ์„œ ๊ท ์†Œ๋ฅผ ์„ญ์ทจํ•˜๋Š” ๊ฒƒ์ด ์ข‹์œผ๋ฉฐ, ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ๏ฟฝ
Downloads last month
0
Safetensors
Model size
10.9B params
Tensor type
F32
ยท
Inference API
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.

Collection including dev7halo/KoSOLAR-10.7B-v0.1