README.md

---
license: mit
language:
- ko
pipeline_tag: text-generation
datasets:
- blueapple8259/c4-ko-cleaned-2
---
[c4-ko-cleaned-2](https://huggingface.co/datasets/blueapple8259/c4-ko-cleaned-2)데이터셋 테스트용 모델입니다.

## 모델 정보

vocab size: 52000

max position embeddings: 1024

hidden size: 512

num attention heads: 16

num key value heads: 4

num hidden layers: 2