KBNIT/KoSOLAR-10.7B-QLoRA-NEFTune-kolon-v0.1

Base Model:

We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3

Model Description

We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning lr = 2e-4

Train Detail

Our Korean Wiki QA data used, and 3 epoch train

Others

We are making LLM model for Kolon !