gwonny/nox-solar-10.7b-v4-kolon-all-5

Base Model:

We made a LLM model with davidkim205/nox-solar-10.7b-v4

Model Description

We use QLOR(64, 16) and NEFTune on LLM Fine-tuning
lr = 2e-4,

Train Detail

Our private data used, and 5 epoch train

Others

We are making LLM model for Kolon !