Base Model:

We made a LLM model with davidkim205/nox-solar-10.7b-v4

Model Description

We use QLoRA(256, 64) and NEFTune on LLM Fine-tuning lr = 1e-5, NEFTune = 3

Our changed private data used, 5 epoch train, and parameter changed

We are making LLM model for Kolon !

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Quantizations