Do Korean dataset used when Finetune?

#15

by maywell - opened Dec 26, 2023

Dec 26, 2023

Hi, I just wondering if Korean dataset used.
I tried this and base model but the Korean output was awful.
but in upstage ko llm leaderboard SOLAR finetuned model is #1

I'm training SOLAR model with my Korean dataset now. and It's fits well crazy.

hunkim

upstage org Dec 27, 2023

Korean output was awful.
We did not use Korean datasets for fine-tuning.

hunkim changed discussion status to closed Dec 27, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment