Edit model card

Sakura-SOLAR-Instruct

(μ£Ό)λ―Έλ””μ–΄κ·Έλ£Ήμ‚¬λžŒκ³Όμˆ²κ³Ό (μ£Ό)마컀의 LLM 연ꡬ μ»¨μ†Œμ‹œμ—„μ—μ„œ 개발된 λͺ¨λΈμž…λ‹ˆλ‹€

Model Details

Model Developers Kyujin Han (kyujinpy)

Method
Using Mergekit.
I shared the information about my model. (training and code)
Please see: ⭐Sakura-SOLAR.

Blog

Model Benchmark

Open leaderboard

  • Follow up as link.
Model Average ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K
Sakura-SOLRCA-Instruct-DPO 74.05 71.16 88.49 66.17 72.10 82.95 63.46
Sakura-SOLAR-Instruct-DPO-v2 74.14 70.90 88.41 66.48 71.86 83.43 63.76
kyujinpy/Sakura-SOLAR-Instruct 74.40 70.99 88.42 66.33 71.79 83.66 65.20

Rank1 2023.12.27 PM 11:50

Implementation Code

### KO-Platypus
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "kyujinpy/Sakura-SOLAR-Instruct"
OpenOrca = AutoModelForCausalLM.from_pretrained(
        repo,
        return_dict=True,
        torch_dtype=torch.float16,
        device_map='auto'
)
OpenOrca_tokenizer = AutoTokenizer.from_pretrained(repo)

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 74.40
AI2 Reasoning Challenge (25-Shot) 70.99
HellaSwag (10-Shot) 88.42
MMLU (5-Shot) 66.33
TruthfulQA (0-shot) 71.79
Winogrande (5-shot) 83.66
GSM8k (5-shot) 65.20
Downloads last month
5,474
Safetensors
Model size
10.7B params
Tensor type
FP16
Β·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for kyujinpy/Sakura-SOLAR-Instruct

Adapters
1 model
Finetunes
1 model
Merges
1 model
Quantizations
7 models

Spaces using kyujinpy/Sakura-SOLAR-Instruct 6

Collection including kyujinpy/Sakura-SOLAR-Instruct

Evaluation results