jingyeom commited on
Commit
7e8fd49
·
verified ·
1 Parent(s): 7bbcdac

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ## Model
2
+ base_model : yanolja/KoSOLAR-10.7B-v0.2
3
+ training objective: freeze, instruction Tuning
4
+ ## Dataset
5
+ 공개 데이터 수집
6
+ Deduplicating Training Data Makes Language Models Better 알고리즘 활용
7
+ instruction version 1.4
8
+
9
+ ## Code
10
+ from transformers import AutoModelForCausalLM, AutoTokenizer
11
+ import torch
12
+
13
+ model_name = "jjingyeom/freeze_KoSoLAR-10.7B-v0.2_1.4_dedup"
14
+ model = AutoModelForCausalLM.from_pretrained(
15
+ model_name,
16
+ )
17
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
18
+