etri-xainlp commited on
Commit
4d96e96
1 Parent(s): 3db1983

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -4,5 +4,22 @@ license: apache-2.0
4
 
5
  # etri-xainlp/llama2-12.8b_lora-dpo_v1
6
 
 
7
 
8
- based [meta-llama/Llama-13b-hf](https://huggingface.co/meta-llama/Llama-2-13b-hf), instruction tuned(710k) and dpo(90k).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  # etri-xainlp/llama2-12.8b_lora-dpo_v1
6
 
7
+ ## Model Details
8
 
9
+ **Model Developers** ETRI xainlp team
10
+
11
+ **Input** text only.
12
+
13
+ **Output** text only.
14
+
15
+ **Model Architecture**
16
+
17
+ **Base Model** [meta-llama/Llama-13b-hf](https://huggingface.co/meta-llama/Llama-2-13b-hf)
18
+
19
+ **Training Dataset**
20
+
21
+ - sft+lora: 710k instruction-following set
22
+
23
+ - dpo+lora: 90k user preference set
24
+
25
+ - We use A100 GPU 80GB * 8, when training.