Mascobot commited on
Commit
2b5c042
1 Parent(s): cd91853

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ This Mistral 7B model is trained on a mix of datasets filtered for higher quality and output length. The mix of datasets was composed to increase reasoning and creativity.
2
+
3
+ Datasets:
4
+
5
+ The mix of datasets is composed of a filtered version of the OpenOrca and Airoboros 2.2.1 datasets.
6
+
7
+ Training:
8
+
9
+ Full model training took 17 hours with 4 epochs on 8x A100s.
10
+
11
+ Prompt format: This model uses the ChatML prompt format (OpenAI's format).
12
+
13
+ <|im_start|>system
14
+ You are a helpful AI assistant.<|im_end|>
15
+ <|im_start|>user
16
+ {prompt}<|im_end|>
17
+ <|im_start|>assistant