jquesada commited on
Commit
e91dcc4
1 Parent(s): 7cc4fe3

Update model card

Browse files
Files changed (1) hide show
  1. README.md +59 -0
README.md CHANGED
@@ -1,3 +1,62 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ # Model Card for Model ID
6
+
7
+ This model is a finetuning of [Toten5/Marcoroni-neural-chat-7B-v2](https://huggingface.co/Toten5/Marcoroni-neural-chat-7B-v2)
8
+
9
+ ## Model Details
10
+
11
+ ### Model Description
12
+
13
+ - **Developed by:** Ignos
14
+ - **Model type:** Mistral
15
+ - **License:** Apache-2.0
16
+
17
+ ## Uses
18
+
19
+ Model created to improve instructional behavior.
20
+
21
+ ## Bias, Risks, and Limitations
22
+
23
+ The same bias, risks and limitations from base models.
24
+
25
+ ## Training Details
26
+
27
+ ### Training Data
28
+
29
+ - [tatsu-lab/alpaca](https://huggingface.co/datasets/tatsu-lab/alpaca)
30
+
31
+ ### Training Procedure
32
+
33
+ - Training with QLoRA approach and merging with base model.
34
+
35
+ ### Results
36
+
37
+ - Huggingface evaluation pending
38
+
39
+ #### Summary
40
+
41
+ ## Technical Specifications
42
+
43
+ ### Model Architecture and Objective
44
+
45
+ - Models based on Mistral Architecture
46
+
47
+ ### Compute Infrastructure
48
+
49
+ - Training on RunPod
50
+
51
+ #### Hardware
52
+
53
+ - 3 x RTX 4090
54
+ - 48 vCPU 377 GB RAM
55
+
56
+ #### Software
57
+
58
+ - Axolotl 0.3.0
59
+
60
+ ### Framework versions
61
+
62
+ - PEFT 0.6.0