Hugging Face's logo

DUAL-GPO
/
zephyr-7b-gpo-log-i0

PEFT
TensorBoard
Safetensors
mistral
alignment-handbook
Generated from Trainer
trl
dpo
Model card Files Metrics Community
lole25 commited on
Commit
81caf98
•
1 Parent(s): af68c35

Model save

Browse files
Files changed (25) hide show
  1. README.md +219 -0
  2. adapter_config.json +5 -5
  3. adapter_model.safetensors +1 -1
  4. all_results.json +21 -0
  5. eval_results.json +16 -0
  6. runs/Apr19_16-02-49_gpu4-119-5/events.out.tfevents.1713506805.gpu4-119-5.530091.0 +2 -2
  7. runs/Apr21_17-58-15_gpu4-119-5/events.out.tfevents.1713686379.gpu4-119-5.2520476.0 +3 -0
  8. runs/Apr21_18-40-51_gpu4-119-5/events.out.tfevents.1713688926.gpu4-119-5.2548779.0 +3 -0
  9. runs/Apr21_19-03-53_gpu4-119-5/events.out.tfevents.1713690311.gpu4-119-5.2564742.0 +3 -0
  10. runs/Apr21_19-06-26_gpu4-119-5/events.out.tfevents.1713690464.gpu4-119-5.2566454.0 +3 -0
  11. runs/Apr21_19-06-26_gpu4-119-5/events.out.tfevents.1713691514.gpu4-119-5.2566454.1 +3 -0
  12. runs/Apr21_21-49-54_gpu4-119-5/events.out.tfevents.1713700264.gpu4-119-5.2625771.0 +3 -0
  13. runs/Apr21_23-04-40_gpu4-119-5/events.out.tfevents.1713704759.gpu4-119-5.2653014.0 +3 -0
  14. runs/Apr21_23-04-40_gpu4-119-5/events.out.tfevents.1713705814.gpu4-119-5.2653014.1 +3 -0
  15. tmp-checkpoint-14900/README.md +202 -0
  16. tmp-checkpoint-14900/adapter_config.json +31 -0
  17. tmp-checkpoint-14900/adapter_model.safetensors +3 -0
  18. tmp-checkpoint-14900/global_step14900/zero_pp_rank_0_mp_rank_00_model_states.pt +3 -0
  19. tmp-checkpoint-14900/special_tokens_map.json +30 -0
  20. tmp-checkpoint-14900/tokenizer.json +0 -0
  21. tmp-checkpoint-14900/tokenizer_config.json +43 -0
  22. tmp-checkpoint-14900/training_args.bin +3 -0
  23. train_results.json +8 -0
  24. trainer_state.json +0 -0
  25. training_args.bin +1 -1
README.md ADDED
@@ -0,0 +1,219 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ tags:
4
+ - trl
5
+ - dpo
6
+ - generated_from_trainer
7
+ base_model: mistralai/Mistral-7B-v0.1
8
+ model-index:
9
+ - name: zephyr-7b-gpo-log-i0
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # zephyr-7b-gpo-log-i0
17
+
18
+ This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 0.6894
21
+ - Rewards/chosen: -0.1985
22
+ - Rewards/rejected: -0.2851
23
+ - Rewards/accuracies: 0.6680
24
+ - Rewards/margins: 0.0866
25
+ - Logps/rejected: -496.7296
26
+ - Logps/chosen: -430.4875
27
+ - Logits/rejected: -1.9716
28
+ - Logits/chosen: -2.1747
29
+
30
+ ## Model description
31
+
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
+
38
+ ## Training and evaluation data
39
+
40
+ More information needed
41
+
42
+ ## Training procedure
43
+
44
+ ### Training hyperparameters
45
+
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 5e-06
48
+ - train_batch_size: 1
49
+ - eval_batch_size: 1
50
+ - seed: 42
51
+ - distributed_type: multi-GPU
52
+ - gradient_accumulation_steps: 2
53
+ - total_train_batch_size: 2
54
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
+ - lr_scheduler_type: cosine
56
+ - lr_scheduler_warmup_ratio: 0.1
57
+ - num_epochs: 0.001
58
+
59
+ ### Training results
60
+
61
+ | Training Loss | Epoch | Step | Logits/chosen | Logits/rejected | Logps/chosen | Logps/rejected | Validation Loss | Rewards/accuracies | Rewards/chosen | Rewards/margins | Rewards/rejected |
62
+ |:-------------:|:-----:|:-----:|:-------------:|:---------------:|:------------:|:--------------:|:---------------:|:------------------:|:--------------:|:---------------:|:----------------:|
63
+ | 0.6931 | 0.01 | 100 | -2.3483 | -2.1599 | -231.7733 | -211.4642 | 0.6931 | 0.4845 | 0.0002 | 0.0001 | 0.0001 |
64
+ | 0.6931 | 0.01 | 200 | -2.3487 | -2.1603 | -231.4387 | -211.6443 | 0.6931 | 0.5800 | 0.0006 | 0.0006 | -0.0000 |
65
+ | 0.6929 | 0.02 | 300 | -2.3526 | -2.1641 | -228.5697 | -209.9551 | 0.6930 | 0.5810 | 0.0034 | 0.0018 | 0.0017 |
66
+ | 0.6929 | 0.03 | 400 | -2.3535 | -2.1649 | -226.9053 | -210.0602 | 0.6929 | 0.5950 | 0.0051 | 0.0035 | 0.0016 |
67
+ | 0.6927 | 0.03 | 500 | -2.3455 | -2.1572 | -243.4080 | -230.7395 | 0.6927 | 0.6065 | -0.0114 | 0.0077 | -0.0191 |
68
+ | 0.6924 | 0.04 | 600 | -2.3406 | -2.1523 | -240.4310 | -234.4804 | 0.6924 | 0.6110 | -0.0084 | 0.0144 | -0.0229 |
69
+ | 0.6928 | 0.05 | 700 | -2.3223 | -2.1352 | -255.1952 | -253.8729 | 0.6922 | 0.6090 | -0.0232 | 0.0191 | -0.0423 |
70
+ | 0.6918 | 0.05 | 800 | -2.3240 | -2.1358 | -289.2699 | -303.1003 | 0.6920 | 0.5970 | -0.0573 | 0.0342 | -0.0915 |
71
+ | 0.6928 | 0.06 | 900 | -2.2816 | -2.0968 | -253.8069 | -254.9312 | 0.6919 | 0.6050 | -0.0218 | 0.0215 | -0.0433 |
72
+ | 0.6908 | 0.07 | 1000 | -1.7918 | -1.6316 | -308.5073 | -327.3462 | 0.6915 | 0.6020 | -0.0765 | 0.0392 | -0.1157 |
73
+ | 0.6925 | 0.07 | 1100 | -1.6588 | -1.5052 | -304.1779 | -315.8557 | 0.6915 | 0.6170 | -0.0722 | 0.0321 | -0.1042 |
74
+ | 0.6906 | 0.08 | 1200 | -1.2484 | -1.1079 | -475.6542 | -521.3765 | 0.6911 | 0.6155 | -0.2436 | 0.0661 | -0.3098 |
75
+ | 0.6901 | 0.09 | 1300 | -1.7384 | -1.5767 | -401.8933 | -423.5184 | 0.6909 | 0.6170 | -0.1699 | 0.0420 | -0.2119 |
76
+ | 0.6887 | 0.09 | 1400 | -1.4353 | -1.2834 | -424.3940 | -463.2532 | 0.6906 | 0.6420 | -0.1924 | 0.0593 | -0.2516 |
77
+ | 0.69 | 0.1 | 1500 | -1.4837 | -1.3358 | -428.6115 | -450.5626 | 0.6911 | 0.6230 | -0.1966 | 0.0423 | -0.2390 |
78
+ | 0.6896 | 0.1 | 1600 | -0.9061 | -0.7923 | -381.1222 | -427.0179 | 0.6905 | 0.6350 | -0.1491 | 0.0663 | -0.2154 |
79
+ | 0.6896 | 0.11 | 1700 | -1.4801 | -1.3317 | -311.4821 | -351.0151 | 0.6904 | 0.6255 | -0.0795 | 0.0599 | -0.1394 |
80
+ | 0.6907 | 0.12 | 1800 | -1.5447 | -1.3930 | -338.7189 | -368.5627 | 0.6906 | 0.6295 | -0.1067 | 0.0502 | -0.1570 |
81
+ | 0.6903 | 0.12 | 1900 | -1.5034 | -1.3577 | -351.9511 | -381.6029 | 0.6906 | 0.6510 | -0.1199 | 0.0500 | -0.1700 |
82
+ | 0.6907 | 0.13 | 2000 | -1.3523 | -1.2127 | -394.4135 | -441.4114 | 0.6902 | 0.6430 | -0.1624 | 0.0674 | -0.2298 |
83
+ | 0.6901 | 0.14 | 2100 | -1.4995 | -1.3486 | -364.0427 | -413.4233 | 0.6902 | 0.6455 | -0.1320 | 0.0698 | -0.2018 |
84
+ | 0.6914 | 0.14 | 2200 | -1.6063 | -1.4533 | -326.1748 | -362.9125 | 0.6903 | 0.6345 | -0.0942 | 0.0571 | -0.1513 |
85
+ | 0.6916 | 0.15 | 2300 | -1.1935 | -1.0524 | -545.2796 | -613.0294 | 0.6904 | 0.6450 | -0.3133 | 0.0881 | -0.4014 |
86
+ | 0.6897 | 0.16 | 2400 | -1.3794 | -1.2359 | -354.2448 | -401.9844 | 0.6901 | 0.6390 | -0.1222 | 0.0681 | -0.1904 |
87
+ | 0.6921 | 0.16 | 2500 | -1.2731 | -1.1393 | -346.2455 | -378.1649 | 0.6903 | 0.6485 | -0.1142 | 0.0523 | -0.1666 |
88
+ | 0.6893 | 0.17 | 2600 | -0.7405 | -0.6334 | -444.1414 | -493.0764 | 0.6899 | 0.6545 | -0.2121 | 0.0693 | -0.2815 |
89
+ | 0.6898 | 0.18 | 2700 | -1.1283 | -0.9989 | -451.3296 | -502.5096 | 0.6902 | 0.6480 | -0.2193 | 0.0716 | -0.2909 |
90
+ | 0.6905 | 0.18 | 2800 | -1.2888 | -1.1517 | -361.0450 | -403.0554 | 0.6902 | 0.6460 | -0.1290 | 0.0624 | -0.1914 |
91
+ | 0.6888 | 0.19 | 2900 | -0.9720 | -0.8516 | -368.5533 | -425.2483 | 0.6901 | 0.6520 | -0.1365 | 0.0771 | -0.2136 |
92
+ | 0.6906 | 0.2 | 3000 | -0.8705 | -0.7524 | -415.2959 | -477.5717 | 0.6900 | 0.6450 | -0.1833 | 0.0827 | -0.2660 |
93
+ | 0.6921 | 0.2 | 3100 | -0.4969 | -0.4021 | -462.8434 | -519.7990 | 0.6900 | 0.6550 | -0.2308 | 0.0773 | -0.3082 |
94
+ | 0.6867 | 0.21 | 3200 | -1.0904 | -0.9625 | -319.7759 | -371.4648 | 0.6899 | 0.6620 | -0.0878 | 0.0721 | -0.1599 |
95
+ | 0.691 | 0.22 | 3300 | -0.7452 | -0.6384 | -352.8773 | -411.2454 | 0.6899 | 0.6470 | -0.1209 | 0.0788 | -0.1996 |
96
+ | 0.6903 | 0.22 | 3400 | -0.9077 | -0.7891 | -387.8607 | -448.2271 | 0.6899 | 0.6530 | -0.1559 | 0.0808 | -0.2366 |
97
+ | 0.6899 | 0.23 | 3500 | -0.7944 | -0.6855 | -357.3799 | -413.9256 | 0.6898 | 0.6515 | -0.1254 | 0.0769 | -0.2023 |
98
+ | 0.6911 | 0.24 | 3600 | -0.6122 | -0.5134 | -367.0983 | -434.4857 | 0.6899 | 0.6615 | -0.1351 | 0.0878 | -0.2229 |
99
+ | 0.6938 | 0.24 | 3700 | -0.7990 | -0.6917 | -355.7067 | -411.4952 | 0.6899 | 0.6545 | -0.1237 | 0.0762 | -0.1999 |
100
+ | 0.6892 | 0.25 | 3800 | -0.9948 | -0.8768 | -332.9629 | -383.2249 | 0.6899 | 0.6570 | -0.1010 | 0.0707 | -0.1716 |
101
+ | 0.688 | 0.26 | 3900 | -0.8941 | -0.7770 | -480.2304 | -543.8677 | 0.6898 | 0.6495 | -0.2482 | 0.0840 | -0.3323 |
102
+ | 0.6879 | 0.26 | 4000 | -1.0341 | -0.9098 | -458.0283 | -518.2861 | 0.6897 | 0.6540 | -0.2260 | 0.0807 | -0.3067 |
103
+ | 0.6933 | 0.27 | 4100 | -1.1499 | -1.0199 | -460.5152 | -502.6912 | 0.6899 | 0.6520 | -0.2285 | 0.0626 | -0.2911 |
104
+ | 0.6908 | 0.27 | 4200 | -0.8099 | -0.7000 | -446.6075 | -499.0349 | 0.6899 | 0.6490 | -0.2146 | 0.0728 | -0.2874 |
105
+ | 0.6902 | 0.28 | 4300 | -0.8444 | -0.7309 | -529.0878 | -583.2983 | 0.6898 | 0.6585 | -0.2971 | 0.0746 | -0.3717 |
106
+ | 0.6895 | 0.29 | 4400 | -0.7360 | -0.6257 | -519.1375 | -587.6252 | 0.6899 | 0.6505 | -0.2871 | 0.0889 | -0.3760 |
107
+ | 0.6864 | 0.29 | 4500 | -1.1400 | -1.0095 | -381.3715 | -431.1979 | 0.6898 | 0.6590 | -0.1494 | 0.0702 | -0.2196 |
108
+ | 0.6903 | 0.3 | 4600 | -1.1055 | -0.9769 | -445.2477 | -493.5267 | 0.6898 | 0.6500 | -0.2132 | 0.0687 | -0.2819 |
109
+ | 0.6849 | 0.31 | 4700 | -0.8268 | -0.7087 | -512.8202 | -581.3583 | 0.6898 | 0.6545 | -0.2808 | 0.0889 | -0.3697 |
110
+ | 0.6902 | 0.31 | 4800 | -0.7168 | -0.6072 | -480.0729 | -542.0420 | 0.6898 | 0.6600 | -0.2481 | 0.0824 | -0.3304 |
111
+ | 0.6888 | 0.32 | 4900 | -0.9126 | -0.7924 | -470.6658 | -534.4230 | 0.6897 | 0.6545 | -0.2387 | 0.0842 | -0.3228 |
112
+ | 0.6915 | 0.33 | 5000 | -0.9266 | -0.8070 | -433.9764 | -492.5659 | 0.6899 | 0.6505 | -0.2020 | 0.0790 | -0.2810 |
113
+ | 0.6903 | 0.33 | 5100 | -0.8068 | -0.6929 | -539.7931 | -603.4097 | 0.6899 | 0.6540 | -0.3078 | 0.0840 | -0.3918 |
114
+ | 0.6889 | 0.34 | 5200 | -0.3375 | -0.2562 | -600.0009 | -653.9318 | 0.6899 | 0.6550 | -0.3680 | 0.0743 | -0.4423 |
115
+ | 0.6925 | 0.35 | 5300 | -0.8018 | -0.6898 | -452.7947 | -513.4368 | 0.6897 | 0.6605 | -0.2208 | 0.0810 | -0.3018 |
116
+ | 0.6883 | 0.35 | 5400 | -0.9780 | -0.8576 | -446.1244 | -496.6496 | 0.6898 | 0.6590 | -0.2141 | 0.0709 | -0.2850 |
117
+ | 0.6885 | 0.36 | 5500 | -0.9162 | -0.8003 | -444.0844 | -493.7664 | 0.6900 | 0.6550 | -0.2121 | 0.0701 | -0.2822 |
118
+ | 0.6896 | 0.37 | 5600 | -0.7257 | -0.6178 | -536.2577 | -598.6424 | 0.6898 | 0.6570 | -0.3043 | 0.0828 | -0.3870 |
119
+ | 0.6898 | 0.37 | 5700 | -0.7838 | -0.6697 | -537.5150 | -606.8261 | 0.6897 | 0.6550 | -0.3055 | 0.0897 | -0.3952 |
120
+ | 0.6894 | 0.38 | 5800 | -0.3527 | -0.2645 | -553.5991 | -630.1355 | 0.6898 | 0.6525 | -0.3216 | 0.0969 | -0.4185 |
121
+ | 0.6899 | 0.39 | 5900 | -0.5848 | -0.4854 | -493.8012 | -557.8223 | 0.6897 | 0.6535 | -0.2618 | 0.0844 | -0.3462 |
122
+ | 0.6896 | 0.39 | 6000 | -0.9796 | -0.8594 | -429.3099 | -477.4435 | 0.6897 | 0.6630 | -0.1973 | 0.0685 | -0.2658 |
123
+ | 0.6885 | 0.4 | 6100 | -0.9699 | -0.8472 | -491.1470 | -547.7917 | 0.6896 | 0.6580 | -0.2591 | 0.0770 | -0.3362 |
124
+ | 0.6905 | 0.41 | 6200 | -1.2529 | -1.1147 | -485.2599 | -540.0978 | 0.6896 | 0.6610 | -0.2533 | 0.0752 | -0.3285 |
125
+ | 0.6885 | 0.41 | 6300 | -1.4056 | -1.2600 | -469.2736 | -521.1331 | 0.6897 | 0.6635 | -0.2373 | 0.0723 | -0.3095 |
126
+ | 0.689 | 0.42 | 6400 | -1.2237 | -1.0844 | -566.3376 | -629.9547 | 0.6897 | 0.6530 | -0.3343 | 0.0840 | -0.4183 |
127
+ | 0.6913 | 0.43 | 6500 | -1.3350 | -1.1925 | -548.8687 | -604.5547 | 0.6897 | 0.6630 | -0.3169 | 0.0761 | -0.3929 |
128
+ | 0.6896 | 0.43 | 6600 | -1.3852 | -1.2377 | -535.6201 | -595.6210 | 0.6898 | 0.6570 | -0.3036 | 0.0804 | -0.3840 |
129
+ | 0.6913 | 0.44 | 6700 | -1.0456 | -0.9158 | -599.0520 | -667.5596 | 0.6898 | 0.6660 | -0.3670 | 0.0889 | -0.4559 |
130
+ | 0.6913 | 0.44 | 6800 | -1.1365 | -1.0039 | -551.1534 | -605.5635 | 0.6897 | 0.6605 | -0.3191 | 0.0748 | -0.3940 |
131
+ | 0.6876 | 0.45 | 6900 | -1.0859 | -0.9569 | -539.8351 | -594.4590 | 0.6897 | 0.6640 | -0.3078 | 0.0750 | -0.3828 |
132
+ | 0.6878 | 0.46 | 7000 | -1.0649 | -0.9341 | -569.5941 | -639.7524 | 0.6896 | 0.6655 | -0.3376 | 0.0906 | -0.4281 |
133
+ | 0.6889 | 0.46 | 7100 | -1.0207 | -0.8952 | -503.5752 | -564.2007 | 0.6896 | 0.6600 | -0.2716 | 0.0810 | -0.3526 |
134
+ | 0.6887 | 0.47 | 7200 | -1.1860 | -1.0530 | -497.2397 | -547.0663 | 0.6897 | 0.6625 | -0.2652 | 0.0702 | -0.3355 |
135
+ | 0.6905 | 0.48 | 7300 | -1.0693 | -0.9412 | -495.2763 | -555.8788 | 0.6896 | 0.6640 | -0.2633 | 0.0810 | -0.3443 |
136
+ | 0.6933 | 0.48 | 7400 | -0.8035 | -0.6899 | -545.2488 | -615.5215 | 0.6896 | 0.6585 | -0.3132 | 0.0907 | -0.4039 |
137
+ | 0.6885 | 0.49 | 7500 | -0.9690 | -0.8482 | -479.9738 | -539.5114 | 0.6896 | 0.6615 | -0.2480 | 0.0799 | -0.3279 |
138
+ | 0.6873 | 0.5 | 7600 | -1.0029 | -0.8792 | -477.3996 | -540.6624 | 0.6897 | 0.6640 | -0.2454 | 0.0837 | -0.3291 |
139
+ | 0.6896 | 0.5 | 7700 | -1.0249 | -0.9031 | -435.6980 | -492.8593 | 0.6897 | 0.6540 | -0.2037 | 0.0776 | -0.2812 |
140
+ | 0.6893 | 0.51 | 7800 | -0.7930 | -0.6833 | -514.2276 | -576.9700 | 0.6897 | 0.6675 | -0.2822 | 0.0831 | -0.3654 |
141
+ | 0.6896 | 0.52 | 7900 | -0.9352 | -0.8165 | -467.9955 | -532.0470 | 0.6895 | 0.6685 | -0.2360 | 0.0844 | -0.3204 |
142
+ | 0.6909 | 0.52 | 8000 | -1.0597 | -0.9345 | -404.4120 | -465.3136 | 0.6895 | 0.6695 | -0.1724 | 0.0813 | -0.2537 |
143
+ | 0.6908 | 0.53 | 8100 | -0.7901 | -0.6795 | -433.8758 | -497.8059 | 0.6895 | 0.6695 | -0.2019 | 0.0843 | -0.2862 |
144
+ | 0.6904 | 0.54 | 8200 | -1.0770 | -0.9495 | -421.2912 | -480.1203 | 0.6895 | 0.6695 | -0.1893 | 0.0792 | -0.2685 |
145
+ | 0.6895 | 0.54 | 8300 | -0.9703 | -0.8504 | -410.2920 | -467.8550 | 0.6896 | 0.6655 | -0.1783 | 0.0780 | -0.2562 |
146
+ | 0.6904 | 0.55 | 8400 | -0.9014 | -0.7865 | -381.2902 | -431.9937 | 0.6897 | 0.6680 | -0.1493 | 0.0711 | -0.2204 |
147
+ | 0.6878 | 0.56 | 8500 | -0.5620 | -0.4634 | -475.0464 | -545.1041 | 0.6895 | 0.6710 | -0.2430 | 0.0905 | -0.3335 |
148
+ | 0.6881 | 0.56 | 8600 | -0.6348 | -0.5309 | -483.7722 | -558.7502 | 0.6895 | 0.6720 | -0.2518 | 0.0954 | -0.3471 |
149
+ | 0.6888 | 0.57 | 8700 | -0.7448 | -0.6360 | -477.9683 | -541.1770 | 0.6895 | 0.6765 | -0.2460 | 0.0836 | -0.3296 |
150
+ | 0.6912 | 0.58 | 8800 | -0.8669 | -0.7510 | -423.5055 | -484.2249 | 0.6895 | 0.6725 | -0.1915 | 0.0811 | -0.2726 |
151
+ | 0.6905 | 0.58 | 8900 | -0.6408 | -0.5339 | -507.0282 | -584.7628 | 0.6895 | 0.6705 | -0.2750 | 0.0981 | -0.3732 |
152
+ | 0.6889 | 0.59 | 9000 | -0.9425 | -0.8210 | -420.3015 | -482.8202 | 0.6895 | 0.6720 | -0.1883 | 0.0829 | -0.2712 |
153
+ | 0.6906 | 0.6 | 9100 | -1.0030 | -0.8787 | -430.4298 | -486.5714 | 0.6895 | 0.6730 | -0.1984 | 0.0765 | -0.2750 |
154
+ | 0.6893 | 0.6 | 9200 | -1.0853 | -0.9546 | -403.3822 | -463.1019 | 0.6895 | 0.6730 | -0.1714 | 0.0801 | -0.2515 |
155
+ | 0.6902 | 0.61 | 9300 | -0.8924 | -0.7709 | -436.1401 | -502.2715 | 0.6895 | 0.6790 | -0.2041 | 0.0865 | -0.2907 |
156
+ | 0.6885 | 0.62 | 9400 | -0.7878 | -0.6740 | -455.3779 | -517.3574 | 0.6895 | 0.6705 | -0.2234 | 0.0824 | -0.3057 |
157
+ | 0.6864 | 0.62 | 9500 | -0.7308 | -0.6198 | -440.1345 | -503.9654 | 0.6895 | 0.6670 | -0.2081 | 0.0842 | -0.2924 |
158
+ | 0.6896 | 0.63 | 9600 | -0.7276 | -0.6168 | -417.3858 | -483.2873 | 0.6895 | 0.6665 | -0.1854 | 0.0863 | -0.2717 |
159
+ | 0.6884 | 0.63 | 9700 | -0.6134 | -0.5091 | -434.1582 | -500.0406 | 0.6895 | 0.6665 | -0.2022 | 0.0863 | -0.2884 |
160
+ | 0.6913 | 0.64 | 9800 | -0.6631 | -0.5573 | -428.2690 | -488.5942 | 0.6895 | 0.6675 | -0.1963 | 0.0807 | -0.2770 |
161
+ | 0.6887 | 0.65 | 9900 | -0.5865 | -0.4827 | -436.9484 | -508.5711 | 0.6895 | 0.6700 | -0.2049 | 0.0920 | -0.2970 |
162
+ | 0.6886 | 0.65 | 10000 | -0.4209 | -0.3262 | -493.7508 | -570.7292 | 0.6895 | 0.6685 | -0.2617 | 0.0974 | -0.3591 |
163
+ | 0.6858 | 0.66 | 10100 | -0.5254 | -0.4271 | -472.5491 | -537.1530 | 0.6895 | 0.6690 | -0.2405 | 0.0850 | -0.3255 |
164
+ | 0.6902 | 0.67 | 10200 | -0.6713 | -0.5611 | -470.4224 | -546.7172 | 0.6895 | 0.6640 | -0.2384 | 0.0967 | -0.3351 |
165
+ | 0.6877 | 0.67 | 10300 | -0.8372 | -0.7204 | -434.0807 | -497.1747 | 0.6894 | 0.6635 | -0.2021 | 0.0835 | -0.2856 |
166
+ | 0.6889 | 0.68 | 10400 | -0.8565 | -0.7377 | -437.3454 | -502.5919 | 0.6895 | 0.6610 | -0.2053 | 0.0856 | -0.2910 |
167
+ | 0.6885 | 0.69 | 10500 | -0.8123 | -0.6946 | -479.5160 | -547.5475 | 0.6895 | 0.6650 | -0.2475 | 0.0884 | -0.3359 |
168
+ | 0.6884 | 0.69 | 10600 | -0.8156 | -0.6967 | -486.4954 | -556.6547 | 0.6895 | 0.6640 | -0.2545 | 0.0906 | -0.3450 |
169
+ | 0.6909 | 0.7 | 10700 | -0.8308 | -0.7125 | -463.0313 | -527.8248 | 0.6895 | 0.6630 | -0.2310 | 0.0852 | -0.3162 |
170
+ | 0.6877 | 0.71 | 10800 | -0.9392 | -0.8151 | -437.7896 | -501.5677 | 0.6895 | 0.6645 | -0.2058 | 0.0842 | -0.2900 |
171
+ | 0.6921 | 0.71 | 10900 | -1.0966 | -0.9660 | -388.6564 | -443.5241 | 0.6895 | 0.6570 | -0.1567 | 0.0753 | -0.2319 |
172
+ | 0.6906 | 0.72 | 11000 | -1.0157 | -0.8885 | -420.5682 | -481.6877 | 0.6895 | 0.6630 | -0.1886 | 0.0815 | -0.2701 |
173
+ | 0.6898 | 0.73 | 11100 | -1.0298 | -0.9005 | -430.2829 | -496.5845 | 0.6895 | 0.6655 | -0.1983 | 0.0867 | -0.2850 |
174
+ | 0.6924 | 0.73 | 11200 | -1.2117 | -1.0739 | -382.5533 | -440.3696 | 0.6895 | 0.6630 | -0.1505 | 0.0782 | -0.2288 |
175
+ | 0.6875 | 0.74 | 11300 | -1.1264 | -0.9923 | -401.6754 | -464.6775 | 0.6895 | 0.6610 | -0.1697 | 0.0834 | -0.2531 |
176
+ | 0.6895 | 0.75 | 11400 | -1.0544 | -0.9230 | -428.9089 | -497.7010 | 0.6895 | 0.6640 | -0.1969 | 0.0892 | -0.2861 |
177
+ | 0.6901 | 0.75 | 11500 | -0.9567 | -0.8319 | -427.2798 | -491.3987 | 0.6895 | 0.6640 | -0.1953 | 0.0845 | -0.2798 |
178
+ | 0.6887 | 0.76 | 11600 | -0.8249 | -0.7049 | -462.7817 | -536.8845 | 0.6895 | 0.6685 | -0.2308 | 0.0945 | -0.3253 |
179
+ | 0.6883 | 0.77 | 11700 | -0.7566 | -0.6421 | -466.8342 | -534.1976 | 0.6895 | 0.6660 | -0.2348 | 0.0878 | -0.3226 |
180
+ | 0.6904 | 0.77 | 11800 | -0.6848 | -0.5755 | -467.6891 | -530.0805 | 0.6895 | 0.6680 | -0.2357 | 0.0828 | -0.3185 |
181
+ | 0.6868 | 0.78 | 11900 | -0.7183 | -0.6058 | -469.5602 | -536.6125 | 0.6895 | 0.6660 | -0.2376 | 0.0874 | -0.3250 |
182
+ | 0.6884 | 0.79 | 12000 | -0.8024 | -0.6854 | -454.8383 | -520.2646 | 0.6894 | 0.6670 | -0.2228 | 0.0858 | -0.3087 |
183
+ | 0.6878 | 0.79 | 12100 | -0.8306 | -0.7124 | -446.4841 | -511.0565 | 0.6894 | 0.6655 | -0.2145 | 0.0850 | -0.2994 |
184
+ | 0.6903 | 0.8 | 12200 | -0.9147 | -0.7927 | -427.7274 | -490.2318 | 0.6894 | 0.6675 | -0.1957 | 0.0829 | -0.2786 |
185
+ | 0.6914 | 0.8 | 12300 | -0.8736 | -0.7533 | -441.0270 | -506.0264 | 0.6894 | 0.6655 | -0.2090 | 0.0854 | -0.2944 |
186
+ | 0.6923 | 0.81 | 12400 | -0.9178 | -0.7957 | -427.3274 | -489.2210 | 0.6894 | 0.6700 | -0.1953 | 0.0823 | -0.2776 |
187
+ | 0.6892 | 0.82 | 12500 | -0.9397 | -0.8164 | -422.7649 | -484.4884 | 0.6894 | 0.6665 | -0.1908 | 0.0821 | -0.2729 |
188
+ | 0.6898 | 0.82 | 12600 | -0.9114 | -0.7894 | -430.8014 | -493.8383 | 0.6894 | 0.6665 | -0.1988 | 0.0834 | -0.2822 |
189
+ | 0.6903 | 0.83 | 12700 | -0.9304 | -0.8066 | -433.3563 | -498.3890 | 0.6894 | 0.6665 | -0.2014 | 0.0854 | -0.2868 |
190
+ | 0.6906 | 0.84 | 12800 | -0.9460 | -0.8214 | -435.6780 | -501.1642 | 0.6894 | 0.6665 | -0.2037 | 0.0859 | -0.2896 |
191
+ | 0.6903 | 0.84 | 12900 | -0.9910 | -0.8630 | -435.8429 | -502.7374 | 0.6894 | 0.6675 | -0.2038 | 0.0873 | -0.2911 |
192
+ | 0.6887 | 0.85 | 13000 | -0.9750 | -0.8480 | -436.7468 | -504.1572 | 0.6894 | 0.6690 | -0.2047 | 0.0878 | -0.2925 |
193
+ | 0.6917 | 0.86 | 13100 | -1.0175 | -0.8889 | -425.4182 | -489.5446 | 0.6894 | 0.6670 | -0.1934 | 0.0845 | -0.2779 |
194
+ | 0.6877 | 0.86 | 13200 | -1.0098 | -0.8810 | -429.9781 | -496.1291 | 0.6894 | 0.6695 | -0.1980 | 0.0865 | -0.2845 |
195
+ | 0.6887 | 0.87 | 13300 | -1.0319 | -0.9020 | -425.5203 | -491.0486 | 0.6894 | 0.6665 | -0.1935 | 0.0859 | -0.2794 |
196
+ | 0.6916 | 0.88 | 13400 | -1.0431 | -0.9129 | -420.7966 | -485.2116 | 0.6894 | 0.6710 | -0.1888 | 0.0848 | -0.2736 |
197
+ | 0.6905 | 0.88 | 13500 | -1.0459 | -0.9157 | -419.9940 | -484.3698 | 0.6894 | 0.6680 | -0.1880 | 0.0848 | -0.2728 |
198
+ | 0.691 | 0.89 | 13600 | -1.0011 | -0.8732 | -428.5783 | -494.4618 | 0.6894 | 0.6690 | -0.1966 | 0.0863 | -0.2828 |
199
+ | 0.6911 | 0.9 | 13700 | -1.0116 | -0.8833 | -426.2202 | -491.4141 | 0.6894 | 0.6700 | -0.1942 | 0.0856 | -0.2798 |
200
+ | 0.6892 | 0.9 | 13800 | -0.9911 | -0.8639 | -431.2167 | -497.5966 | 0.6894 | 0.6695 | -0.1992 | 0.0868 | -0.2860 |
201
+ | 0.6905 | 0.91 | 13900 | -0.9932 | -0.8657 | -430.5668 | -497.0990 | 0.6894 | 0.6705 | -0.1986 | 0.0869 | -0.2855 |
202
+ | 0.6884 | 0.92 | 14000 | -0.9785 | -0.8517 | -433.5998 | -500.4916 | 0.6894 | 0.6670 | -0.2016 | 0.0873 | -0.2889 |
203
+ | 0.6892 | 0.92 | 14100 | -0.9989 | -0.8711 | -429.9120 | -496.2607 | 0.6894 | 0.6695 | -0.1979 | 0.0867 | -0.2846 |
204
+ | 0.689 | 0.93 | 14200 | -0.9909 | -0.8633 | -431.8853 | -498.7849 | 0.6894 | 0.6695 | -0.1999 | 0.0873 | -0.2872 |
205
+ | 0.6911 | 0.94 | 14300 | -0.9981 | -0.8703 | -430.6117 | -496.9819 | 0.6894 | 0.6680 | -0.1986 | 0.0868 | -0.2854 |
206
+ | 0.6898 | 0.94 | 14400 | -0.9977 | -0.8700 | -430.6717 | -497.1328 | 0.6894 | 0.6675 | -0.1987 | 0.0869 | -0.2855 |
207
+ | 0.6909 | 0.95 | 14500 | -0.9958 | -0.8681 | -431.3944 | -498.0706 | 0.6894 | 0.6695 | -0.1994 | 0.0871 | -0.2865 |
208
+ | 0.6889 | 0.96 | 14600 | -0.9952 | -0.8676 | -430.4063 | -496.6932 | 0.6894 | 0.6690 | -0.1984 | 0.0867 | -0.2851 |
209
+ | 0.6902 | 0.96 | 14700 | -0.9974 | -0.8697 | -430.0926 | -496.2929 | 0.6894 | 0.6690 | -0.1981 | 0.0866 | -0.2847 |
210
+ | 0.6894 | 0.97 | 14800 | -0.9956 | -0.8682 | -430.4017 | -496.6894 | 0.6894 | 0.6675 | -0.1984 | 0.0867 | -0.2851 |
211
+
212
+
213
+ ### Framework versions
214
+
215
+ - PEFT 0.7.1
216
+ - Transformers 4.36.2
217
+ - Pytorch 2.1.2+cu121
218
+ - Datasets 2.14.6
219
+ - Tokenizers 0.15.2
adapter_config.json CHANGED
@@ -19,13 +19,13 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "k_proj",
23
- "up_proj",
24
- "q_proj",
25
- "gate_proj",
26
  "v_proj",
 
27
  "o_proj",
28
- "down_proj"
 
 
29
  ],
30
  "task_type": "CAUSAL_LM"
31
  }
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "down_proj",
 
 
 
23
  "v_proj",
24
+ "gate_proj",
25
  "o_proj",
26
+ "k_proj",
27
+ "q_proj",
28
+ "up_proj"
29
  ],
30
  "task_type": "CAUSAL_LM"
31
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec858e668d321d366944a64293f96a765f2ffb817baafdf1884ac59800790013
3
  size 671150064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05bc5f9fd7767242bb06dff689efac49d522be0d6037282d28f2122690a31203
3
  size 671150064
all_results.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.48,
3
+ "eval_logits/chosen": -2.1746628284454346,
4
+ "eval_logits/rejected": -1.971569538116455,
5
+ "eval_logps/chosen": -430.4875183105469,
6
+ "eval_logps/rejected": -496.7296142578125,
7
+ "eval_loss": 0.6893993616104126,
8
+ "eval_rewards/accuracies": 0.6679999828338623,
9
+ "eval_rewards/chosen": -0.1984768956899643,
10
+ "eval_rewards/margins": 0.08663950115442276,
11
+ "eval_rewards/rejected": -0.28511643409729004,
12
+ "eval_runtime": 1049.0946,
13
+ "eval_samples": 2000,
14
+ "eval_samples_per_second": 1.906,
15
+ "eval_steps_per_second": 1.906,
16
+ "train_loss": 4.683178136915897e-05,
17
+ "train_runtime": 5.5433,
18
+ "train_samples": 61135,
19
+ "train_samples_per_second": 11.029,
20
+ "train_steps_per_second": 5.592
21
+ }
eval_results.json ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.48,
3
+ "eval_logits/chosen": -2.1746628284454346,
4
+ "eval_logits/rejected": -1.971569538116455,
5
+ "eval_logps/chosen": -430.4875183105469,
6
+ "eval_logps/rejected": -496.7296142578125,
7
+ "eval_loss": 0.6893993616104126,
8
+ "eval_rewards/accuracies": 0.6679999828338623,
9
+ "eval_rewards/chosen": -0.1984768956899643,
10
+ "eval_rewards/margins": 0.08663950115442276,
11
+ "eval_rewards/rejected": -0.28511643409729004,
12
+ "eval_runtime": 1049.0946,
13
+ "eval_samples": 2000,
14
+ "eval_samples_per_second": 1.906,
15
+ "eval_steps_per_second": 1.906
16
+ }
runs/Apr19_16-02-49_gpu4-119-5/events.out.tfevents.1713506805.gpu4-119-5.530091.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b43c9b1e9fd744cff2e16e37cf1c55f9fe8cb856df945d668c72f254a42276cf
3
- size 1052893
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1617a202f48ea017c997996d04c7e88dea6c8fef590196096bab750c536a9a4
3
+ size 1059973
runs/Apr21_17-58-15_gpu4-119-5/events.out.tfevents.1713686379.gpu4-119-5.2520476.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e9692dea0fa9a84c6186cd35b36388ec0ecb83c9d20abb1622cd9104f783999
3
+ size 4575
runs/Apr21_18-40-51_gpu4-119-5/events.out.tfevents.1713688926.gpu4-119-5.2548779.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c53cf58e26bba8f79bc8445ddbee28d62b484fc02b33232bdaf0419194f570e
3
+ size 10915
runs/Apr21_19-03-53_gpu4-119-5/events.out.tfevents.1713690311.gpu4-119-5.2564742.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c79afd738bc4ac6ecf5976d2d58062664eb1ca01035be82bbd889ad18dff8d9f
3
+ size 4919
runs/Apr21_19-06-26_gpu4-119-5/events.out.tfevents.1713690464.gpu4-119-5.2566454.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d6ccf506a6e4c89578461352541b94672488628a03d2ca0ea112bece2eff848
3
+ size 4920
runs/Apr21_19-06-26_gpu4-119-5/events.out.tfevents.1713691514.gpu4-119-5.2566454.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3193acb00bd086b9200106390c3f5e14f03c61b8382998d688a5e61af713ab43
3
+ size 828
runs/Apr21_21-49-54_gpu4-119-5/events.out.tfevents.1713700264.gpu4-119-5.2625771.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b03f5bb5045203fabf2052ccf55dd3907d20dc99364902e52ef6e2d48bc6652
3
+ size 4916
runs/Apr21_23-04-40_gpu4-119-5/events.out.tfevents.1713704759.gpu4-119-5.2653014.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:312a4b8ed6bb9c0b94761b219588b370968c73ca76533567341257e771687a31
3
+ size 4920
runs/Apr21_23-04-40_gpu4-119-5/events.out.tfevents.1713705814.gpu4-119-5.2653014.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d9349c0f814e09ff23392c63644b7018132dd112babf87b7c435c0123162390
3
+ size 828
tmp-checkpoint-14900/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ base_model: mistralai/Mistral-7B-v0.1
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.7.1
tmp-checkpoint-14900/adapter_config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "mistralai/Mistral-7B-v0.1",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layers_pattern": null,
10
+ "layers_to_transform": null,
11
+ "loftq_config": {},
12
+ "lora_alpha": 128,
13
+ "lora_dropout": 0.05,
14
+ "megatron_config": null,
15
+ "megatron_core": "megatron.core",
16
+ "modules_to_save": null,
17
+ "peft_type": "LORA",
18
+ "r": 128,
19
+ "rank_pattern": {},
20
+ "revision": null,
21
+ "target_modules": [
22
+ "k_proj",
23
+ "up_proj",
24
+ "q_proj",
25
+ "gate_proj",
26
+ "v_proj",
27
+ "o_proj",
28
+ "down_proj"
29
+ ],
30
+ "task_type": "CAUSAL_LM"
31
+ }
tmp-checkpoint-14900/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7c72054f4d3c16b0caa7be5f8c91268a531d44ae30db473455a39fc4d768541
3
+ size 671150064
tmp-checkpoint-14900/global_step14900/zero_pp_rank_0_mp_rank_00_model_states.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26900715ff0084c1b36811592f88503131b37aec16f51794a07095c0f639d1a0
3
+ size 10154987520
tmp-checkpoint-14900/special_tokens_map.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "unk_token": {
24
+ "content": "<unk>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ }
30
+ }
tmp-checkpoint-14900/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tmp-checkpoint-14900/tokenizer_config.json ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "added_tokens_decoder": {
5
+ "0": {
6
+ "content": "<unk>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "1": {
14
+ "content": "<s>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "2": {
22
+ "content": "</s>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ }
29
+ },
30
+ "additional_special_tokens": [],
31
+ "bos_token": "<s>",
32
+ "chat_template": "{% for message in messages %}\n{% if message['role'] == 'user' %}\n{{ '<|user|>\n' + message['content'] + eos_token }}\n{% elif message['role'] == 'system' %}\n{{ '<|system|>\n' + message['content'] + eos_token }}\n{% elif message['role'] == 'assistant' %}\n{{ '<|assistant|>\n' + message['content'] + eos_token }}\n{% endif %}\n{% if loop.last and add_generation_prompt %}\n{{ '<|assistant|>' }}\n{% endif %}\n{% endfor %}",
33
+ "clean_up_tokenization_spaces": false,
34
+ "eos_token": "</s>",
35
+ "legacy": true,
36
+ "model_max_length": 2048,
37
+ "pad_token": "</s>",
38
+ "sp_model_kwargs": {},
39
+ "spaces_between_special_tokens": false,
40
+ "tokenizer_class": "LlamaTokenizer",
41
+ "unk_token": "<unk>",
42
+ "use_default_system_prompt": false
43
+ }
tmp-checkpoint-14900/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0978c2b18400206a4e19ea34a159e44d6a5a5a95086c3589f2a2427cb31cbc5c
3
+ size 5816
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.48,
3
+ "train_loss": 4.683178136915897e-05,
4
+ "train_runtime": 5.5433,
5
+ "train_samples": 61135,
6
+ "train_samples_per_second": 11.029,
7
+ "train_steps_per_second": 5.592
8
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0978c2b18400206a4e19ea34a159e44d6a5a5a95086c3589f2a2427cb31cbc5c
3
  size 5816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:757ebeb4afe9644085c50d304247c7f8f917362b61693e3fbd7eb7f74f54739e
3
  size 5816