Hugging Face's logo

e-hossam96
/
arabic-nano-gpt-v0

Text Generation
Transformers
Safetensors
Arabic
gpt2
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
e-hossam96 commited on
Commit
a64684d
·
verified ·
1 Parent(s): 58ce61c

End of training

Browse files
Files changed (3) hide show
  1. README.md +4 -30
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 8.1700
20
 
21
  ## Model description
22
 
@@ -47,35 +47,9 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-------:|:----:|:---------------:|
50
- | 7.203 | 3.4483 | 100 | 7.3071 |
51
- | 6.1398 | 6.8966 | 200 | 6.5485 |
52
- | 5.2755 | 10.3448 | 300 | 6.3037 |
53
- | 4.7782 | 13.7931 | 400 | 6.2548 |
54
- | 4.1729 | 17.2414 | 500 | 6.3045 |
55
- | 3.748 | 20.6897 | 600 | 6.4207 |
56
- | 3.3521 | 24.1379 | 700 | 6.5497 |
57
- | 2.9579 | 27.5862 | 800 | 6.6898 |
58
- | 2.7095 | 31.0345 | 900 | 6.8030 |
59
- | 2.323 | 34.4828 | 1000 | 6.9333 |
60
- | 2.118 | 37.9310 | 1100 | 7.0691 |
61
- | 1.7952 | 41.3793 | 1200 | 7.1780 |
62
- | 1.6861 | 44.8276 | 1300 | 7.2792 |
63
- | 1.4171 | 48.2759 | 1400 | 7.4004 |
64
- | 1.295 | 51.7241 | 1500 | 7.4844 |
65
- | 1.165 | 55.1724 | 1600 | 7.5765 |
66
- | 1.0117 | 58.6207 | 1700 | 7.6435 |
67
- | 0.9315 | 62.0690 | 1800 | 7.7318 |
68
- | 0.8213 | 65.5172 | 1900 | 7.8111 |
69
- | 0.7844 | 68.9655 | 2000 | 7.8869 |
70
- | 0.676 | 72.4138 | 2100 | 7.9278 |
71
- | 0.639 | 75.8621 | 2200 | 8.0032 |
72
- | 0.5734 | 79.3103 | 2300 | 8.0398 |
73
- | 0.5438 | 82.7586 | 2400 | 8.0730 |
74
- | 0.514 | 86.2069 | 2500 | 8.1075 |
75
- | 0.4812 | 89.6552 | 2600 | 8.1316 |
76
- | 0.4583 | 93.1034 | 2700 | 8.1478 |
77
- | 0.4461 | 96.5517 | 2800 | 8.1701 |
78
- | 0.4447 | 100.0 | 2900 | 8.1700 |
79
 
80
 
81
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 6.7561
20
 
21
  ## Model description
22
 
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-------:|:----:|:---------------:|
50
+ | 3.9323 | 33.3333 | 100 | 6.6959 |
51
+ | 1.7608 | 66.6667 | 200 | 6.7001 |
52
+ | 1.0962 | 100.0 | 300 | 6.7561 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
 
55
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:35885542f33a3e864c6d8ae24029095f37b5eeb1ade6244ed6c7e65e1c158a97
3
  size 22080496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e436710d521e6b7a63363fcdbf0f809934864e7a02edab3e6f8115fba67822f6
3
  size 22080496
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ca1dad276f25e7421c6c02d51bce557449dc43c6c6b6508d2616d9f016825fa
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7dc7ec1ed83b3496ca7f0d18310e9ca6d0e5afaf432a54bc535d3d7aa6b0d97
3
  size 5240