Hugging Face's logo

alex-miller
/
climate-percentage-regression

Text Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
alex-miller commited on
Commit
ad49d6d
•
1 Parent(s): 404a414

End of training

Browse files
Files changed (6) hide show
  1. README.md +7 -22
  2. model.safetensors +1 -1
  3. runs/Sep10_14-33-11_61f787a135ef/events.out.tfevents.1725978792.61f787a135ef.745.0 +3 -0
  4. runs/Sep10_14-33-46_61f787a135ef/events.out.tfevents.1725978827.61f787a135ef.745.1 +3 -0
  5. tokenizer.json +6 -1
  6. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [alex-miller/ODABert](https://huggingface.co/alex-miller/ODABert) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.0553
20
 
21
  ## Model description
22
 
@@ -41,32 +41,17 @@ The following hyperparameters were used during training:
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
- - num_epochs: 20
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 0.0861 | 1.0 | 126 | 0.0733 |
51
- | 0.0763 | 2.0 | 252 | 0.0666 |
52
- | 0.0698 | 3.0 | 378 | 0.0607 |
53
- | 0.0613 | 4.0 | 504 | 0.0574 |
54
- | 0.056 | 5.0 | 630 | 0.0574 |
55
- | 0.0536 | 6.0 | 756 | 0.0568 |
56
- | 0.0519 | 7.0 | 882 | 0.0564 |
57
- | 0.0496 | 8.0 | 1008 | 0.0559 |
58
- | 0.0472 | 9.0 | 1134 | 0.0564 |
59
- | 0.0472 | 10.0 | 1260 | 0.0563 |
60
- | 0.0455 | 11.0 | 1386 | 0.0562 |
61
- | 0.0463 | 12.0 | 1512 | 0.0553 |
62
- | 0.0449 | 13.0 | 1638 | 0.0554 |
63
- | 0.0448 | 14.0 | 1764 | 0.0550 |
64
- | 0.0445 | 15.0 | 1890 | 0.0554 |
65
- | 0.0432 | 16.0 | 2016 | 0.0551 |
66
- | 0.0438 | 17.0 | 2142 | 0.0553 |
67
- | 0.0426 | 18.0 | 2268 | 0.0552 |
68
- | 0.0435 | 19.0 | 2394 | 0.0553 |
69
- | 0.0429 | 20.0 | 2520 | 0.0553 |
70
 
71
 
72
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [alex-miller/ODABert](https://huggingface.co/alex-miller/ODABert) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0385
20
 
21
  ## Model description
22
 
 
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
44
+ - num_epochs: 5
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.0642 | 1.0 | 285 | 0.0566 |
51
+ | 0.0512 | 2.0 | 570 | 0.0466 |
52
+ | 0.0436 | 3.0 | 855 | 0.0411 |
53
+ | 0.0395 | 4.0 | 1140 | 0.0391 |
54
+ | 0.0387 | 5.0 | 1425 | 0.0385 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
 
57
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7c9db301c428bfd008e37ef96c5c63f60626cfbe12c6084720df08bd20fc7b6c
3
  size 672705532
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca518aeddd7ee1fee2b1c494cbbafabf8a9647504e6028ba766799f0075387e3
3
  size 672705532
runs/Sep10_14-33-11_61f787a135ef/events.out.tfevents.1725978792.61f787a135ef.745.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe96d29273333a9646897a611efb8edae3b25b349fc9b1eda2ac114a898a0a92
3
+ size 5231
runs/Sep10_14-33-46_61f787a135ef/events.out.tfevents.1725978827.61f787a135ef.745.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5a13350eb0b23fd0f44a62f46ba05f7f3e126b165f5a62b77954048ed2c46c2
3
+ size 7994
tokenizer.json CHANGED
@@ -1,6 +1,11 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 512,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
  "padding": null,
10
  "added_tokens": [
11
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:adfb9376fe7290de729510d244e573fd672c7c45d3e2c06d2b2dda728c5892cd
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0f90fdb254ddf68f1cccbee1943be3eb671d919eccf48ce354f1920aabda77f
3
  size 5176