Hugging Face's logo

srinivasan-sridhar28
/
sentiment-analysis

PEFT
TensorBoard
Safetensors
distilbert
Generated from Trainer
Model card Files Metrics Community
srinivasan-sridhar28 commited on
Commit
9a77362
•
1 Parent(s): 97af5fe

sentiment-analysis

Browse files
Files changed (8) hide show
  1. README.md +9 -5
  2. adapter_config.json +7 -2
  3. adapter_model.safetensors +2 -2
  4. runs/Jul04_14-23-47_srinivasan-Victus/events.out.tfevents.1720083229.srinivasan-Victus.73311.4 +3 -0
  5. runs/Jul04_14-23-59_srinivasan-Victus/events.out.tfevents.1720083240.srinivasan-Victus.73311.5 +3 -0
  6. runs/Jul04_15-07-14_srinivasan-Victus/events.out.tfevents.1720085841.srinivasan-Victus.73311.6 +3 -0
  7. runs/Jul04_16-15-26_srinivasan-Victus/events.out.tfevents.1720089928.srinivasan-Victus.73311.7 +3 -0
  8. training_args.bin +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.1509
22
- - Accuracy: 0.563
23
 
24
  ## Model description
25
 
@@ -52,9 +52,13 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
- | No log | 0.8 | 100 | 1.3600 | 0.5245 |
56
- | No log | 1.6 | 200 | 1.2107 | 0.543 |
57
- | No log | 2.4 | 300 | 1.1509 | 0.563 |
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.0940
22
+ - Accuracy: 0.586
23
 
24
  ## Model description
25
 
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
+ | No log | 0.4 | 50 | 1.5942 | 0.401 |
56
+ | No log | 0.8 | 100 | 1.5160 | 0.4765 |
57
+ | No log | 1.2 | 150 | 1.3189 | 0.535 |
58
+ | No log | 1.6 | 200 | 1.2154 | 0.551 |
59
+ | No log | 2.0 | 250 | 1.1434 | 0.562 |
60
+ | No log | 2.4 | 300 | 1.1106 | 0.575 |
61
+ | No log | 2.8 | 350 | 1.0940 | 0.586 |
62
 
63
 
64
  ### Framework versions
adapter_config.json CHANGED
@@ -19,13 +19,18 @@
19
  "score"
20
  ],
21
  "peft_type": "LORA",
22
- "r": 8,
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
 
 
26
  "out_lin",
 
27
  "k_lin",
28
- "v_lin"
 
 
29
  ],
30
  "task_type": "SEQ_CLS",
31
  "use_dora": false,
 
19
  "score"
20
  ],
21
  "peft_type": "LORA",
22
+ "r": 16,
23
  "rank_pattern": {},
24
  "revision": null,
25
  "target_modules": [
26
+ "classifier",
27
+ "v_lin",
28
  "out_lin",
29
+ "q_lin",
30
  "k_lin",
31
+ "pre_classifier",
32
+ "lin2",
33
+ "lin1"
34
  ],
35
  "task_type": "SEQ_CLS",
36
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fe493e1c3641cf093eb42ce4371fbb891ded7c6c54c5ceaa068702c33103bc31
3
- size 3271152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:303afd31de305b1acef2469c3bae6ad9e34e77d74b5fd57e7d4eb3d8b88ba266
3
+ size 8145048
runs/Jul04_14-23-47_srinivasan-Victus/events.out.tfevents.1720083229.srinivasan-Victus.73311.4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28122782963ac5fa37aa6ee4ff71b5a873b556d072dac3221bf0f41b9d7aa78e
3
+ size 5524
runs/Jul04_14-23-59_srinivasan-Victus/events.out.tfevents.1720083240.srinivasan-Victus.73311.5 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:474cf8eb11857effca397406a9ff61dc3429b1ace6d53ce3e755beed59b3d07e
3
+ size 8126
runs/Jul04_15-07-14_srinivasan-Victus/events.out.tfevents.1720085841.srinivasan-Victus.73311.6 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bf4f4b6474808edfe7ef527f44d592048a2f4ddc9f977eaba0aa23207cd05f4
3
+ size 8078
runs/Jul04_16-15-26_srinivasan-Victus/events.out.tfevents.1720089928.srinivasan-Victus.73311.7 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97594d2c48879eb0179a1d2e1d7b6b60cb214426534eb13f3fd47764d84d741a
3
+ size 8078
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0a4f9c1455dd76722efb2ccf63f3e70e5c9f6303a9a5f4d39bb11488a9b94c03
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d93f8df002c38f4d15bbecee44e18df6457a6d30e421ad6bb2d62f2de7de3bb6
3
  size 5112