edmundmills
commited on
Commit
•
cbc33f8
1
Parent(s):
d3f5e5c
Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
11 |
|
12 |
# experience-model-v1
|
13 |
|
14 |
-
This model
|
15 |
|
16 |
## Model description
|
17 |
|
@@ -23,20 +23,19 @@ More information needed
|
|
23 |
|
24 |
## Training and evaluation data
|
25 |
|
26 |
-
|
27 |
|
28 |
## Training procedure
|
29 |
|
|
|
|
|
30 |
### Training hyperparameters
|
31 |
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
38 |
-
- lr_scheduler_type: linear
|
39 |
-
- num_epochs: 3.0
|
40 |
|
41 |
### Framework versions
|
42 |
|
|
|
11 |
|
12 |
# experience-model-v1
|
13 |
|
14 |
+
This model is intended to detect the presence of a present-moment experience a human or animal is experiencing in a sentence.
|
15 |
|
16 |
## Model description
|
17 |
|
|
|
23 |
|
24 |
## Training and evaluation data
|
25 |
|
26 |
+
This model was trained on 745 training samples, with ~10% of them containing present moment experiences.
|
27 |
|
28 |
## Training procedure
|
29 |
|
30 |
+
This model was fine-tuned from 'microsoft/deberta-v3-large' using https://github.com/AlignmentResearch/experience-model.
|
31 |
+
|
32 |
### Training hyperparameters
|
33 |
|
34 |
+
It used the following hyperparameters:
|
35 |
+
learning_rate: 2.0 e-05
|
36 |
+
batch_size: 16
|
37 |
+
epochs: 200
|
38 |
+
weight_decay: 0.01
|
|
|
|
|
|
|
39 |
|
40 |
### Framework versions
|
41 |
|