willystumblr commited on
Commit
c7b49c2
1 Parent(s): 4875a0e

End of training

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -6,6 +6,8 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  base_model: google/gemma-2b-it
 
 
9
  model-index:
10
  - name: ehrsql-2024-sft-text2sql-gemma-2b-it
11
  results: []
@@ -16,7 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # ehrsql-2024-sft-text2sql-gemma-2b-it
18
 
19
- This model is a fine-tuned version of [google/gemma-2b-it](https://huggingface.co/google/gemma-2b-it) on an unknown dataset.
 
 
20
 
21
  ## Model description
22
 
@@ -43,6 +47,15 @@ The following hyperparameters were used during training:
43
  - lr_scheduler_type: cosine
44
  - num_epochs: 3
45
 
 
 
 
 
 
 
 
 
 
46
  ### Framework versions
47
 
48
  - PEFT 0.9.0
 
6
  - sft
7
  - generated_from_trainer
8
  base_model: google/gemma-2b-it
9
+ datasets:
10
+ - generator
11
  model-index:
12
  - name: ehrsql-2024-sft-text2sql-gemma-2b-it
13
  results: []
 
18
 
19
  # ehrsql-2024-sft-text2sql-gemma-2b-it
20
 
21
+ This model is a fine-tuned version of [google/gemma-2b-it](https://huggingface.co/google/gemma-2b-it) on the generator dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 0.0834
24
 
25
  ## Model description
26
 
 
47
  - lr_scheduler_type: cosine
48
  - num_epochs: 3
49
 
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss |
53
+ |:-------------:|:-----:|:----:|:---------------:|
54
+ | 0.1012 | 1.0 | 608 | 0.1077 |
55
+ | 0.0871 | 2.0 | 1216 | 0.0882 |
56
+ | 0.0764 | 3.0 | 1824 | 0.0834 |
57
+
58
+
59
  ### Framework versions
60
 
61
  - PEFT 0.9.0