metadata
library_name: transformers
tags:
- generated_from_trainer
datasets:
- crispr_data
model-index:
- name: SX_ispymac_CRISPR_transformer
results: []
SX_ispymac_CRISPR_transformer
This model is a fine-tuned version of on the crispr_data dataset. It achieves the following results on the evaluation set:
- Loss: 514639.75
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.001
- train_batch_size: 100
- eval_batch_size: 100
- seed: 63036
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.05
- num_epochs: 30.0
Training results
| Training Loss | Epoch | Step | Validation Loss |
|---|---|---|---|
| 5601914.5031 | 1.0 | 326 | 1894021.75 |
| 1328778.8957 | 2.0 | 652 | 670578.75 |
| 669992.0982 | 3.0 | 978 | 528672.8125 |
| 549468.5644 | 4.0 | 1304 | 528315.75 |
| 528034.8957 | 5.0 | 1630 | 517330.3438 |
| 521024.6871 | 6.0 | 1956 | 516302.25 |
| 518358.3804 | 7.0 | 2282 | 516195.9375 |
| 517674.454 | 8.0 | 2608 | 516099.6875 |
| 516467.3865 | 9.0 | 2934 | 515717.6562 |
| 516283.1411 | 10.0 | 3260 | 516509.0 |
| 515811.4356 | 11.0 | 3586 | 515362.1875 |
| 515361.1779 | 12.0 | 3912 | 517239.9375 |
| 515421.5951 | 13.0 | 4238 | 515716.4688 |
| 515266.2577 | 14.0 | 4564 | 514972.875 |
| 514957.9877 | 15.0 | 4890 | 514995.125 |
| 514826.3558 | 16.0 | 5216 | 515276.4688 |
| 514742.8221 | 17.0 | 5542 | 514949.9375 |
| 514670.9693 | 18.0 | 5868 | 515125.5 |
| 514493.3988 | 19.0 | 6194 | 514852.7812 |
| 514367.3129 | 20.0 | 6520 | 514896.3125 |
| 514363.1411 | 21.0 | 6846 | 515543.625 |
| 514226.3067 | 22.0 | 7172 | 514779.0 |
| 514206.135 | 23.0 | 7498 | 514666.75 |
| 514089.4233 | 24.0 | 7824 | 514983.75 |
| 514020.908 | 25.0 | 8150 | 514966.5625 |
| 513915.8282 | 26.0 | 8476 | 514978.0938 |
| 513902.9202 | 27.0 | 8802 | 514722.125 |
| 513746.454 | 28.0 | 9128 | 514688.625 |
| 513719.0675 | 29.0 | 9454 | 514638.1562 |
| 513652.319 | 30.0 | 9780 | 514639.75 |
Framework versions
- Transformers 4.44.2
- Pytorch 2.4.0+cu124
- Datasets 2.21.0
- Tokenizers 0.19.1