metadata

library_name: transformers
tags:
  - generated_from_trainer
datasets:
  - crispr_data
model-index:
  - name: SX_spymac_CRISPR_transformer
    results: []

SX_spymac_CRISPR_transformer

This model is a fine-tuned version of on the crispr_data dataset. It achieves the following results on the evaluation set:

Loss: 554919.0625

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.001
train_batch_size: 100
eval_batch_size: 100
seed: 63036
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.05
num_epochs: 30.0

Training results

Training Loss	Epoch	Step	Validation Loss
8892548.3058	1.0	327	2231862.75
1596845.9939	2.0	654	767051.1875
850237.4557	3.0	981	605501.0625
586577.419	4.0	1308	559650.875
557455.315	5.0	1635	556497.6875
549405.8471	6.0	1962	556590.5625
546295.633	7.0	2289	556962.8125
544300.4281	8.0	2616	556499.75
544035.5719	9.0	2943	556551.1875
542642.2018	10.0	3270	556249.25
541842.3486	11.0	3597	557194.25
541445.1376	12.0	3924	556227.0
541168.7339	13.0	4251	555564.25
540981.8716	14.0	4578	556040.8125
540638.9235	15.0	4905	556208.25
540627.6208	16.0	5232	555999.9375
540306.104	17.0	5559	555283.125
540060.3792	18.0	5886	555715.625
540050.3976	19.0	6213	555535.9375
539878.1162	20.0	6540	555504.625
539819.8899	21.0	6867	555669.3125
539598.0428	22.0	7194	555249.3125
539608.8073	23.0	7521	555444.9375
539408.9786	24.0	7848	555080.8125
539380.5994	25.0	8175	555413.8125
539192.318	26.0	8502	554968.75
539192.8073	27.0	8829	555104.0625
539042.6911	28.0	9156	555027.5625
538919.8287	29.0	9483	554871.5625
538892.9174	30.0	9810	554919.0625

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu124
Datasets 2.21.0
Tokenizers 0.19.1