roberta-tiny-10M / best_trial.txt
g8a9's picture
Training in progress, step 50
d9ecaf0
raw
history blame contribute delete
213 Bytes
BestRun(run_id='17', objective=0.33777202905463155, hyperparameters={'learning_rate': 0.0003735194908471509, 'weight_decay': 0.020625116983982793, 'gradient_accumulation_steps': 32, 'lr_scheduler_type': 'cosine'})