lapp0
/

distily_bench_obj_cross

Generated from Trainer

8-bit precision

Model card Files Files and versions Metrics Training metrics Community

distily_bench_obj_cross / logs

1 contributor

History: 1 commit

This model has 1 file scanned as unsafe.

lapp0's picture

Training in progress, step 15469

508f6f4 verified 5 months ago

attn_loss_fn=raw_mse, attn_weight=10.0, hidden_weight=10.0, hs_loss_fn=mse, learning_rate=4e-05
Training in progress, step 15469 5 months ago
attn_loss_fn=raw_mse, attn_weight=10.0, hidden_weight=10.0, hs_loss_fn=raw_mse, learning_rate=4e-05
Training in progress, step 15469 5 months ago
attn_loss_fn=raw_mse, attn_weight=10.0, hs_loss_fn=mse, hs_weight=10.0, learning_rate=4e-05
Training in progress, step 15469 5 months ago
attn_loss_fn=raw_mse, attn_weight=10.0, hs_loss_fn=raw_mse, hs_weight=10.0, learning_rate=4e-05
Training in progress, step 15469 5 months ago