Hugging Face's logo

lapp0
/
distily_bench_obj_cross_v2

TensorBoard
Safetensors
Distily
gpt_neo
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
98dc3d0
•
1 Parent(s): 4572dcc

Training in progress, step 12375

Browse files
Files changed (6) hide show
  1. logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___4_, lr_scheduler_type=cosine_with_restarts, max/completed.flag +0 -0
  2. logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___4_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834178.93d6cbb3ad53 +2 -2
  3. logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___8_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834406.93d6cbb3ad53 +3 -0
  4. logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___8_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834861.93d6cbb3ad53 +3 -0
  5. model.safetensors +1 -1
  6. training_args.bin +1 -1
logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___4_, lr_scheduler_type=cosine_with_restarts, max/completed.flag ADDED
File without changes
logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___4_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834178.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4dcf54c0f3ba80cf194440b99eed60de8b69bcd2db4045d4de3c07cf2414325f
3
- size 307
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef886d3f2012a1fac51fed097dc3a8509201d1634aa69c1270c47b44baba3e16
3
+ size 578
logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___8_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834406.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25ba8a8497628fc70b435a2e26161558b49826e614bde3ca5e3cd11dacf010d0
3
+ size 842065
logs/attn_loss_fn=None, attn_weight=0, gradient_accumulation_steps=1, hs_loss_fn=mse, hs_weight=2.0, learning_rate=0.0004, lr_scheduler_kwargs=__num_cycles___8_, lr_scheduler_type=cosine_with_restarts, max/events.out.tfevents.1723834861.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ac26a745f5fb66f4d47ad609bcbde595def8e5bfea3da55a603dbe0963dfd7d
3
+ size 5185087
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d0fb2a2484cd2ddfc1ca74f378aecd493ed96dc95efbcd19968d8b21725ce360
3
  size 137033984
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:960451a35c801281ca6e7a523aa41528c03c25770fecdf15b63277ee5c70517d
3
  size 137033984
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:92aff456c150a4d9506132557c4348d28144722c442e735e1dc664c76cb9cc23
3
  size 1017948232
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2b2238360718a308cbe0b72932acfb5b6c7e3ae3d7e0e80b1a95534a44afacb
3
  size 1017948232