Hugging Face's logo

distily
/
distily_attn_distilgpt2_sweep

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
deea050
•
1 Parent(s): 4bc9967

Training in progress, step 35000

Browse files
Files changed (5) hide show
  1. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=25, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724990139.e3f806ea38c9 +3 -0
  2. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/completed.flag +0 -0
  3. logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724990001.e3f806ea38c9 +2 -2
  4. model.safetensors +1 -1
  5. training_args.bin +1 -1
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=25, learning_rate=0.0002, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724990139.e3f806ea38c9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63da38d79ada063f4bcda4528b841144c523b37797380b673f7f62214f670baa
3
+ size 21506102
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/completed.flag ADDED
File without changes
logs/attn_norm=layernorm, attn_projector=orthogonal, attn_weight=5, learning_rate=0.0004, per_device_train_batch_size=4, warmup_ratio=0/events.out.tfevents.1724990001.e3f806ea38c9 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b88efa7db2fc21c3c7530407789f57c590adda9eebdc793006c628e7798fb6f6
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b9170a5701858f68592938bd8b4f638e8d95278b5adb997a9541bbaa0399e41
3
+ size 529
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:01d3481bc973ebeb340724f7ff89081abeb5ac3f0733f021f8db68f1059c6e50
3
  size 163832792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae332ff3811d400952fe0fab674eb04c09d669d42998f3d71bb14b1b7baa1945
3
  size 163832792
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dab04769221304ecf1e8b1a6b1a68225de1ca61e6edb2229d9a52b1fea5c11cd
3
  size 5560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52ce08855153a2a3b013bd7912e59f44cfb60d56230ceb58753cf7b4593cbd76
3
  size 5560