Hugging Face's logo

distily
/
distily_test_attn_identity

TensorBoard
Safetensors
Distily
gpt2
bitnet
1.58b
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
e6ba710
•
1 Parent(s): 5cec22c

Training in progress, step 61875

Browse files
Files changed (4) hide show
  1. logs/attn_layer_mapper=all, attn_loss_fn=cos, attn_projector=identity/events.out.tfevents.1724679850.e3f806ea38c9 +3 -0
  2. logs/attn_layer_mapper=layer-2, attn_loss_fn=raw_mse, attn_projector=identity/completed.flag +0 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/attn_layer_mapper=all, attn_loss_fn=cos, attn_projector=identity/events.out.tfevents.1724679850.e3f806ea38c9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e27d0f7cfc06d39fbd47472ba16b3da30cc9e9d07ac4018ffb47827689bb1aad
3
+ size 29625290
logs/attn_layer_mapper=layer-2, attn_loss_fn=raw_mse, attn_projector=identity/completed.flag ADDED
File without changes
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc1c5071ff24a4f0e326641a149e4ae2c7870681f390e1b3785420a2640fa2e7
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b8dfcfac1d80e1d878e7fb1e8364f3847bcf4b67daf6be324539ce0ae00d83b
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fc807382c67deaadfe6da38ec40e76ad55370503eff5b8957fc3c216f3563b96
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2efb59eb8b3a3573d8c1144643795edaa8b9d400f40aec1697f5e26d95454bc6
3
  size 5432