Hugging Face's logo

distily
/
distily_test_attn_identity

TensorBoard
Safetensors
Distily
gpt2
bitnet
1.58b
Generated from Trainer
Model card Files Metrics Community
lapp0 commited on
Commit
c10c075
•
1 Parent(s): 680f050

Training in progress, step 61875

Browse files
Files changed (4) hide show
  1. logs/attn_layer_mapper=last, attn_loss_fn=cos, attn_projector=identity/events.out.tfevents.1724693124.e3f806ea38c9 +3 -0
  2. logs/attn_layer_mapper=last_k_2, attn_loss_fn=cos, attn_projector=identity/completed.flag +0 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/attn_layer_mapper=last, attn_loss_fn=cos, attn_projector=identity/events.out.tfevents.1724693124.e3f806ea38c9 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f897cc4219d84dc56e1325356a7878536b2d003738cee4ed479719c4e5f63b4
3
+ size 29625292
logs/attn_layer_mapper=last_k_2, attn_loss_fn=cos, attn_projector=identity/completed.flag ADDED
File without changes
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77f3184c0245fd1d64b8bdc36d6c4758d8e9bace72c97da2f262b4a9eedd5fe1
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea98929db2abf7aea39e373d9eb73a9606c7a00a2b8c5580bb801fb4155d3c50
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbe32d4a908ba69dccd4c52c248d80a229eebdbc4f34c8c6482b09aee96f595c
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e3bef9d42da06686e98bcb9103589db8a1d83b133fcb5cdb1ab36598a98f0da
3
  size 5432