torchdistill: Reproducing fine-tuned BERT models - a yoshitomo-matsubara Collection

SRSD: Symbolic Regression for Scientific Discovery

torchdistill: Distilling fine-tuned BERT-Large -> BERT-Base

torchdistill: Reproducing fine-tuned BERT models

updated 20 days ago

GLUE leaderboard: https://gluebenchmark.com/leaderboard/ Code: https://github.com/yoshitomo-matsubara/torchdistill?tab=readme-ov-file#glue

Upvote

yoshitomo-matsubara/bert-base-uncased-mnli

Text Classification • Updated Apr 19 • 120
yoshitomo-matsubara/bert-base-uncased-cola

Text Classification • Updated Apr 19 • 134
yoshitomo-matsubara/bert-base-uncased-rte

Text Classification • Updated Apr 19 • 63 • 1
yoshitomo-matsubara/bert-base-uncased-stsb

Text Classification • Updated Apr 19 • 24
yoshitomo-matsubara/bert-base-uncased-qnli

Text Classification • Updated Apr 19 • 38
yoshitomo-matsubara/bert-base-uncased-sst2

Text Classification • Updated Apr 19 • 37
yoshitomo-matsubara/bert-base-uncased-mrpc

Text Classification • Updated Apr 19 • 45
yoshitomo-matsubara/bert-base-uncased-qqp

Text Classification • Updated Apr 19 • 44
yoshitomo-matsubara/bert-base-uncased-wnli

Text Classification • Updated Apr 19 • 9
yoshitomo-matsubara/bert-large-uncased-qqp

Text Classification • Updated Apr 19 • 36
yoshitomo-matsubara/bert-large-uncased-mnli

Text Classification • Updated Apr 19 • 49
yoshitomo-matsubara/bert-large-uncased-sst2

Text Classification • Updated Apr 19 • 45
yoshitomo-matsubara/bert-large-uncased-rte

Text Classification • Updated Apr 19 • 62
yoshitomo-matsubara/bert-large-uncased-cola

Text Classification • Updated Apr 19 • 80 • 1
yoshitomo-matsubara/bert-large-uncased-qnli

Text Classification • Updated Apr 19 • 41
yoshitomo-matsubara/bert-large-uncased-mrpc

Text Classification • Updated Apr 19 • 84
yoshitomo-matsubara/bert-large-uncased-stsb

Text Classification • Updated Apr 19 • 14
yoshitomo-matsubara/bert-large-uncased-wnli

Text Classification • Updated Apr 19 • 10

Upvote