Nicolas-BZRD
's Collections
LLMs Distillation
updated
Towards Cross-Tokenizer Distillation: the Universal Logit Distillation
Loss for LLMs
Paper
•
2402.12030
•
Published
mistralai/Mistral-7B-Instruct-v0.2
Text Generation
•
Updated
•
3.3M
•
•
2.64k
meta-llama/Llama-2-7b-chat-hf
Text Generation
•
Updated
•
1.37M
•
•
4.2k
EleutherAI/pythia-160m-deduped
Text Generation
•
Updated
•
44.2k
•
3
EleutherAI/pythia-410m-deduped
Text Generation
•
Updated
•
21.3k
•
20
EleutherAI/pythia-1b-deduped
Text Generation
•
Updated
•
22k
•
18
bigscience/bloomz-560m
Text Generation
•
Updated
•
322k
•
117
bigscience/mt0-base
Text2Text Generation
•
Updated
•
3.21k
•
30
facebook/opt-350m
Text Generation
•
Updated
•
365k
•
132
Viewer
•
Updated
•
98.2k
•
58.7k
•
286
google-research-datasets/qed
Updated
•
149
•
3
Viewer
•
Updated
•
10.6k
•
163
•
8
Viewer
•
Updated
•
274k
•
3.78k
•
170
Viewer
•
Updated
•
14.5k
•
11.5k
•
192