Extending Llama-3's Context Ten-Fold Overnight
Paper
•
2404.19553
•
Published
•
33
Fine-tuning
-
-
ReFT: Representation Finetuning for Language Models
Paper • 2404.03592 • Published • 91 -
Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck
Paper • 2404.07647 • Published • 4 -
SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning
Paper • 2401.07950 • Published • 4 -
Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models
Paper • 2312.06585 • Published • 28