TheBirdLegacy/FreeLoaderLM
Text Generation
•
Updated
Free(loader)LM
Training a large language model from scratch for 1$ on LambdaLabs
-
-
CofeAI/FLM-101B
Text Generation • Updated • 12 • 92 -
FLM-101B: An Open LLM and How to Train It with $100K Budget
Paper • 2309.03852 • Published • 44 -
Composable Function-preserving Expansions for Transformer Architectures
Paper • 2308.06103 • Published • 19 -
YaRN: Efficient Context Window Extension of Large Language Models
Paper • 2309.00071 • Published • 65 -
TinyStories: How Small Can Language Models Be and Still Speak Coherent English?
Paper • 2305.07759 • Published • 33 -
roneneldan/TinyStories
Viewer • Updated • 2.14M • 17.5k • 582 -
chansung/llama2-stories
Viewer • Updated • 73 • 48 • 4 -
Scaling MLPs: A Tale of Inductive Bias
Paper • 2306.13575 • Published • 14 -
Textbooks Are All You Need II: phi-1.5 technical report
Paper • 2309.05463 • Published • 87 -
ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
Paper • 2306.10209 • Published • 2 -
One Wide Feedforward is All You Need
Paper • 2309.01826 • Published • 31 -
2x Faster Language Model Pre-training via Masked Structural Growth
Paper • 2305.02869 • Published • 1 -
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale
Paper • 2309.04564 • Published • 15 -
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Paper • 2309.12307 • Published • 88 -
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
Paper • 2309.11998 • Published • 25
