Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
Paper
•
1701.06538
•
Published
•
5
Must Reads On Transformers and Diffusers
Explore the cutting-edge of AI with our curated list of must reads on Transformers & Diffusers, driving innovation in generative-AI and beyond.
-
-
Attention Is All You Need
Paper • 1706.03762 • Published • 44 -
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Paper • 2005.11401 • Published • 12 -
Language Model Evaluation Beyond Perplexity
Paper • 2106.00085 • Published -
LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 30 -
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Paper • 2201.11903 • Published • 9 -
Training language models to follow instructions with human feedback
Paper • 2203.02155 • Published • 16 -
Emergent Abilities of Large Language Models
Paper • 2206.07682 • Published • 3 -
ReAct: Synergizing Reasoning and Acting in Language Models
Paper • 2210.03629 • Published • 14 -
Automatic Chain of Thought Prompting in Large Language Models
Paper • 2210.03493 • Published • 2 -
Are Emergent Abilities of Large Language Models a Mirage?
Paper • 2304.15004 • Published • 6 -
Lost in the Middle: How Language Models Use Long Contexts
Paper • 2307.03172 • Published • 36 -
DoRA: Weight-Decomposed Low-Rank Adaptation
Paper • 2402.09353 • Published • 26 -
Chain-of-Thought Reasoning Without Prompting
Paper • 2402.10200 • Published • 100 -
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation
Paper • 2403.05313 • Published • 9 -
RAFT: Adapting Language Model to Domain Specific RAG
Paper • 2403.10131 • Published • 67