GaLore: Advancing Large Model Training on Consumer-grade Hardware
•
26
Matthew Douglas
mdouglas
AI & ML interests
LLMs, quantization, NLP, embeddings, hardware, DevEx
Recent Activity
liked
a model
3 days ago
answerdotai/ModernBERT-base
Articles
Organizations
Collections
13
Datasets that were under consideration for usage in my submission to the 2023 NeurIPS Large Language Model Efficiency Challenge.
-
Detecting Pretraining Data from Large Language Models
Paper • 2310.16789 • Published • 10 -
Let's Synthesize Step by Step: Iterative Dataset Synthesis with Large Language Models by Extrapolating Errors from Small Models
Paper • 2310.13671 • Published • 18 -
AutoMix: Automatically Mixing Language Models
Paper • 2310.12963 • Published • 14 -
An Emulator for Fine-Tuning Large Language Models using Small Language Models
Paper • 2310.12962 • Published • 14
models
5
datasets
None public yet