"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
46
Eliza Wszola
EliWsz
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM
Quantization
updated
a model
about 2 months ago
nm-testing/Llama-3.2-1B-Instruct-HQQ
Organizations
