neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated 10 days ago • 2.05k • 8
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated 9 days ago • 5.53k • 10
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated 9 days ago • 28.4k • 20