Quants - a crusoeai Collection

crusoeai 's Collections

Quants

Quants

updated Apr 24, 2024

Auto-generated quantized models courtesy of CrusoeAI compute.

crusoeai/dolphin-2.9-llama3-70b-GGUF

Updated Apr 25, 2024 • 362 • 12
crusoeai/dolphin2.9-llama3-70b-4.5bpw-exl2

Text Generation • Updated Apr 24, 2024 • 16 • 2
crusoeai/dolphin2.9-llama3-70b-2.5bpw-exl2

Text Generation • Updated Apr 24, 2024 • 20 • 2
crusoeai/dolphin2.9-llama3-70b-2.25bpw-exl2

Text Generation • Updated Apr 24, 2024 • 9 • 1