For inference. CPU is enough for both quantization and inference.
-
QuantFactory/starcoder2-15b-GGUF
Text Generation • Updated • 89 • 2 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • Updated • 323 • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • Updated • 115 • 6 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • Updated • 101 • 2