Hugging Face's logo

uukuguy
/
speechless-coder-ds-6.7b

Text Generation
Transformers
PyTorch
GGUF
English
llama
code
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Community
1

gguf version please

#1
by NK-Spacewalk - opened
Discussion
NK-Spacewalk

could you provide gguf for uukuguy/speechless-coder-ds-6.7b ,@uukuguy @TheBloke ?

uukuguy
 Owner

4, 5 and 8-bit GGUF models for CPU+GPU inference

Sign up or log in to comment