Made quantized models
#1
by
Skier8402
- opened
Hi,
I have been testing your models. I made quantized version of the model using this tool https://huggingface.co/spaces/ggml-org/gguf-my-repo and here's the model https://huggingface.co/Skier8402/gemma2-2b-swahili-preview-Q4_K_M-GGUF
That’s so cool will check it out!!