Safetensors
gemma2

GGUF Format

#5
by ekaone - opened

Hi, is it official GGUF format πŸ‘‡πŸΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF

Hi, is it official GGUF format πŸ‘‡πŸΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF

of course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)

Hi, is it official GGUF format πŸ‘‡πŸΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF

of course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)

Thank you for the GGUF format! I am using it

Hi, is it official GGUF format πŸ‘‡πŸΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF

of course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)

but, thank you for making it with the GGUF format

Sign up or log in to comment