Release GGUF models?
#5
by
CosmicSound
- opened
Hi,
Any plans to release .GGUF models so users can try the models on their mobiles, tablets, easier?
@CosmicSound I think someone from the community is working on this: https://github.com/ggerganov/llama.cpp/issues/7116
the 20 and 34b have been released, work is still happening on 3 and 8
mayank-mishra
changed discussion status to
closed
all models have been released now