Can provide the GGUF format for llama.cpp?

by zhibinlu - opened Sep 1, 2023

Sep 1, 2023

Can someone make a GGUF and GPTQ format for llama.cpp? @TheBloke

Sep 1, 2023

I already did make GGUF, and GPTQs are processing

Sep 1, 2023

•

actually GPTQs just completed a minute ago. They're all there now

Sep 1, 2023

actually GGUFs just completed a minute ago. They're all there now
Thanks a lot! 🫡

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment