File size: 308 Bytes
8fff9fd 927d99a aee615f |
1 2 3 4 5 6 7 |
GGML variant of WizardLM-30b-V1.0, for use on 24GB cards such as 3090. Update pushed 6/14 that resolved garbage output on llama.cpp, not tested using other tools. Requires a recent build of llama.cpp that supports the K-quant methods (June or later). Quant was prepared using llama.cpp build on 6/14/2023. |