qwenv2-7b-inst-imatrix-gguf / qwen7bv2instruct_q8.gguf

Best q8 conversion down from bf16 with slightly better perplexity than f16 based quants

bc0fa51 verified about 1 month ago

8.1 GB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.