Hugging Face's logo

legraphista
/
Meta-Llama-3-70B-Instruct-abliterated-v3.5-IMat-GGUF

Text Generation
GGUF
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
2
New discussion

Are QK and IQ quantizations made from the F16 or BF16 Gguf?
#2 opened 4 months ago by Nexesenex

Wow!

2
#1 opened 5 months ago by Nexesenex