Hugging Face's logo
Joseph717171 's Collections
GGUF Llama-3.2-Instruct-OQ8_0-F32.EF32.IQ4_K-Q8_0 IQuants
GGUF LLaMa-3.1-8B-Instruct-Based OQ8_0.EF32 IQuants
GGUF Mistral-Nemo-2407-Instruct OQ8_0.EF32 IQuants

GGUF LLaMa-3.1-8B-Instruct-Based OQ8_0.EF32 IQuants

Custom GGUF quants of Llama-3.1-8B-Instruct fine-tunes, where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. 🧠🔥🚀

Upvote
-