File size: 183 Bytes
762a321
 
 
60a5567
 
 
1
2
3
4
5
6
Custom GGUF quant for :
failspy/llama-3-70B-Instruct-abliterated-GGUF

IQ4_SR is Optimal (8k ctx) for 36GB VRAM with an IGP displaying the OS.

Without an IGP, the IQ4_XSR is for you.