Nexesenex
/

llama-3-70B-Instruct-abliterated-CQ-GGUF

Inference Endpoints

Model card Files Files and versions Community

Nexesenex commited on May 9

Commit

762a321

•

1 Parent(s): 179cdf5

Create README.md

Files changed (1) hide show

README.md +4 -0

README.md ADDED Viewed

	@@ -0,0 +1,4 @@

+Custom GGUF quant for :
+failspy/llama-3-70B-Instruct-abliterated-GGUF
+Optimal (8k ctx) for 36GB VRAM with an IGP displaying the OS.