Hugging Face's logo

ArliAI
/
Llama-3.1-70B-ArliAI-RPMax-v1.3

Safetensors
llama
Model card Files Community
3
GusPuffy commited on
Commit
7a1e596
•
1 Parent(s): 589555b

Add GPTQ quant link

Browse files

Hello, I quantized this model using GPTQ. This adds a link to the quant in the README.md. Thanks for making a great model!

Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -52,6 +52,7 @@ The model is available in quantized formats:
52
  * **FP16**: https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
53
  * **GGUF**: https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF
54
  * **Bartowski's GGUF**: https://huggingface.co/bartowski/Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF
 
55
 
56
  ## Suggested Prompt Format
57
 
 
52
  * **FP16**: https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3
53
  * **GGUF**: https://huggingface.co/ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF
54
  * **Bartowski's GGUF**: https://huggingface.co/bartowski/Llama-3.1-70B-ArliAI-RPMax-v1.3-GGUF
55
+ * **GPTQ (W4A16)**: https://huggingface.co/GusPuffy/Llama-3.1-70B-ArliAI-RPMax-v1.3-GPTQ
56
 
57
  ## Suggested Prompt Format
58