VPTQ Llama 3.3 70B Instruct without finetune
Collection
arxiv.org/abs/2409.17066, VPTQ Llama 3.3 70B without finetune
•
6 items
•
Updated
Disclaimer:
The model is reproduced based on the paper VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models github and arXiv
The model itself is sourced from a community release.
It is intended only for experimental purposes.
Users are responsible for any consequences arising from the use of this model.
- Downloads last month
- 11
Model tree for VPTQ-community/Meta-Llama-3.3-70B-Instruct-v8-k65536-256-woft
Base model
meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.3-70B-Instruct