numen-tech
/

Cat-Llama-3-70B-instruct-w4a16g128asym

Model card Files Files and versions Community

Cat-Llama-3-70B-instruct-w4a16g128asym / README.md

numen-tech's picture

Add weights

ccb2d8a 3 months ago

|

history blame contribute delete

No virus

192 Bytes

	---
	license: llama3
	---

	4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [Cat-Llama-3-70B-instruct](https://huggingface.co/turboderp/Cat-Llama-3-70B-instruct).