bullerwins
/

gradientai_Llama-3-8B-Instruct-262k_exl2_6.0bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

bullerwins commited on Apr 26

Commit

d41b183

•

1 Parent(s): 3c32d2e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -6,6 +6,7 @@ tags:
 - meta
 - llama-3
 ---
 <img src="https://cdn-uploads.huggingface.co/production/uploads/655bb613e8a8971e89944f3e/TSa3V8YpoVagnTYgxiLaO.png" width="200"/>
 # Llama-3 8B Instruct 262k

 - meta
 - llama-3
 ---
+This is an EXL2 quant made with [exllamav2](https://github.com/turboderp/exllamav2) at 6.0bpw
 <img src="https://cdn-uploads.huggingface.co/production/uploads/655bb613e8a8971e89944f3e/TSa3V8YpoVagnTYgxiLaO.png" width="200"/>
 # Llama-3 8B Instruct 262k