JayhC
/

L3-ChaoticSoliloquy-v1.5-4x8B-6.5bpw-h8-exl2

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JayhC commited on May 3

Commit

227d9b6

•

1 Parent(s): 220ca68

Update README.md

Files changed (1) hide show

README.md +7 -0

README.md CHANGED Viewed

@@ -6,6 +6,13 @@ language:
 - en
 ---
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/m5urYkrpE5amrwHyaVwFM.png)
 > [!IMPORTANT]

 - en
 ---
+<br/><br/>
+6.5bpw/h8 exl2 quantization of [xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B](https://huggingface.co/xxx777xxxASD/L3-ChaoticSoliloquy-v1.5-4x8B) using default exllamav2 calibration dataset.
+---
+**ORIGINAL CARD:**
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/m5urYkrpE5amrwHyaVwFM.png)
 > [!IMPORTANT]