bigstorm
/

dolphin-2.9.1-llama-3-70b-6.0bpw-exl2

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

bigstorm commited on Jul 4, 2024

Commit

13ca8c4

·

verified ·

1 Parent(s): 963d1c0

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -19,7 +19,7 @@ datasets:
 ---
 # Exl2 Quantization 6.0BPW
-This model fits comfortably within 72gb of VRAM with 32k context. It was created after inference/quant bug was repaired.
 - 6 head bits
 - 6.0 bpw target

 ---
 # Exl2 Quantization 6.0BPW
+This model fits comfortably within 72gb of VRAM with 32k context.
 - 6 head bits
 - 6.0 bpw target