comaniac
/

Mixtral-8x7B-Instruct-v0.1-FP8-v2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

comaniac commited on Jun 10

Commit

200f867

•

1 Parent(s): 9cc7235

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,4 +1,4 @@
-## Mixtral-8x7B-Instruct-v0.1-FP8-v1
 * Weights and activations are per-tensor quantized to float8_e4m3.
 * Quantization with AutoFP8.

+## Mixtral-8x7B-Instruct-v0.1-FP8-v2
 * Weights and activations are per-tensor quantized to float8_e4m3.
 * Quantization with AutoFP8.