CarrotAI
/

Mistral-Large-Instruct-2407-FP8-Dynamic-8bit

Model card Files Files and versions Community

vllm fp8

Downloads last month: 27

Safetensors

Model size

123B params

Tensor type

BF16

·

F8_E4M3

·

Inference API

Unable to determine this model's library. Check the docs .

Model tree for CarrotAI/Mistral-Large-Instruct-2407-FP8-Dynamic-8bit

Base model

mistralai/Mistral-Large-Instruct-2407

Finetuned

(8)

this model