Mistral 7B Instruct v0.2 - GGUF

Description

This repo contains GGUF format model files for Mistral AI_'s Mistral 7B Instruct v0.2.

Prompt template: Mistral

<s>[INST] {prompt} [/INST]

Citation

TheBloke

Downloads last month
24
GGUF
Model size
7.24B params
Architecture
llama

5-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for dataequity/mistral-7b-instruct-v0.2.Q5_K_M.gguf

Quantized
(88)
this model