Local Models
Collection
19 items
•
Updated
•
1
Overview
Mistral 7B, a 7-billion-parameter Large Language Model by Mistral AI. Designed for efficiency and performance, it suits real-time applications requiring swift responses.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | 7b-gguf | cortex run mistral:7b-gguf |
| 2 | tensorrt-llm | cortex run mistral:tensorrt-llm |
| 3 | 7b-onnx | cortex run mistral:7b-onnx |
| 4 | 7b-v0.3 | cortex run mistral:7b-v0.3-gguf-q4-km |
| 4 | 7b-small | `cortex run mistral:small-gguf-q4-km |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexhub/mistral
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run mistral
Credits
- Author: MistralAI
- Converter: Homebrew
- Original License: Licence
- Papers: Mistral paper
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.