Local Models
Collection
19 items
•
Updated
•
1
Overview
The Mixtral-7x8B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts. The Mistral-7x8Boutperforms Llama 2 70B on most benchmarks we tested.
Variants
| No | Variant | Cortex CLI command |
|---|---|---|
| 1 | 7x8b-gguf | cortex run mixtral:7x8b-gguf |
Use it with Jan (UI)
- Install Jan using Quickstart
- Use in Jan model Hub:
cortexhub/mixtral
Use it with Cortex (CLI)
- Install Cortex using Quickstart
- Run the model with command:
cortex run mixtral
Credits
- Author: Mistralai
- Converter: Homebrew
- Downloads last month
- 20
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.