mlx-community/Mistral-NeMo-Minitron-8B-Instruct

The Model mlx-community/Mistral-NeMo-Minitron-8B-Instruct was converted to MLX format from nvidia/Mistral-NeMo-Minitron-8B-Instruct using mlx-lm version 0.17.1.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/Mistral-NeMo-Minitron-8B-Instruct")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Downloads last month
30
Safetensors
Model size
8.41B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for mlx-community/Mistral-NeMo-Minitron-8B-Instruct

Finetuned
(14)
this model