metadata
license: apache-2.0
tags:
- finetuned
- mlx
pipeline_tag: text-generation
inference: true
widget:
- messages:
- role: user
content: What is your favorite condiment?
versae/filiberto-7B-instruct
This model was converted to MLX format from mistralai/Mistral-7B-Instruct-v0.2
using mlx-lm version 0.9.0.
Refer to the original model card for more details on the model.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("versae/filiberto-7B-instruct")
response = generate(model, tokenizer, prompt="hello", verbose=True)