language: | |
- de | |
license: llama3 | |
library_name: transformers | |
tags: | |
- mlx | |
# cstr/Llama3-DiscoLeo-Instruct-8B-v0.1-mlx | |
The Model [cstr/Llama3-DiscoLeo-Instruct-8B-v0.1-mlx](https://huggingface.co/cstr/Llama3-DiscoLeo-Instruct-8B-v0.1-mlx) was converted to MLX format from [DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1](https://huggingface.co/DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1) using mlx-lm version **0.14.0**. | |
## Use with mlx | |
```bash | |
pip install mlx-lm | |
``` | |
```python | |
from mlx_lm import load, generate | |
model, tokenizer = load("cstr/Llama3-DiscoLeo-Instruct-8B-v0.1-mlx") | |
response = generate(model, tokenizer, prompt="hello", verbose=True) | |
``` | |