File size: 624 Bytes
43252b0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
language:
- en
license: apache-2.0
library_name: transformers
tags:
- unsloth
- transformers
- gemma
- gemma-2b
- mlx
---

# Paramstr/MLX_unsloth_gemma-2b-it

The Model [Paramstr/MLX_unsloth_gemma-2b-it](https://huggingface.co/Paramstr/MLX_unsloth_gemma-2b-it) was converted to MLX format from [unsloth/gemma-2b-it](https://huggingface.co/unsloth/gemma-2b-it) using mlx-lm version **0.14.2**.

## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("Paramstr/MLX_unsloth_gemma-2b-it")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```