add info for running on a smartphone
Browse files
README.md
CHANGED
@@ -20,9 +20,11 @@ an ORPO fine-tune of google/gemma-2b.
|
|
20 |
You can find more information, including evaluation and training/usage notebook in the [`gemma-2b-orpo` model card](https://huggingface.co/anakin87/gemma-2b-orpo/)
|
21 |
|
22 |
## 🎮 Model in action
|
23 |
-
The model can run with all the libraries
|
24 |
|
25 |
-
If you need to
|
|
|
|
|
26 |
|
27 |
Here a simple example with **Llama.cpp python**:
|
28 |
```python
|
|
|
20 |
You can find more information, including evaluation and training/usage notebook in the [`gemma-2b-orpo` model card](https://huggingface.co/anakin87/gemma-2b-orpo/)
|
21 |
|
22 |
## 🎮 Model in action
|
23 |
+
The model can run with all the libraries that are part of the Llama.cpp ecosystem.
|
24 |
|
25 |
+
If you need to apply the prompt template manually, take a look at the [tokenizer_config.json of the original model](https://huggingface.co/anakin87/gemma-2b-orpo/blob/main/tokenizer_config.json).
|
26 |
+
|
27 |
+
📱 **Run the model on a budget smartphone** -> [see my recent post](https://www.linkedin.com/posts/stefano-fiorucci_llm-genai-edgecomputing-activity-7183365537618411520-PU2s)
|
28 |
|
29 |
Here a simple example with **Llama.cpp python**:
|
30 |
```python
|