File size: 523 Bytes
5a86b6a e9457e8 5a86b6a e9457e8 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: apache-2.0
tags:
- medusa
---
# Model Description
This is a Medusa model for Mistral 7B Instruct v0.2.
This is trained using the latest Medusa 2 commit.
## Training:
* Dataset used is the self distillation dataset from Mistral 7B Instruct v0.2, temperature 0.3 with output token of 2048.
* It has been trained using axolotl fork as describe in Medusa 2 README.md
## Inference:
* To load the model please follow the instruction found in [Github](https://github.com/FasterDecoding/Medusa?tab=readme-ov-file) |