File size: 678 Bytes
9bd4535 74074f9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: apache-2.0
---
## Mamba-2.8B-SlimOrca Model
### Overview
Mamba-2.8B-SlimOrca is a finetune of the original pretrained Mamba model, utilizing the SlimOrca dataset. At this point, it's still pretty rough.
### Usage
The easiest way to try out this model is to use `chat.py` from [Mamba-Chat](https://github.com/havenhq/mamba-chat).
### Future Plans
- Integration with Hugging Face space (planned). Contributions welcome.
### Model Training Details
- Dataset Used: [SlimOrca](https://huggingface.co/datasets/Open-Orca/SlimOrca)
- Training Duration: Single epoch
- Current Status: Training is ongoing. Further iterations will be uploaded if there are improvements.
|