See merge.yml for information about this model's contents.

In some brief testing, this model performed very well in RP and general chatting, easily better than v1, and about as good as I could hope for from the StableLM lineage. This will likely be my final StableLM merge.

GGUF available here: https://huggingface.co/jeiku/Rosa_v2_3B_GGUF

Downloads last month: 11

Safetensors

Model size

2.8B params

Tensor type

BF16

Inference Examples

Text Generation

Inference API (serverless) does not yet support model repos that contain custom code.