GGUF
English
Inference Endpoints

This is a big step forward for 3B class models. Trained on smol PIPPA, alpaca-cleaned, and two custom datasets, and based on https://huggingface.co/jeiku/Rosa_v3_3B

This should serve as a decent fiction model, though it also excels at roleplaying, but is not an ideal model for logical queries or riddles.

Downloads last month
43
GGUF
Model size
2.8B params
Architecture
stablelm

2-bit

3-bit

4-bit

5-bit

6-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .

Datasets used to train jeiku/Foundation_3B_GGUF