Hugging Face's logo

mesolitica
/
Qwen2-0.5B-8192-fpf

Text Generation
Transformers
Safetensors
Malay
qwen2
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

Full Parameter Finetuning 0.5B 8192 context length Qwen 2 on Malaysian text 12.86B tokens

Continue pretraining https://huggingface.co/Qwen/Qwen2-0.5B on 12.86B tokens Malaysian dataset using 8192 context length.

WanDB at https://wandb.ai/huseinzol05/Qwen2-0.5B-fpf/workspace?nw=nwuserhuseinzol05

Downloads last month
49
Safetensors
Model size
494M params
Tensor type
BF16
·
Inference API
Text Generation
Input a message to start chatting with mesolitica/Qwen2-0.5B-8192-fpf.
This model can be loaded on Inference API (serverless).

Collection including mesolitica/Qwen2-0.5B-8192-fpf