README.md

metadata

language:
  - ms
  - en
  - zh
  - ta

Malaysian Llama 3.2 1B Instruct

Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-3B on Malaysian instruction dataset.

Still on training.

Improvement

1. 128k context length.
2. Support respond in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu.
3. Able to code in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu.
4. Multi-turn Malaysian context such as related to Malaysian Legislation, politics, religions and languages.
5. Malaysian role-playing.
6. Standard RAG.