File size: 673 Bytes
332e17d
 
 
 
 
 
 
 
cca3924
332e17d
 
 
8d1d8e5
 
332e17d
 
 
 
 
 
286be59
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---
language:
- ms
- en
- zh
- ta
---

# Malaysian Llama 3.2 1B Instruct

Continue finetuning https://huggingface.co/meta-llama/Llama-3.2-3B on Malaysian instruction dataset.

**Still on training**.

## Improvement

1. 128k context length.
2. Support respond in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu.
3. Able to code in Mandarin, Tamil, Jawi, Johor, Kedah, Kelantan, Pahang, Perak, Sabah, Sarawak, Selangor, Negeri Sembilan and Terengganu.
4. Multi-turn Malaysian context such as related to Malaysian Legislation, politics, religions and languages.
5. Malaysian role-playing.
6. Standard RAG.