File size: 1,808 Bytes
f745cba 77fa549 f898ece 77fa549 f898ece 512a750 f745cba f898ece f745cba 77fa549 f898ece f745cba 77fa549 f745cba 77fa549 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 |
---
license: apache-2.0
datasets:
- yentinglin/v1
language:
- zh
tags:
- traditional mandarin
- traditional chinese
- taiwan
- moe
- mixtral
- zh-tw
- zh-hant
pretty_name: twllm-moe
---
# Taiwan LLM Mixtrue of Export - Pilot run
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** [Yen-Ting Lin 林彥廷](https://yentingl.com/)
- **Compute Funded by:** [HelperAI](https://helperai.ai/)
- **Model type:** [Mixtral](https://huggingface.co/docs/transformers/model_doc/mixtral)
- **Language(s) (NLP):** Traditional Mandarin (zh-tw)
- **License:** [Apache-2.0](https://www.apache.org/licenses/LICENSE-2.0)
- **Finetuned from model:** [mistralai/Mixtral-8x7B-Instruct-v0.1](https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1)
- **TMMLUS+ score:** 38.09223090909092
### Model Sources
<!-- Provide the basic links for the model. -->
- **Repository:** [Taiwan-LLM](https://github.com/MiuLab/Taiwan-LLM)
- **Paper:** [Taiwan-LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Model](https://arxiv.org/pdf/2311.17487.pdf)
- **Demo:** [Taiwan LLM ChatUI](https://twllm.com/)
## Citation
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
```bibtex
@misc{lin2023taiwan,
title={Taiwan LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Model},
author={Yen-Ting Lin and Yun-Nung Chen},
year={2023},
eprint={2311.17487},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
``` |