|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
datasets: |
|
- m-a-p/COIG-CQIA |
|
language: |
|
- zh |
|
pipeline_tag: text-generation |
|
inference: false |
|
--- |
|
|
|
# Model Card for Model ID |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
This model is fine-tuned on the Qwen1.5-4B-Chat model and COIG-CQIA/ruozhiba dataset by QLoRA. |
|
|
|
Be noted that the model file contains the adapter LoRA weights only, so you are suggested to merge adapters with the base model for inference usage. Check the official reference [here](https://huggingface.co/docs/peft/main/en/developer_guides/lora#merge-adapters) |
|
|
|
This whole training process is running on Google Colab with free computing resources, detail can be accessed via [link](https://colab.research.google.com/drive/1GiI8drsinxhFdprWbqlXtN0DqbHHs1fe?hl=en#scrollTo=5o3OgCMdRGgp) |
|
|
|
This project is for the demonstration only of course DSAA5009, HKUST Guangzhou |
