metadata
license: apache-2.0
language:
- en
library_name: peft
pipeline_tag: text2text-generation
- Base Model: Llama-2-7b-hf
- LoRA target:
q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj - LoRA rank: 16
- Training epochs: 4
See https://github.com/punica-ai/punica/tree/master/examples/finetune