Why is the weight separated?

#4
by 2U1 - opened

Thanks for the great work!
I have some question about the model.

  1. Why is the model separated?
    I saw the model has lora_weights not merged and the code for loading the model sets the lora adapter and not merging. What is the purpose of this? Does merginig the wieghts harm the performance?

  2. Is the lora weights the instruted tuned weight?

Sign up or log in to comment