cognitivecomputations

/

dolphin-2_6-phi-2

like 191

Excellent work as always. I was curious how you are merging the QLoRA adapter weights. I know there was some discussion last year around the optimal way to merge the QLoRA adapter weights with the base model but doesn't seem as though a consensus was reached (a lot of results had shown the naive method often gave poor results). Thanks!