Where did you get model weights from

#2
by tarunchand - opened

According to lmsys, only 13b model weights have been released, with 7b coming soon. How has this 7b been created? Did you fine-tune llama 7b on the vicuna dataset?

Correct, 7B hasn't officially released. This version has been independently trained by AlekseyKorshuk.

Correct, 7B hasn't officially released. This version has been independently trained by AlekseyKorshuk.

Was his training set exactly the same as Vicuna's?

I think he trained on filtered data

Sign up or log in to comment