Can we have a smaller model.bin?

#4
by doufulai - opened

The current bin size is too large and when I download the weight, it is always corrupted. 9.3GB instead of 9.9GB

The current bin size is too large and when I download the weight, it is always corrupted. 9.3GB instead of 9.9GB

This is model v1.0, which has been superseded by v1.1. The deltas for v1.1 are https://huggingface.co/lmsys/vicuna-13b-delta-v1.1

I have made an HF format repo for v1.1, which you can use immediately without needing to apply the deltas. My v1.1 HF repo is here: https://huggingface.co/TheBloke/vicuna-13B-1.1-HF

So if you're having problems applying the delta, I'd recommend just downloading my HF model. Then you can run that straight away, with no further work required.

Sign up or log in to comment