error running 7B model.
#4
by
fudanjx
- opened
the 7B seems just nice to fit into my RTX3070 8G VRAM GPU.
But when I start to ask question, there is error:
return torch.layer_norm(input, normalized_shape, weight, bias, eps, torch.backends.cudnn.enabled)
RuntimeError: Expected weight to be of same shape as normalized_shape, but got weight of shape [4096] and normalized_shape = [2560]
Any one also encounter this issue? What does this mean? How to resolve it?
Please say how you are running this
I pretty much follow the MonsterORPG YouTube video, using gadio to run it
OK, I'd follow guidance in this repo to start, or see more notes at https://github.com/databrickslabs/dolly That we can vouch for.
srowen
changed discussion status to
closed