error running 7B model.

#4
by fudanjx - opened

the 7B seems just nice to fit into my RTX3070 8G VRAM GPU.

But when I start to ask question, there is error:
return torch.layer_norm(input, normalized_shape, weight, bias, eps, torch.backends.cudnn.enabled)
RuntimeError: Expected weight to be of same shape as normalized_shape, but got weight of shape [4096] and normalized_shape = [2560]

Any one also encounter this issue? What does this mean? How to resolve it?

Databricks org

Please say how you are running this

I pretty much follow the MonsterORPG YouTube video, using gadio to run it

Databricks org

OK, I'd follow guidance in this repo to start, or see more notes at https://github.com/databrickslabs/dolly That we can vouch for.

srowen changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment