llama-13b-pth / params.json
TheBloke's picture
Uploading Llama 13B as provided by Facebook.
e7381de
raw
history blame
101 Bytes
{"dim": 5120, "multiple_of": 256, "n_heads": 40, "n_layers": 40, "norm_eps": 1e-06, "vocab_size": -1}