Zicara
/

OPT-30B-Erebus-4bit-128g

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (3)

Did anyone manage to run it with oobabooga? It's very slow

#7 opened over 1 year ago by

Why is this model so sloooooooow in text-generation-webui?

#6 opened over 1 year ago by

Will there be a non-group sized (not 128g) version released?

#5 opened over 1 year ago by

RuntimeError: expected scalar type Float but found Half

#3 opened over 1 year ago by

I can't get this to work in KoboldAI?

#1 opened over 1 year ago by