Simple question, can I load this model in 8bit mode?
#13
by
nmitchko
- opened
Very simple question, I have been working in 8bit mode on GPT-j-6B (the original) and was wondering if I can load this model in 8bit mode?
Sure, but it wasn't answered in discussion 12
@vilimus
nmitchko
changed discussion status to
closed