12.5 tokens/second on 16 GB RAM with 4 GB VRAM GPU Nvidia GTX 1050 Ti
#5 opened 2 months ago
by
JLouisBiz

Adding `safetensors` variant of this model
#2 opened 5 months ago
by
SFconvertbot

Not able to load the model using transformers .
1
#1 opened 7 months ago
by
Pchaudhary