More quants

#2
by aikitoria - opened

I made some smaller quants to try this model on more reasonable hardware: https://huggingface.co/aikitoria/Goliath-longLORA-120b-rope8-32k-exl2

Thanks for creating this! It's so much better than the original with rope scaling!

Fantastic

Sign up or log in to comment