Hugging Face's logo

grimulkan
/
Goliath-longLORA-120b-rope8-32k-6bpw_h8_exl2

Text Generation
Transformers
llama
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

This is an EXL2 6-bit quantization of Goliath-longLORA-120b-rope8-32k-fp16

Downloads last month
2
Inference API
Text Generation
Examples
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.