Hugging Face's logo

grimulkan
/
lzlv-longLORA-70b-rope8-32k-4bpw-h6-exl2

Text Generation
Transformers
Safetensors
llama
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

This is an EXL2 4-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16

Downloads last month
0
Inference API
Text Generation
Examples
Model is too large to load in Inference API (serverless). To try the model, launch it on Inference Endpoints (dedicated) instead.