grimulkan
/

lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2

Text Generation

Transformers

llama

Inference Endpoints

Model card Files Files and versions Community

This is an EXL2 6-bit quantization of lzlv-longLORA-70b-rope8-32k-fp16

Downloads last month: 4

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.