solidrust
/

MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ

Text Generation

4-bit precision

Inference Endpoints

zhengr/MixTAO-7Bx2-MoE-v8.1

jsfs11/MixtureofMerges-MoE-2x7b-v6

text-generation-inference

Model card Files Files and versions Community

Edit model card

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b AWQ

Model creator: jsfs11
Original model: MixtureofMerges-MoE-2x7b-SLERPv0.9b

Model Summary

MixtureofMerges-MoE-2x7b-SLERPv0.9b is a merge of the following models using LazyMergekit:

Downloads last month: 10

Safetensors

Model size

1.95B params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ

Base model

jsfs11/MixtureofMerges-MoE-2x7b-SLERPv0.9b

Quantized

(1)

this model

Collection including solidrust/MixtureofMerges-MoE-2x7b-SLERPv0.9b-AWQ

2x7B AWQ

Mixture of experts 2 x 7B. • 20 items • Updated Apr 30