AIChenKai
/

TinyLlama-1.1B-Chat-v1.0-x2-MoE

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v1.0-x2-MoE / README.md

AIChenKai's picture

Update README.md

00c3134 about 1 year ago

|

history blame contribute delete

309 Bytes

metadata

license: apache-2.0

Testing model.

Config:

base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]