MoCLE
Collection
A collection of MoCLE checkpoints (https://kaichen1998.github.io/projects/mocle/)
•
7 items
•
Updated
MoCLE is a Multi-modality Large Language Model (MLLM) with a Mixture-of-Experts (MoE) architecture for instruction customization and generalization based on InstructBLIP. This repo contains the MoCLE checkpoint with 16 instruction clusters and a routing temperature of 0.05. Check detailed usage in our Github repo and Website.