Edit model card

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

LeroyDyer/Mixtral_AI_Vision_128k

This model is also a Vision model with 128k context window:

To be further refined! Working!

VISION+ Language Model


If you want to use vision functionality:

Make sure you are using the latest version of KoboldCpp.
To use the multimodal capabilities of this model, such as vision, you also need to load the specified mmproj file, you can get it here.

https://huggingface.co/LeroyDyer/Mixtral_AI_Vision_128k/blob/main/mmproj-model-f16.gguf

You can load the mmproj by using the corresponding section in the interface:


KoboldCpp now supports Vision via Multimodal Projectors (aka LLaVA), allowing it to perceive and react to images! Load a suitable --mmproj file or select it in the GUI launcher to use vision capabilities. (Not working on Vulkan)
Note: This is NOT limited to only LLaVA models, any compatible model of the same size and architecture can gain vision capabilities!
Simply grab a 200mb mmproj file for your architecture here,

 https://huggingface.co/koboldcpp/mmproj

load it with --mmproj and stick it into your favorite compatible model, and it will be able to see images as well!

Merge Details

Merge Method

This model was merged using the linear merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

Downloads last month
0
Safetensors
Model size
7.24B params
Tensor type
FP16
·
Inference Examples
Inference API (serverless) does not yet support transformers models for this pipeline type.

Model tree for LeroyDyer/Mixtral_AI_CyberVision

Quantized
(2)
this model

Collections including LeroyDyer/Mixtral_AI_CyberVision