---
license: other
license_name: tongyi-qianwen
base_model: cognitivecomputations/dolphin-vision-72b
datasets:
- cognitivecomputations/Dolphin-2.9
- teknium/OpenHermes-2.5
- m-a-p/CodeFeedback-Filtered-Instruction
- cognitivecomputations/dolphin-coder
- cognitivecomputations/samantha-data
- microsoft/orca-math-word-problems-200k
- Locutusque/function-calling-chatml
- internlm/Agent-FLAN
---

# DolphinVision 72b - 4.0bpw EXL2 🐬

Base model: [cognitivecomputations/dolphin-vision-72b](https://huggingface.co/cognitivecomputations/dolphin-vision-72b)  

Language model quantized to 4.0bpw with FP16 vision layers merged back in.  

Text working in exllamav2/tabbyapi. Vision input not working yet.  

n.b. architecture in config.json has been changed from "BunnyQwenForCausalLM" to "Qwen2ForCausalLM" to prevent model from being loaded as llama in tabbyapi.