---
tags:
    - llamafile
    - GGUF
base_model: TheBloke/openchat-3.5-0106-GGUF
---
## openchat-3.5-0106-llamafile

llamafile lets you distribute and run LLMs with a single file. [announcement blog post](https://hacks.mozilla.org/2023/11/introducing-llamafile/)

#### Downloads

 - [openchat-3.5-0106.Q2_K.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q2_K.llamafile)
 - [openchat-3.5-0106.Q4_K_M.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q4_K_M.llamafile)
 - [openchat-3.5-0106.Q5_K_M.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q5_K_M.llamafile)
 - [openchat-3.5-0106.Q8_0.llamafile](https://huggingface.co/rabil/openchat-3.5-0106-llamafile/resolve/main/openchat-3.5-0106.Q8_0.llamafile)

This repository was created using the [llamafile-builder](https://github.com/rabilrbl/llamafile-builder)