metadata

license: apache-2.0

Zephyr 7B Beta Llamafiles

See here for a guide on how to use llamafiles!

Original Model: Zephyr 7B Beta
Quantized Model: Zephyr 7B Beta GGUF
Llamafile Source Code: Mozilla-Ocho/llamafile
- Built with Llamafile 5ea929c

Both the server and the CLI are based on TheBloke's Zephyr 7B Beta GGUF Q4_K_M model.

Usage

NOTE: Due to the executable being greater than 4GB, it is currently not compatible with Windows. I will update with a Windows friendly version of Zephyr 7B Beta when I can.

# replace with the CLI if you prefer
wget https://huggingface.co/TimeSurgeLabs/zephyr-7b-beta-llamafile/resolve/main/zephyr-beta-server.llamafile
chmod +x zephyr-beta-server.llamafile
./zephyr-beta-server.llamafile