---
license: llama2
language:
- en
---

GGUF File format for llama-2-chat-13b models from Meta AI.

# Quantization:
Currently only 2 quants are available in my repository:

|filename| quantization| size|
|--------|-------------|-----|
|ggml-llama-2-13b-chat-q4_k_m.gguf| Q4_K_M| 7.8GB|
|ggml-llama-2-13b-chat-f16.gguf|f16|26GB|


License subject to Meta's original license agreement.