|
--- |
|
license: other |
|
license_name: llama3 |
|
license_link: https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct/blob/main/LICENSE |
|
--- |
|
GGUF of [Replete-AI Llama 3 11.5B Instruct V2](https://huggingface.co/Replete-AI/Llama-3-11.5B-Instruct-v2) |
|
|
|
Quantized with llama.cpp commit <s>[b2710](https://github.com/ggerganov/llama.cpp/releases/tag/b2710)</s> [b2780](https://github.com/ggerganov/llama.cpp/releases/tag/b2780) |
|
|
|
Original model description below<hr> |
|
|
|
Llama-3-11.5B-Instruct-v2 |
|
|
|
Thank you to Meta for the weights for Meta-Llama-3-8B-Instruct |
|
|
|
 |
|
|
|
This is an upscaling of the Meta-Llama-3-8B-Instruct Ai using techniques created for chargoddard/mistral-11b-slimorca. This Ai model has been upscaled from 8b parameters to 11.5b parameters without any continuous pretraining or fine-tuning. |
|
|
|
Unlike version 1 this model has no issues at fp16 or any quantizations. |
|
|
|
The model that was used to create this one is linked below: |
|
|
|
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct |
