|
--- |
|
tags: |
|
- quantized |
|
- 2-bit |
|
- 3-bit |
|
- 4-bit |
|
- 5-bit |
|
- 6-bit |
|
- 8-bit |
|
- GGUF |
|
- transformers |
|
- safetensors |
|
- mistral |
|
- text-generation |
|
- arxiv:2304.12244 |
|
- arxiv:2306.08568 |
|
- arxiv:2308.09583 |
|
- license:apache-2.0 |
|
- autotrain_compatible |
|
- endpoints_compatible |
|
- text-generation-inference |
|
- region:us |
|
- text-generation |
|
model_name: WizardLM-2-8x22B-GGUF |
|
base_model: microsoft/WizardLM-2-7B |
|
inference: false |
|
model_creator: microsoft |
|
pipeline_tag: text-generation |
|
quantized_by: MaziyarPanahi |
|
--- |
|
# [MaziyarPanahi/WizardLM-2-8x22B-GGUF](https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF) |
|
- Model creator: [microsoft](https://huggingface.co/microsoft) |
|
- Original model: [microsoft/WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B) |
|
|
|
## Description |
|
[MaziyarPanahi/WizardLM-2-7B-GGUF](https://huggingface.co/MaziyarPanahi/WizardLM-2-8x22B-GGUF) contains GGUF format model files for [microsoft/WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B). |
|
|
|
|
|
## Prompt template |
|
|
|
``` |
|
{system_prompt} |
|
USER: {prompt} |
|
ASSISTANT: </s> |
|
``` |
|
|
|
or |
|
|
|
``` |
|
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, |
|
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s> |
|
USER: {prompt} ASSISTANT: </s>...... |
|
``` |
|
|
