File size: 647 Bytes
093aefd 3c91e51 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
base_model: Infinigence/Megrez-3B-Instruct
license: apache-2.0
model_creator: Infinigence
model_name: Megrez-3B-Instruct
quantized_by: Second State Inc.
language:
- en
- zh
pipeline_tag: text-generation
---
# Megrez-3B-Instruct-GGUF
## Original Model
[Infinigence/Megrez-3B-Instruct](https://huggingface.co/Infinigence/Megrez-3B-Instruct)
## Run with Gaianet
**Prompt template:**
prompt template: `megrez`
**Context size:**
chat_ctx_size: `32000`
**Run with GaiaNet:**
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
- Customize your node: https://docs.gaianet.ai/node-guide/customize
*Quantized with llama.cpp b4381* |