Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
<div align="center">
|
| 7 |
+
|
| 8 |
+
# Beepo-22B-GGUF
|
| 9 |
+
</div>
|
| 10 |
+
|
| 11 |
+
This is the GGUF quantization of https://huggingface.co/concedo/Beepo-22B, which was originally finetuned on top of the https://huggingface.co/mistralai/Mistral-Small-Instruct-2409 model.
|
| 12 |
+
|
| 13 |
+
You can use [KoboldCpp](https://github.com/LostRuins/koboldcpp/releases/latest) to run this model.
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
|
| 17 |
+
Key Features:
|
| 18 |
+
- **Retains Intelligence** - LR was kept low and dataset heavily pruned to avoid losing too much of the original model's intelligence.
|
| 19 |
+
- **Instruct prompt format supports Alpaca** - Honestly, I don't know why more models don't use it. If you are an Alpaca format lover like me, this should help. The original Mistral instruct format can still be used, but is not recommended.
|
| 20 |
+
- **Instruct Decensoring Applied** - You should not need a jailbreak for a model to obey the user. The model should always do what you tell it to. No need for weird `"Sure, I will"` or kitten-murdering-threat tricks. No abliteration was done, only finetuning. This model is not evil. It does not moralize. Like a good tool, it just obeys. **It ALWAYS obeys**.
|
| 21 |
+
|
| 22 |
+
<!-- prompt-template start -->
|
| 23 |
+
## Prompt template: Alpaca
|
| 24 |
+
|
| 25 |
+
```
|
| 26 |
+
### Instruction:
|
| 27 |
+
{prompt}
|
| 28 |
+
|
| 29 |
+
### Response:
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
<!-- prompt-template end -->
|
| 33 |
+
|
| 34 |
+
Please leave any feedback or issues that you may have.
|