Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Join our Discord! https://discord.gg/Nbv9pQ88Xb
Nearly 2500 members strong πͺ
Now with more channels! A hub for creatives and makers alike!
BeaverAI proudly presents...
Behemoth 123B v2.1 π¦£
Nothing in the void is foreign to us. The place we go is the place we belong.
Links
- Original: https://huggingface.co/TheDrummer/Behemoth-123B-v2.1
- GGUF: https://huggingface.co/TheDrummer/Behemoth-123B-v2.1-GGUF
- iMatrix: https://huggingface.co/bartowski/Behemoth-123B-v2.1-GGUF (recommended for smaller quants)
Description
Behemoth v2.x is a finetune of the new Largestral 2411 with system prompt support. Testers have noted that everything felt improved.
Usage
Testers say this frankenformat maximizes the model's potential: Metharme with Mistral's new system tokens
[SYSTEM_PROMPT] <|system|>{{system_message}}[/SYSTEM_PROMPT]<|user|>{{user_message}}<|model|>{{assistant_message}}
<|system|>[SYSTEM_PROMPT] {{system_message}}[/SYSTEM_PROMPT]<|user|>{{user_message}}<|model|>{{assistant_message}}
Take note that the opening system tag SHOULD ALWAYS have a leading whitespace after it.
Complete SillyTavern Settings in BeaverAI Club: https://discord.com/channels/1238219753324281886/1309968730301792370/1309968730301792370
Versions
- v2.0 is equivalent to Behemoth v1.0 (Classic)
- v2.1 is equivalent to Behemoth v1.1 (Creative Boost)
- v2.2 is an improvement of Behemoth v2.1 (Creative++)
Special Thanks
Thank you to each and everyone who donated/subscribed in Ko-Fi π I hope to never disappoint!
Toasty Pigeon
theguywhogamesalot
Grozi
F
Marinara
Ko-fi Supporter
Grozi
Phaelon
ONTHEREDTEAM
EvarinSharath'fe(USM-Valor)
Silva
Dakkidaze
AlexTheVP
Pseudo
Kistara
Dr. Fjut
Grozi π₯
KinjiHakari777
dustywintr
Syd
HumbleConsumer
Syd
Ko-fi Supporter
Arkamist
joe π₯
Toad
Lied
Konnect
Kistara
Grozi π₯
SleepDeprived3
Luigi
Nestor
https://ko-fi.com/thedrummer/leaderboard
Finetuned by yours truly,
Drummer
- Downloads last month
- 21