BigMaid
Collection
Fun to talk to models.
•
4 items
•
Updated
BigMaid-20B-v1.0
Model Details
- A result of interleaving layers of KatyTheCutie/EstopianMaid-13B with itself.
- The resulting model has approximately 20 billion parameters.
- See mergekit-config.yml for details on the merge method used.
Warning: This model can produce NSFW content!
Results
- Bigger version of original, uncensored like oryginal.
- Retains all good qualities of original with additional affinity for abstract and lighthearted humor
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 56.07 |
| AI2 Reasoning Challenge (25-Shot) | 61.35 |
| HellaSwag (10-Shot) | 85.26 |
| MMLU (5-Shot) | 57.15 |
| TruthfulQA (0-shot) | 55.29 |
| Winogrande (5-shot) | 75.30 |
| GSM8k (5-shot) | 2.05 |
- Downloads last month
- 728
Collection including TeeZee/BigMaid-20B-v1.0
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard61.350
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard85.260
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard57.150
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard55.290
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard75.300
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard2.050