leaderboard-pr-bot's picture
Adding Evaluation Results
2993647
|
raw
history blame
1.87 kB
metadata
license: apache-2.0
datasets:
  - Fredithefish/openassistant-guanaco-unfiltered
language:
  - en
library_name: transformers
pipeline_tag: conversational
inference: false
Alt Text

✨ Guanaco - 3B - Uncensored ✨

Guanaco-3B-Uncensored has been fine-tuned for 6 epochs on the Unfiltered Guanaco Dataset. using RedPajama-INCITE-Base-3B-v1 as the base model.
The model does not perform well with languages other than English.
Please note: This model is designed to provide responses without content filtering or censorship. It generates answers without denials.

Special thanks

I would like to thank AutoMeta for providing me with the computing power necessary to train this model.

Prompt Template

### Human: {prompt} ### Assistant:

Changes

This is the second version of the 3B parameter Guanaco uncensored model. The model has been fine-tuned on the V2 of the Guanaco unfiltered dataset.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 34.35
ARC (25-shot) 42.15
HellaSwag (10-shot) 66.72
MMLU (5-shot) 26.18
TruthfulQA (0-shot) 35.21
Winogrande (5-shot) 63.3
GSM8K (5-shot) 0.3
DROP (3-shot) 6.6