red pajama
Collection
1 item
•
Updated
Base Model
native fine tune of togethercomputer/RedPajama-INCITE-Base-3B-v1
Prompting
The current model version has been trained on prompts using three different roles, which are denoted by the following tokens: <|system|>, <|user|> and <|model|>.
The <|system|> prompt can be used to inject out-of-channel information behind the scenes, while the <|user|> prompt should be used to indicate user input. The <|model|> token should then be used to indicate that the model should generate a response. These tokens can happen multiple times and be chained up to form a conversation history.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 33.48 |
| ARC (25-shot) | 40.96 |
| HellaSwag (10-shot) | 64.54 |
| MMLU (5-shot) | 26.58 |
| TruthfulQA (0-shot) | 31.65 |
| Winogrande (5-shot) | 64.09 |
| GSM8K (5-shot) | 1.14 |
| DROP (3-shot) | 5.41 |
- Downloads last month
- 1,533
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.