|
--- |
|
license: cc-by-4.0 |
|
datasets: |
|
- allenai/soda |
|
language: |
|
- en |
|
base_model: |
|
- TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T |
|
library_name: transformers |
|
--- |
|
# Model Card for TinyDialog-1.1B |
|
|
|
## Model Details |
|
|
|
### Basic Information |
|
|
|
- **Model Name:** TinyDialog-1.1B |
|
- **Model Type:** Language Model optimized for dialog |
|
- **Version:** 1.1B |
|
- **Base Model:** TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T |
|
- **Training Data:** allenai/soda |
|
- **Language(s):** English |
|
|
|
## Limitations |
|
|
|
- Limited to English language only |
|
- No unicode support, all text will be normalized to lowercase |
|
- May not perform as well on non-dialog tasks |
|
|
|
## Prompt Format |
|
|
|
The model uses the following prompt template: |
|
|
|
``` |
|
<|begin_of_text_id|><|start_header_id|>Name of person1<|end_header_id|>Sentence 1.<|end_of_sentence_id|><|end_of_message_id|><|start_header_id|>Name of person2<|end_header_id|>Sentence 2.<|end_of_sentence_id|>Sentence 3.<|end_of_sentence_id|><|end_of_message_id|> |
|
``` |
