Edit model card

Model Card for TinyDialog-1.1B

Model Details

Basic Information

  • Model Name: TinyDialog-1.1B
  • Model Type: Language Model optimized for dialog
  • Version: 1.1B
  • Base Model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
  • Training Data: allenai/soda
  • Language(s): English

Limitations

  • Limited to English language only
  • No unicode support, all text will be normalized to lowercase
  • May not perform as well on non-dialog tasks

Prompt Format

The model uses the following prompt template:

<|begin_of_text_id|><|start_header_id|>Name of person1<|end_header_id|>Sentence 1.<|end_of_sentence_id|><|end_of_message_id|><|start_header_id|>Name of person2<|end_header_id|>Sentence 2.<|end_of_sentence_id|>Sentence 3.<|end_of_sentence_id|><|end_of_message_id|>
Downloads last month
29
Safetensors
Model size
1.07B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Zeger56644/TinyDialog-1.1B

Finetuned
(89)
this model

Dataset used to train Zeger56644/TinyDialog-1.1B