metadata
license: wtfpl
datasets:
- ms_marco
- squad
language:
- en
Model
t5-base-msmarco-squad-query-generation-firstp-v2
Task: query generation Architecture: T5
Base model: t5-base
Note: This is supposed to be a baseline model.
Prompt:
"Generate Query: {document}. Query:"
Sequence length:
512 tokens
Training details
Hyperparameters
Batch size: 8;
Gradient acc: 8;
LR: 3e-4, linear scheduler, 400 warmup steps.
Data
Total: 252059 pairs (document, query)
From MARCO-V2: 165238 From SQuAD: 86821
The remaining queries from MARCO-V2 train split were not used.
Evaluation
This model is supposed to be used for data augmentation. Hence, meaningful evaluation will come from downstream tasks.
MARCO-V2 Dev1: BLEU: 0.105 ROUGE: 0.449
MARCO-V2 Dev2: BLEU: 0.171 ROUGE: 0.503