---
license: wtfpl
datasets:
- ms_marco
- squad
language:
- en
---
# Model

t5-base-msmarco-squad-query-generation-firstp-v2

Task: query generation 
Architecture: T5

Base model: t5-base

Note: This is supposed to be a baseline model.


## Prompt:

"Generate Query: {document}. Query:"

## Sequence length:

512 tokens

## Training details

### Hyperparameters

Batch size: 8;  
Gradient acc: 8;
LR: 3e-4, linear scheduler, 400 warmup steps.  


### Data

Total: 252059 pairs (document, query) 

From MARCO-V2: 165238
From SQuAD: 86821

The remaining queries from MARCO-V2 train split were not used.

## Evaluation

This model is supposed to be used for data augmentation.
Hence, meaningful evaluation will come from downstream tasks.

MARCO-V2 Dev1:
BLEU: 0.105
ROUGE: 0.449

MARCO-V2 Dev2:
BLEU: 0.171
ROUGE: 0.503