tags: | |
- bert | |
- adapter-transformers | |
- adapterhub:qa/squad2 | |
- question-answering | |
datasets: | |
- squad_v2 | |
license: "apache-2.0" | |
# Adapter `bert-base-uncased_qa_squad2_pfeiffer` for bert-base-uncased | |
Adapter for bert-base-uncased in Pfeiffer architecture trained on the SQuAD 2.0 dataset for 15 epochs with early stopping and a learning rate of 1e-4. | |
**This adapter was created for usage with the [Adapters](https://github.com/Adapter-Hub/adapters) library.** | |
## Usage | |
First, install `adapters`: | |
``` | |
pip install -U adapters | |
``` | |
Now, the adapter can be loaded and activated like this: | |
```python | |
from adapters import AutoAdapterModel | |
model = AutoAdapterModel.from_pretrained("bert-base-uncased") | |
adapter_name = model.load_adapter("AdapterHub/bert-base-uncased_qa_squad2_pfeiffer") | |
model.set_active_adapters(adapter_name) | |
``` | |
## Architecture & Training | |
- Adapter architecture: pfeiffer | |
- Prediction head: question answering | |
- Dataset: [SQuAD 2.0](https://rajpurkar.github.io/SQuAD-explorer/) | |
## Author Information | |
- Author name(s): Clifton Poth | |
- Author email: calpt@mail.de | |
- Author links: [Website](https://calpt.github.io), [GitHub](https://github.com/calpt), [Twitter](https://twitter.com/@clifapt) | |
## Citation | |
```bibtex | |
``` | |
*This adapter has been auto-imported from https://github.com/Adapter-Hub/Hub/blob/master/adapters/ukp/bert-base-uncased_qa_squad2_pfeiffer.yaml*. |