|
--- |
|
language: en |
|
license: mit |
|
widget: |
|
- text: "What is antibiotic resistance?</s>" |
|
inference: |
|
parameters: |
|
max_new_tokens: 25 |
|
--- |
|
|
|
## ABR-Finetuned-BioGPT |
|
|
|
Many LLM's have general capabilities, but many times domain specific knowledge is more important. To fill this gap we took the BioGPT model pretrained on a large set |
|
of biomedical abstracts and finetuned it on antibiotic resistance abstracts. But to get closer to a chatgpt like model some question and answering datasets where used |
|
to achieve this. |
|
|
|
### Data Trained On |
|
|
|
#### Medical Domain Data |
|
- qiaojin/PubMedQA |
|
- Amirkid/MedQuad-dataset |
|
- PubMed ABR abstracts |
|
- medalpaca/medical_meadow_medical_flashcards |
|
- medalpaca/medical_meadow_wikidoc |
|
|
|
#### General Question Answering |
|
- tatsu-lab/alpaca |
