metadata
language: en
license: mit
widget:
- text: What is antibiotic resistance?</s>
inference:
parameters:
max_new_tokens: 25
ABR-Finetuned-BioGPT
Many LLM's have general capabilities, but many times domain specific knowledge is more important. To fill this gap we took the BioGPT model pretrained on a large set of biomedical abstracts and finetuned it on antibiotic resistance abstracts. But to get closer to a chatgpt like model some question and answering datasets where used to achieve this.
Data Trained On
Medical Domain Data
- qiaojin/PubMedQA
- Amirkid/MedQuad-dataset
- PubMed ABR abstracts
- medalpaca/medical_meadow_medical_flashcards
- medalpaca/medical_meadow_wikidoc
General Question Answering
- tatsu-lab/alpaca