File size: 759 Bytes
4b03472
 
 
 
 
eb39552
 
acbebb9
4b03472
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
---
language: en
license: mit
widget:
- text: "What is antibiotic resistance?</s>"
inference:
  parameters:
    max_new_tokens: 25
---

## ABR-Finetuned-BioGPT

Many LLM's have general capabilities, but many times domain specific knowledge is more important. To fill this gap we took the BioGPT model pretrained on a large set 
of biomedical abstracts and finetuned it on antibiotic resistance abstracts. But to get closer to a chatgpt like model some question and answering datasets where used
to achieve this.

### Data Trained On

#### Medical Domain Data
- qiaojin/PubMedQA
- Amirkid/MedQuad-dataset
- PubMed ABR abstracts
- medalpaca/medical_meadow_medical_flashcards
- medalpaca/medical_meadow_wikidoc

#### General Question Answering
- tatsu-lab/alpaca