farrell236 commited on
Commit
7aa947f
1 Parent(s): 77c8482

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -10,4 +10,37 @@ pinned: false
10
  license: mit
11
  ---
12
 
13
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  license: mit
11
  ---
12
 
13
+ # RATCHET: RAdiological Text Captioning for Human Examined Thoraxes
14
+
15
+ RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting. Based on the architecture featured in [Attention Is All You Need](https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf). This network is trained and validated on the MIMIC-CXR v2.0.0 dataset.
16
+
17
+
18
+ ### Architecture
19
+
20
+ <p align="center">
21
+ <img src="assets/model_transformer.png" alt="RATCHET Architecture" width="300"/>
22
+ </p>
23
+
24
+
25
+ ### Results
26
+
27
+ <p align="center">
28
+ &nbsp;&nbsp;&nbsp;&nbsp;
29
+ <img src="https://upload.wikimedia.org/wikipedia/commons/7/7a/Cardiomegally.PNG" alt="Cardiomegaly" height="300"/>
30
+ &nbsp;&nbsp;&nbsp;&nbsp;
31
+ &nbsp;&nbsp;&nbsp;&nbsp;
32
+ <img src="assets/attn_plot.png" alt="Cardiomegaly Attention Plot" height="300"/>
33
+ &nbsp;&nbsp;&nbsp;&nbsp;
34
+ </p>
35
+
36
+
37
+ ##### Generated Text:
38
+
39
+ > In comparison with the study of \_\_\_, there is little overall change. Again there is substantial enlargement of the cardiac silhouette with a dual-channel pacer device in place. No evidence of vascular congestion or acute focal pneumonia. Blunting of the costophrenic angles is again seen.
40
+
41
+
42
+ ### More Examples
43
+
44
+ <p align="center">
45
+ <img src="assets/examples.png" alt="More Captioning Examples" max-height="400"/>
46
+ </p>