Spaces:
Sleeping
Sleeping
farrell236
commited on
Commit
•
7aa947f
1
Parent(s):
77c8482
Update README.md
Browse files
README.md
CHANGED
@@ -10,4 +10,37 @@ pinned: false
|
|
10 |
license: mit
|
11 |
---
|
12 |
|
13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
license: mit
|
11 |
---
|
12 |
|
13 |
+
# RATCHET: RAdiological Text Captioning for Human Examined Thoraxes
|
14 |
+
|
15 |
+
RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting. Based on the architecture featured in [Attention Is All You Need](https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf). This network is trained and validated on the MIMIC-CXR v2.0.0 dataset.
|
16 |
+
|
17 |
+
|
18 |
+
### Architecture
|
19 |
+
|
20 |
+
<p align="center">
|
21 |
+
<img src="assets/model_transformer.png" alt="RATCHET Architecture" width="300"/>
|
22 |
+
</p>
|
23 |
+
|
24 |
+
|
25 |
+
### Results
|
26 |
+
|
27 |
+
<p align="center">
|
28 |
+
|
29 |
+
<img src="https://upload.wikimedia.org/wikipedia/commons/7/7a/Cardiomegally.PNG" alt="Cardiomegaly" height="300"/>
|
30 |
+
|
31 |
+
|
32 |
+
<img src="assets/attn_plot.png" alt="Cardiomegaly Attention Plot" height="300"/>
|
33 |
+
|
34 |
+
</p>
|
35 |
+
|
36 |
+
|
37 |
+
##### Generated Text:
|
38 |
+
|
39 |
+
> In comparison with the study of \_\_\_, there is little overall change. Again there is substantial enlargement of the cardiac silhouette with a dual-channel pacer device in place. No evidence of vascular congestion or acute focal pneumonia. Blunting of the costophrenic angles is again seen.
|
40 |
+
|
41 |
+
|
42 |
+
### More Examples
|
43 |
+
|
44 |
+
<p align="center">
|
45 |
+
<img src="assets/examples.png" alt="More Captioning Examples" max-height="400"/>
|
46 |
+
</p>
|