Spaces:
Sleeping
Sleeping
File size: 1,412 Bytes
6692ae2 7aa947f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
title: RATCHET
emoji: 🏆
colorFrom: red
colorTo: gray
sdk: streamlit
sdk_version: 1.19.0
app_file: app.py
pinned: false
license: mit
---
# RATCHET: RAdiological Text Captioning for Human Examined Thoraxes
RATCHET is a Medical Transformer for Chest X-ray Diagnosis and Reporting. Based on the architecture featured in [Attention Is All You Need](https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf). This network is trained and validated on the MIMIC-CXR v2.0.0 dataset.
### Architecture
<p align="center">
<img src="assets/model_transformer.png" alt="RATCHET Architecture" width="300"/>
</p>
### Results
<p align="center">
<img src="https://upload.wikimedia.org/wikipedia/commons/7/7a/Cardiomegally.PNG" alt="Cardiomegaly" height="300"/>
<img src="assets/attn_plot.png" alt="Cardiomegaly Attention Plot" height="300"/>
</p>
##### Generated Text:
> In comparison with the study of \_\_\_, there is little overall change. Again there is substantial enlargement of the cardiac silhouette with a dual-channel pacer device in place. No evidence of vascular congestion or acute focal pneumonia. Blunting of the costophrenic angles is again seen.
### More Examples
<p align="center">
<img src="assets/examples.png" alt="More Captioning Examples" max-height="400"/>
</p>
|