Skip to content

This is the implementation of the 'VSGRU' model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'.

License

Notifications You must be signed in to change notification settings

omar-mohamed/X-Ray-Report-Generation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

58 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

X-Ray-Report-Generation (VSGRU)

This is the implementation of the 'VSGRU' model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'.

Paper link here.

Thesis link here.

We automatically generate full radiology reports given chest X-ray images from the IU-X-Ray dataset by conditioning a recurrent neural net on the visual and semantic features of the image.

vsgru dpi

Installation & Usage

The project was tested on a virtual environment of python 3.7, pip 23.2.1, and MacOS

  • pip install -r full_requirements.txt (or pip install -r requirements.txt if there are errors because of using a different operating system, as requirements.txt only contains the main dependencies and pip will fetch the compatible sub-dependencies, but it will be slower)
  • nlg-eval --setup
  • python get_iu_xray.py (to download the dataset)
  • python train.py

Related Repositories

  • CDGPT2 repository (main paper repo) here.
  • Finetuned Chexnet repository here.

Citation

To cite this paper, please use:

@article{ALFARGHALY2021100557,
title = {Automated radiology report generation using conditioned transformers},
journal = {Informatics in Medicine Unlocked},
volume = {24},
pages = {100557},
year = {2021},
issn = {2352-9148},
doi = {https://doi.org/10.1016/j.imu.2021.100557},
url = {https://www.sciencedirect.com/science/article/pii/S2352914821000472},
author = {Omar Alfarghaly and Rana Khaled and Abeer Elkorany and Maha Helal and Aly Fahmy}
}

About

This is the implementation of the 'VSGRU' model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages