Artificial Intelligence Measures COVID-19 Lung Disease Severity on Chest X-rays
In This Article
- Researchers at Massachusetts General Hospital have been developing an artificial intelligence algorithm to provide objective measures of disease severity on a continuous spectrum
- When the COVID-19 pandemic emerged, they adapted the algorithm to measure the severity of coronavirus-related lung disease on chest X-rays
- The algorithm could serve a host of applications for COVID-19, including predicting intubation or death
- Other applications of the algorithm include monitoring disease progression in retinopathy of prematurity and evaluating disease severity in knee osteoarthritis
Subscribe to the latest updates from Radiology Advances in Motion
Early this year, a team of researchers at Massachusetts General Hospital was developing an artificial intelligence (AI) algorithm that could measure disease severity and detect change from medical images to help inform clinical decision-making. By March 2020, they had described two potential applications of the algorithm. Monitoring disease progression in retinopathy of prematurity on retinal photographs showed a great deal of promise, as did evaluating disease severity in knee osteoarthritis on X-rays.
The researchers thought about other possible uses; because the algorithm architecture is flexible, it could be generalized to other clinical applications. Then the COVID-19 outbreak emerged as a global pandemic, scrambling the work of researchers and clinicians.
When the hospital experienced a surge of patients with COVID-19, Matthew D. Li, MD, a resident physician in the Department of Radiology at Mass General and a member of the group who built the algorithm in the Quantitative Translational Imaging in Medicine (QTIM) Lab at the Athinoula A. Martinos Center for Biomedical Imaging, volunteered to redeploy to a COVID-19 inpatient service to help with the effort to treat them. "While I was there," he said, "I noticed there is a lot of information in a chest X-ray that isn't really extracted or communicated in the report," information that could convey to clinicians the severity of the findings.
To help clinicians take advantage of this information, he and colleagues in the QTIM group set out to create an AI tool that could extract it from chest X-rays. They reported the tool in Radiology: Artificial Intelligence in late July 2020.
Objective Measures of Severity and Change
Clinicians often use imaging to evaluate both the severity and progression of the disease, in many cases by assigning severity to one of several categories based on the imaging findings and seeing whether and how the classification changes on follow-up. This approach has limitations, though. Because manual readings are inherently subjective, there is inevitably variability in clinicians' interpretations of the severity.
In their work before the pandemic, the members of the QTIM group addressed this challenge by developing an automated algorithm (reported in NPJ Digital Medicine) for disease severity evaluation and change detection on a continuous spectrum. Based on the Siamese neural network, a type of deep learning architecture originally deployed in the 1990s for verification of credit card signatures, this algorithm takes two medical images as inputs and outputs a quantitative measure of difference in disease severity between the two images.
Having decided to apply it to imaging of COVID-19, the researchers set about training the algorithm—that is, feeding it imaging data so it could learn to extract patterns from other, similar data. For pretraining, they used a publicly available chest X-ray data set, CheXpert, from Stanford Hospital in Palo Alto, with 224,316 chest X-rays. For subsequent training, they used 314 admission chest X-rays from patients hospitalized at Mass General for COVID-19 during the period of April 1 to April 10, 2020. Further testing was done with additional COVID-19 data sets.
Now that it has been trained, when fed a new chest X-ray, the algorithm can extract a quantified measure of COVID-19 lung disease severity called the pulmonary X-ray severity (PXS) score. Comparisons with ground-truth interpretations by multiple Mass General radiologists showed correlations between PXS scores and tedious manually annotated scores for severity.
Informing Clinical Decision-Making
The researchers say the new algorithm is nearly ready to be deployed to clinical workflows for prospective testing in the COVID-19 pandemic. Jayashree Kalpathy-Cramer, PhD, senior author of the study and director of the QTIM Lab, described several possible use cases for the algorithm.
First, she said, is enabling standardized radiologist reporting and thus addressing the challenge of inter-rater and intra-rater variability. When a frontline clinician reads the radiologist's report, a descriptor is only useful if it is reproducible (e.g., severe means severe, mild means mild). PXS score may help improve this reproducibility.
The algorithm could also be helpful in clinical decision-making, as the PXS score can help predict subsequent intubation (needing a ventilator) or death. For example, by setting a PXS score threshold, frontline clinicians could use it to help assess the risk of patient decompensation, along with other clinical data like lab values and vital signs. To this end, the researchers are working to validate the algorithm in several additional cohorts so it can better generalize to broader patient populations.
Another possible application in patients with COVID-19 is monitoring the progression of the disease, providing a quantifiable answer to the question of whether or not a patient is getting better. Here, the authors of the study are now working with Bruce Fischl, PhD, and Adrian Dalca, PhD, both of the Laboratory for Computational Neuroimaging, also at the Martinos Center, to incorporate novel registration techniques to improve change detection with the algorithm.
Learn more about the Radiology Department
Learn more about the Quantitative Translational Imaging in Medicine (QTIM) Lab