Convolutional recurrent neural networks for future anatomy prediction
Page, D McWilliam, Alan Chuter, Robert Green, Andrew
Page, D
McWilliam, Alan
Chuter, Robert
Green, Andrew
Citations
Altmetric:
Abstract
Purpose or Objective
Highly conformal dose distributions allow for increased dose to target volumes without a significant increase in dose to
nearby organs at risk (OARs). Such dose distributions can become unsafe to deliver due to changes in patient anatomy, such
as tumour shrinkage or weight loss. This mandates the implementation of adaptive radiotherapy (ART), which can be
resource intensive and time consuming. In this work, we investigate the feasibility of using a convolutional recurrent neural
network (CRNN) to predict when replanning will be necessary, allowing for efficient, ahead-of-time resource allocation.
Materials and Methods
A time dependent CRNN was developed capable of predicting the future anatomy of head and neck (HN) cancer patients
undergoing radiotherapy and the accuracy of predictions at different time points in the future was investigated.
Series of 3D CBCTs obtained over a course of treatment, which varied between 5 and 31 in length, from 266 HN patients
were used in this work, a total of 2849 images. For each series, the scans were rigidly registered on the target region. The data was randomly split into 70%, 20% and 10% groups for training, validation and testing respectively. An input series
lengths of 5, the number obtained in one week, along with the date and time at which the scans were obtained, were
presented to the network and predictions of the next 10 scans were produced.
The accuracy of predictions was evaluated using mean squared error (MSE) to compare predicted scans to ground truths.
Results
The average MSE between the network predictions (Fig. 1C) and ground truths (Fig. 1B) in a test set of 27 patients were
2.79x103 for predictions of anatomy made 0-24 hours after the final input scan, 3.85x103 for 48-72 hours after, 6.54x103
for 144-168 hours after and 1.36x104 for 312-336 hours after. However, only 11 of the 27 series in the test set contained 15
or more scans. The 144-168 hours and 312-336 hours results are averages of 22 and 11 prediction accuracies respectively. Conclusion
We produced a CRNN architecture for predicting changes in head and neck patient anatomy given one week of patient
scans. Predictions of anatomy within 72 hours of the final input image exhibit the modelling capabilities of the network.
Further work will focus on improving the model accuracy to provide useful anatomical predictions for one week in the
future and beyond, allowing for its use as a decisions making tool, improving resource allocation.
Description
Date
2022
Publisher
Collections
Keywords
Type
Meetings and Proceedings
Citation
Page D, McWilliam A, Chuter R, Green A. Convolutional recurrent neural networks for future anatomy prediction. Radiotherapy and Oncology. 2022 May;170:S1253-S4. PubMed PMID: WOS:000806779900299.