TY - JOUR
T1 - SMORE
T2 - A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning
AU - Zhao, Can
AU - Dewey, Blake E.
AU - Pham, Dzung L.
AU - Calabresi, Peter A.
AU - Reich, Daniel S.
AU - Prince, Jerry L.
N1 - Publisher Copyright:
© 1982-2012 IEEE.
PY - 2021/3
Y1 - 2021/3
N2 - High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-To-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.2 This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-Aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
AB - High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-To-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.2 This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-Aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
KW - anti-Aliasing
KW - convolutional neural network
KW - deep network
KW - magnetic resonance imaging
KW - self-supervised
KW - super-resolution
UR - http://www.scopus.com/inward/record.url?scp=85096839586&partnerID=8YFLogxK
U2 - 10.1109/TMI.2020.3037187
DO - 10.1109/TMI.2020.3037187
M3 - Article
C2 - 33170776
AN - SCOPUS:85096839586
SN - 0278-0062
VL - 40
SP - 805
EP - 817
JO - IEEE Transactions on Medical Imaging
JF - IEEE Transactions on Medical Imaging
IS - 3
M1 - 9253710
ER -