ESRGAN network for super-resolution reconstruction of anisotropic 3D-MRI images
CSTR:
Author:
Clc Number:

TP391

  • Article
  • | |
  • Metrics
  • |
  • Reference [31]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    High-resolution(HR) magnetic resonance images (MRI) can improve the accuracy of disease diagnosis, but it is very difficult to obtain high-resolution MRI. Image super-resolution (SR) technology based on deep learning can effectively improve image resolution. In recent years, the generative adversarial networks (GANs) have provided new ideas for 3D-MRI SR reconstruction. Compared with the traditional SR algorithm based on deep convolutional neural network (DCNN), the GANs network targets the human visual mechanism and introduces a discriminant function to make the reconstructed 3D-MRI closer to the real image. We introduced the enhanced super-resolution generative adversarial network (ESRGAN) to perform SR reconstruction of 3D-MRI, and used the cross-layer self-similarity of 3D-MRI to reduce the dimensionality of the reconstruction task to 2D. On the basis of ensuring the reconstruction effect, the proposed method can reduce network training time and memory requirements. Compared with other traditional algorithms and DCNN-based techniques, experimental results show that our proposed method can further improve the visual quality of SR 3D-MRI.

    Reference
    [1] Pham C H, Tor-Díez C, Meunier H, et al. Multiscale brain MRI super-resolution using deep 3D convolutional networks[J]. Computerized Medical Imaging and Graphics, 2019, 77:101647.
    [2] Srinivasan K, Ankur A, Sharma A. Super-resolution of magnetic resonance images using deep convolutional neural networks[C]//2017 IEEE International Conference on Consumer Electronics-Taiwan. June 12-14, 2017,[S. L.]:IEEE, 2017:41-42.
    [3] Chen Y H, Xie Y B, Zhou Z W, et al. Brain MRI super resolution using 3D deep densely connected neural networks[C]//2018 IEEE 15th International Symposium on Biomedical Imaging. April 4-7, 2018, Washington, DC, USA. IEEE, 2018:739-742.
    [4] Chen Y H, Shi F, Christodoulou A G, et al. Efficient and accurate MRI super-resolution using a generative adversarial network and 3D multi-level densely connected network[C]//Medical Image Computing and Computer Assisted Intervention-MICCAI 2018. Granada, Spain:Springer, 2018:91-99.
    [5] Sánchez I, Vilaplana V. Brain MRI super-resolution using 3D generative adversarial networks[J]. arXiv preprint arXiv:1812.11440, 2018.
    [6] Chen Y, Christodoulou A G, Zhou Z, et al. Mri super-resolution with gan and 3d multi-level densenet:Smaller, faster, and better[J]. arXiv preprint arXiv:2003.01217, 2020.
    [7] Wang X T, Yu K, Wu S, et al. Esrgan:Enhanced super-resolution generative adversarial networks[C]//Proceedings of the European conference on computer vision (ECCV) workshops. Munich German:IEEE, 2019:63-79.
    [8] Ledig C, Theis L, Huszár F, et al. Photo-realistic single image super-resolution using a generative adversarial network[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition. July 21-26, 2017. Honolulu, HI, USA:IEEE, 2017:105-114.
    [9] He K M, Zhang X Y, Ren S Q, et al. Delving deep into rectifiers:surpassing human-level performance on ImageNet classification[C]//2015 IEEE International Conference on Computer Vision. December 7-13, 2015. Santiago, Chile:IEEE, 2015:1026-1034.
    [10] Shi W Z, Caballero J, Huszár F, et al. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition. June 27-30, 2016. Las Vegas, NV, USA:IEEE, 2016:1874-1883.
    [11] Lim B, Son S, Kim H, et al. Enhanced deep residual networks for single image super-resolution[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. July 21-26, 2017. Honolulu, HI, USA:IEEE, 2017:1132-1140.
    [12] Zhang Y L, Tian Y P, Kong Y, et al. Residual dense network for image super-resolution[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 18-23, 2018. Salt Lake City, UT, USA:IEEE, 2018:2472-2481.
    [13] Zhang Y L, Li K P, Li K, et al. Image super-resolution using very deep residual channel attention networks[M]//Computer Vision-ECCV 2018. Cham:Springer International Publishing, 2018:294-310.
    [14] Jolicoeur-Martineau A. The relativistic discriminator:a key element missing from standard GAN[J]. arXiv preprint arXiv:1807.00734, 2018.
    [15] Gatys L A, Ecker A S, Bethge M. Texture synthesis using convolutional neural networks[EB/OL]. 2015:arXiv:1505.07376[cs.CV]. https://arxiv.org/abs/1505.07376.
    [16] Bruna J, Sprechmann P, LeCun Y. Super-resolution with deep convolutional sufficient statistics[EB/OL]. 2015:arXiv:1511.05666[cs.CV]. https://arxiv.org/abs/1511.05666.
    [17] Johnson J, Alahi A, Li F F. Perceptual losses for real-time style transfer and super-resolution[EB/OL]. 2016:arXiv:1603.08155[cs.CV]. https://arxiv.org/abs/1603.08155.
    [18] Plenge E, Poot D H J, Niessen W J, et al. Super-resolution reconstruction using cross-scale self-similarity in multi-slice MRI[J]. Medical Image Computing and Computer-Assisted Intervention:MICCAI International Conference on Medical Image Computing and Computer-Assisted Intervention, 2013, 16(Pt 3):123-130.
    [19] Manjón J V, Coupé P, Buades A, et al. Non-local MRI upsampling[J]. Medical Image Analysis, 2010, 14(6):784-792.
    [20] Jia Y Y, He Z S, Gholipour A, et al. Single anisotropic 3-D MR image upsampling via overcomplete dictionary trained from in-plane high resolution slices[J]. IEEE Journal of Biomedical and Health Informatics, 2016, 20(6):1552-1561.
    [21] Dong C, Loy C C, He K, et al. Learning a deep convolutional network for image super-resolution[C]//European Conference on Computer Vision. Zürich, Switzerland:Springer, 2014:184-199.
    [22] Kim J, Lee J K, Lee K M. Accurate image super-resolution using very deep convolutional networks[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition. June 27-30, 2016. Las Vegas, NV, USA:IEEE, 2016:1646-1654.
    [23] Du J L, He Z S, Wang L L, et al. Super-resolution reconstruction of single anisotropic 3D MR images using residual convolutional neural network[J]. Neurocomputing, 2020, 392:209-220.
    [24] Landman B A, Huang A J, Gifford A, et al. Multi-parametric neuroimaging reproducibility:a 3-T resource study[J]. NeuroImage, 2011, 54(4):2854-2866.
    [25] Menze B H, Jakab A, Bauer S, et al. The multimodal brain tumor image segmentation benchmark (BRATS)[J]. IEEE Transactions on Medical Imaging, 2015, 34(10):1993-2024.
    [26] Cocosco C A, Kollokian V, Kwan R K S, et al. Brainweb:Online interface to a 3D MRI simulated brain database[J]. NeuroImage. 1997, 5(4):24.
    [27] Blau Y, Mechrez R, Timofte R, et al. The 2018 PIRM challenge on perceptual image super-resolution[C]//European Conference on Computer Vision. Munich, Germany:Springer, 2018:334-355.
    [28] Blau Y, Michaeli T. The perception-distortion tradeoff[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 18-23, 2018. Salt Lake City, UT, USA:IEEE, 2018:6228-6237.
    [29] Ma C, Yang C Y, Yang X K, et al. Learning a no-reference quality metric for single-image super-resolution[J]. Computer Vision and Image Understanding, 2017, 158:1-16.
    [30] Mittal A, Soundararajan R, Bovik A C. Making a "completely blind" image quality analyzer[J]. IEEE Signal Processing Letters, 2013, 20(3):209-212.
    [31] Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing:a Publication of the IEEE Signal Processing Society, 2004, 13(4):600-612.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

张建,贾媛媛,贺向前,韩宝如,祝华正,杜井龙.面向各向异性3D-MRI图像超分辨率 重建的ESRGAN网络[J].重庆大学学报,2022,45(5):114~124

Copy
Share
Article Metrics
  • Abstract:675
  • PDF: 1118
  • HTML: 913
  • Cited by: 0
History
  • Received:October 12,2020
  • Online: June 11,2022
Article QR Code