Contents lists available at ScienceDirect
Magnetic Resonance Imaging
journal homepage: www.elsevier.com/locate/mri
Region-of-interest undersampled MRI reconstruction: A deep convolutional
neural network approach
Liyan Sun
a
, Zhiwen Fan
a
, Xinghao Ding
a,
*, Yue Huang
a
, John Paisley
b
a
Fujian Key Laboratory of Sensing and Computing for Smart City, Xiamen University, Fujian, China
b
Department of Electrical Engineering, Columbia University, New York, NY, USA
ARTICLE INFO
Keywords:
Deep convolutional neural network
Magnetic resonance imaging
Image reconstruction
Region of interest
ABSTRACT
Compressive sensing enables fast magnetic resonance imaging (MRI) reconstruction with undersampled k-space
data. However, in most existing MRI reconstruction models, the whole MR image is targeted and reconstructed
without taking specific tissue regions into consideration. This may fails to emphasize the reconstruction accuracy
on important and region-of-interest (ROI) tissues for diagnosis. In some ROI-based MRI reconstruction models,
the ROI mask is extracted by human experts in advance, which is laborious when the MRI datasets are too large.
In this paper, we propose a deep neural network architecture for ROI MRI reconstruction called ROIRecNet to
improve reconstruction accuracy of the ROI regions in under-sampled MRI. In the model, we obtain the ROI
masks by feeding an initially reconstructed MRI from a pre-trained MRI reconstruction network (RecNet) to a
pre-trained MRI segmentation network (ROINet). Then we fine-tune the RecNet with a binary weighted ℓ
2
loss
function using the produced ROI mask. The resulting ROIRecNet can offer more focus on the ROI. We test the
model on the MRBrainS13 dataset with different brain tissues being ROIs. The experiment shows the proposed
ROIRecNet can significantly improve the reconstruction quality of the region of interest.
1. Introduction
Magnetic resonance imaging (MRI) is a medical imaging modality
that generates high-resolution anatomical images with little radiation,
but is potentially limited by slow data acquisition speed [1]. Different
acceleration techniques have been proposed such as fast pulse sequence
designs, parallel imaging, and applying compressed sensing theory.
Compressed sensing has attracted researchers' attention in general be-
cause of the wide applicability of its theory, which proves a signal can
be very accurately recovered with few measurements if it can be
sparsely represented [2]. Compressed sensing methods have been ex-
plored in fast MR imaging (CS-MRI) for acceleration and are recently
being employed by industry [3].
In conventional MRI reconstruction methods built upon compressed
sensing, a reconstructed image is produced based on interpolating the
unsampled Fourier measurements in k-space. The classic CS-MRI pro-
blem can be formulated as
= +x F x y xargmin ( ),
x
u
2
2
is the underlying P-dimensional vectorized MR image
and
(Q ≪ P) is the under-sampled Q-dimensional k-space
measurements with much lower dimension. The undersamped Fourier
encoding matrix is denoted as
. By under-sampling k-space
measurements, the imaging can be significantly accelerated. The first
term is the data fidelity and second term a regularization. In this ob-
jective, ρ(x) encodes the prior information on the desired property of
the MRI. The optimization of the problem seeks to minimize the data
fidelity loss and regularization loss simultaneously. Conventionally, the
sparse priors are used to constrain the ill-posed problem like ℓ
1
norm [4], but recently, deep convolutional neural networks have been
utilized to address the problem [5, 6]. Wavelet sparsity and total var-
iation [1, 4] are common fixed-basis regularizers (ρ(x) in Eq. (1)). Some
adaptive-basis variants of wavelets [7] or dictionary learning techni-
ques [8, 9] are also used. Recently, deep neural networks have been
applied to undersampled MRI reconstruction [10], achieving state-of-
the-art performance in both quality and efficiency.
From the objective in Eq. (1), it is worth noting that all the pixels in
the MR image x are typically weighted equally, regardless of the spe-
cific tissues. In other words, conventional MRI reconstruction methods
lack the ability to provide better reconstruction quality a region of in-
terest (ROI). However, in real application scenarios, different tissues in
the same MRI represents different biological information, and in some
cases the needs to focus on certain tissues over others exists. For
https://doi.org/10.1016/j.mri.2019.07.010
Received 23 March 2019; Received in revised form 6 July 2019; Accepted 14 July 2019
Corresponding author.
E-mail address: dxh@xmu.edu.cn (X. Ding).
Magnetic Resonance Imaging 63 (2019) 185–192
0730-725X/ © 2019 Elsevier Inc. All rights reserved.
T