DCT-Based Channel Estimator for OFDM Systems:
Threshold Setting and Leakage Estimation
Xin Xiong, Bin Jiang, Xiqi Gao, and Xiaohu You
National Mobile Communications Research Laboratory, Southeast University, Nanjing 210096, P. R. China
Email: {xinxiong, bjiang, xqgao, xhyu}@seu.edu.cn
Abstract—This paper addresses the problem of the discrete
cosine transform (DCT)-based channel estimator for orthogonal
frequency-division multiplexing (OFDM) systems in the presence
of virtual subcarriers. We focus on the following two problems.
The first issue is the threshold setting. Traditional methods to
set the threshold are reasonable but based on heuristics. We
propose a new threshold based on the analytical expression of
the channel impulse response (CIR) in the DCT domain. The
second issue is the leakage estimation for DCT-based channel
estimators. Recently, we have proposed the leakage estimation for
discrete Fourier transform (DFT)-based channel estimators. It is
well known that there is the channel leakage in the high frequency
region of the DCT domain, and the leakage causes the error floor.
In order to eliminate the error floor, we propose to estimate the
leakage in the high frequency region. Simulation results show that
the DCT-based channel estimator with the proposed threshold
achieves better performance and the error floor is mitigated after
leakage estimation.
I. INTRODUCTION
The orthogonal frequency-division multiplexing (OFDM)
technique has attracted much attention due to its robustness
against frequency-selective fading channels and easiness to
employ the multiple antenna techniques. The OFDM technique
has been employed by commercial systems such as long term
evolution (LTE) and wireless local area networks (WLAN)
due to its simple implementation. For coherent receivers, ac-
curate channel estimation can significantly improve the system
performance, especially when the system uses the high-order
modulation. The commercial system adopts the pilot-aided
channel estimation as a result of reliability and simplicity.
Among pilot-aided channel estimators, the discrete cosine
transform (DCT)-based channel estimators have been exten-
sively studied over the past decade [1]–[5]. For the first
time, the DCT-based channel estimator was suggested in
[1]. Due to its energy compaction property, the DCT-based
channel estimator generally outperforms the discrete Fourier
transform (DFT)-based channel estimator. The authors in [2]
proposed an improved scheme using truncated singular value
decomposition for DCT-based methods. In [3] and [4], the
DCT-based channel estimator was suggested for cyclically
shifted reference signals. In [3], the channel response of each
user was completely separated by the type-I DCT. The authors
compared the DCT-based channel estimator and DFT-based
channel estimator for the LTE uplink in [4].
In this paper, we focus on two problems. The first issue is
the threshold setting. Since the DCT-based channel estimator
was proposed, much literature has addressed the issue on
threshold. The existing thresholds are reasonable but based
on heuristics. Until now, the theoretical analysis on threshold
is not sufficient, and some parameters are determined by
experience. In order to solve this problem, we derive the
precise expression of the channel impulse response (CIR)
in the DCT domain. Based on the expression, we propose
a threshold which is easy to set. The second issue is the
leakage estimation. The CIR energy in the high frequency
region of the DCT domain is small but nonzero. For threshold-
based methods, the leaked energy in the high frequency region
is removed while reducing noise. The removed energy will
cause the error floor which appears in the high signal-to-noise
ratio (SNR) region. Recently, we have proposed to estimate
the channel leakage for DFT-based channel estimators in [6].
In the similar way, the leakage can be estimated by using
the partial minimum mean-square-error (MMSE) filtering for
DCT-based channel estimators. After leakage estimation, the
error floor will not exhibit in the SNR region of interest.
This paper is organized as follows. Section II describes the
channel model and the system model. The DCT-based channel
estimators and all kinds of thresholds are presented in Section
III. Section IV introduces the leakage estimation for DCT-
based channel estimators. The simulations are analyzed in
Section V. Finally, the conclusion is drawn in Section VI.
Notations: Matrices are denoted by upper case boldface
(e.g. X), and vectors are denoted by lower case boldface
(e.g. x). An N × N identity matrix is expressed as I
N
.
The superscripts T and H denote transpose and conjugate
transpose, respectively. [A]
ij
represents the (i, j)-th element of
the matrix A. x indicates rounding x to the nearest integer
that is greater than or equal to x. |x| denotes the absolute
value of x. We reserve E{·} for expectation with respect to all
random variables within the brackets, diag{x} for a diagonal
matrix with the elements of the vector x on its main diagonal,
and blkdiag {X
1
, X
2
, ..., X
N
} for a block diagonal matrix with
matrices X
1
,..., X
N
on its main diagonal.
II. S
YSTEM DESCRIPTION
A. Channel Model
A time-varying multipath channel model composed of L
impulses is given by
h(t; τ )=
L−1
m=0
α
m
(t)δ(τ − τ
m
(t)T
s
), (1)
978-1-4799-0308-5/13/$31.00 © 2013 IEEE