Structure Tensor-Based WLS Filter for Adaptive
Smoothing
Zhendong Zhang and Cheolkon Jung
School of Electronic Engineering, Xidian University, Xi’an 710071, China
zhengzk@xidian.edu.cn
Abstract—The weighted least s
quares (WLS) filter is a well-
known edge preserving smoothing technique, but its weights
highly depend on the image gradients. Thus, it is hard to
smooth local textures with large gradients by WLS filter. In
this paper, we propose a structure tensor-based WLS (ST-
WLS) filter to enhance the smoothing ability of WLS filter
while successfully keeping object boundaries. We introduce
structure tensor into WLS filter to extract local structures in
an image and use them to guide the smoothing process.
Specifically, we use structure tensor to measure isotropy of
pixels. Then, we calculate the smoothing weights for pixels
based on both their isotropy and gradients. Experimental
results demonstrate that ST-WLS filter has strong ability of
smoothing textures, especially for isotropic textures, while
preserving boundaries and structures of objects.
Index Terms
—
Adaptive smoothing, isotropic textures,
structure tensor, structure preserving, WLS filter.
I.
I
NTRODUCTION
Many applications in computer vision need adaptive
smoothing filters to suppress or extract content of images.
Up to the present, many outstanding results in adaptive
smoothing have been achieved by researchers [1]-[11]. They
are classified into two main groups. The first group, called
edge-preserving filter, aims at smoothing images while
preserving their edges, e.g. anisotropic diffusion filter [1],
total variation-based filter [2], bilateral filter [3, 4], WLS
filter [5], L
0
smoothing filter [6], and guided image filter
[7]. These filters often use gradient magnitudes of images as
an edge indicator. Due to their local contrast-based edge
definition, these filters are hard to extract textures from the
main structures. The second group of adaptive smoothing
filters, called structure-preserving filter, aims at extracting
textures from structures. This group has been popularly
investigated in recent years [8-11]. These filters commonly
use local descriptors as a structure indicator, e.g. local
histogram [8], local extrema [9], relative total variation [10]
and region covariance [11]. Although these two kinds of
filters aim at solving different problems, there is no absolute
boundary to classify them. Structure-preserving filters are
effective in preserving edges of an image because edges are
regarded as parts of structures, i.e. according to the
definition of edges and structures, while edge-preserving
filters smooth textures whose gradients are small. WLS
filter achieves smoothing in an image by finding the
minimum of weighted square errors using a global
optimization model, and its weights for smoothing only
depend on the image gradients. In this paper, we propose
ST-WLS filter for adaptive smoothing. ST-WLS filter is
based on WLS filter, but different from WLS filter because
we assume that edges are regarded as a set of pixels with
both strong anisotropy and large gradients. That is, we
compute smoothing weights for ST-WLS filter using both
gradients and anisotropy of pixels which is measured by
structure tensor. If a pixel has strong anisotropy and large
gradient, its smoothing weight becomes small, and vice
versa. Experimental results demonstrate that ST-WLS filter
has a strong smoothing ability of local textures, especially
for isotropic textures, than WLS filter, while keeping its
boundary-preserving property.
II.
WLS
F
ILTER
Given an in
put image g, WLS filter seek a new image u,
which is close to g, while smoothing the whole image
except for pixels with large gradients in g. It finds the
minimum of the following equation:
2
2
2
( ) () ()
xy
p
uu
ug ag ag
xy
λ
∂∂
−+ +
∂∂
(1)
where the subscript p denotes the location of a pixel. The
first term minimizes the difference between u and g. The
second term achieves smoothness by minimizing the partial
derivatives of u.
λ
is a parameter which controls the balance
between two terms. a
x
and a
y
are spatially varying weights
for smoothing which depend on g. The larger the gradient is,
the smaller a
x
and a
y
are. We compute a
x
and a
y
as follows:
1
,xp
p
l
a
x
α
ε
−
∂
=+
∂
1
y, p
p
l
a
y
α
ε
−
∂
=+
∂
(2)
where l is the log-luminance channel of g; the exponent α
(typically between 1.2 and 2) determines the sensitivity to
the gradients of g; ε (typically 0.0001) is a small constant
that prevents division by zero in the constant areas of g.
III.
S
TRUCTURE
T
ENSOR
Structure tens
or is a tensor that extracts structural
information at a pixel. It has been commonly applied to
image and video processing [12], [13]. We obtain structure
tensor using spatial information for simplicity.
978-1-5090-5316-2/16/$31.00 ©2016 IEEE VCIP 2016, Nov. 27 - 30, 2016, Chengdu, China