K-means Based Delay Quantization and Prediction in Networked
Control Systems
Yuan Ge, Shuang Cong
#
, and Weiwei Shang
Department of Automation, University of Science and Technology of China, Hefei, 230027, P. R. China
E-mail:
ygetoby@mail.ustc.edu.cn
, scong@ustc.edu.cn, wwshang@ustc.edu.cn
Abstract: In the networked control system (NCS) with the discrete-time hidden Markov model (DTHMM), K-means clustering
is proposed in this paper to quantize the controller-to-actuator (C-A) delays and to obtain the discrete observations for estimating
the DTHMM parameters. The prediction of the current stochastic C-A delay is achieved based on the quantizing method and the
estimated DTHMM. Then, by taking the current predicted C-A delay into account, a state-feedback controller is designed to
directly compensate for the effect of the current real C-A delay on the NCS. The detailed procedure of the K-means clustering
used to quantize the past C-A delays is given. The contrastive simulation experiments are implemented, and the results
demonstrate the superiority of the quantizing and predictive methods proposed in this paper.
Key Words:
Networked control system; discrete-time hidden Markov model; K-means clustering; delay quantization; delay
prediction
1. Introduction
Hidden Markov model (HMM) was first introduced to
networked control systems (NCSs) by Nilsson in [1]. Then,
the further application of the HMM in NCSs has been
investigated in [2-6]. The HMM was mainly used to model
the relation that the distribution of the network-induced
delays is usually probabilistically governed by the network
states. In this model, the hidden Markov chain consists of the
network states and the observations are the quantized results
from the network-induced delays. The HMM used in [1-6] is
actually a discrete-time HMM (DTHMM), which is a kind of
HMM with discrete states and discrete observations [7]. The
parameters of the DTHMM in [1-3] were all assumed to be
known in advance. In order to relax this unrealistic
assumption, some maximum likelihood estimation algorithms
(e.g., Baum-Welch, Expectation Maximization) were used in
[4-6] to estimate the DTHMM parameters. The main purpose
of the DTHMM parameter estimation in [5] is to statistically
predict the controller-to-actuator (C-A) delay in the current
sampling period (denoted as the current C-A delay). Then, the
predicted C-A delay was taken into account in the
state-feedback controller design and the effect of the real C-A
delay on the NCS was directly compensated in [6].
Generally, the estimation of the DTHMM parameters is
based on the discrete observations which are the inputs of this
model. In order to obtain the observations, the delay interval
in [4-6] was uniformly divided into several equal subintervals,
and then the delays were quantized into a discrete-time
sequence which served as the observations. This is so-called
uniform quantization of delays. However, in practical NCSs,
the delays do not always uniformly distribute over a time
interval. For example, the delay distribution has a lower mean
if the network has low load, and a higher mean if the network
This work is partially supported by the National Science Foundation of
China (61074050, 60843003, 50905172), the Science Foundation of Anhui
Province (090412071, 090412040), and the University of Science and
Technology of China Initiative Foundation.
#
Corresponding author
has a high load [1]. This is the reason why the precision of the
current C-A delay prediction based on the uniform
quantization is relatively lower [5-6]. Therefore, more
effective delay quantizing methods for the actual network
situation is much needed to improve the predictive precision,
which motivates this paper.
In this paper, K-means clustering is introduced to quantize
the past C-A delays. In NCSs, the delays are one-dimensional
data that stochastically distribute over a bounded interval.
When quantizing these delays, some relatively centralized
delays should be quantized as the same observation value
while those relatively decentralized delays should be
quantized into different observation values. Obviously, the
delay quantizing process is a clustering problem. As is known,
K-means is one of the efficient and most widely used
clustering algorithms [8] since it was first introduced by
MacQueen in 1967 [9]. So, K-means clustering can be used to
quantize the delays in NCSs. Then, the current stochastic C-A
delay can be predicted based on the quantizing method.
Compared with the uniform quantization, the K-means
clustering quantization gets closer to the real distribution of
the stochastic delays. As a result, the predictive precision
based on the K-means clustering quantization is higher than
that based on the uniform quantization. Moreover, the
state-feedback controller designed based on the prediction in
this paper can render the NCS better performance than that in
[6].
The remainder of this paper is organized as follows. In
Section 2, K-means clustering is proposed to quantize the
past C-A delays to get an observation sequence. In section 3,
the observation sequence is used as the input to estimate the
DTHMM parameters and the statistical prediction of the
current C-A delay is obtained. Section 3 presents the
contrastive simulation experiments to demonstrate the
superiority of the proposed quantizing and predictive
methods. Finally, the conclusions are given in Section 4.
3URFHHGLQJVRIWKHVW&KLQHVH&RQWURO&RQIHUHQFH
-XO\+HIHL&KLQD
5921