Zhai et al. / Front Inform Technol Electron Eng in press
Control of Two-wheel Self-balancing Robots Based on Gesture Recog-
nition
Jie-han LIU
1
, Lei CAO
2
, Chao-li WANG
1
(
1
Control science and Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China)
(
2
Ellectrical and Electronic Experiment Center, Henan University of Science and Technology, Luoyang 471023, China)
E-mail: 13564374538@126.com, Caoleis@163.com, clclwang@126.com
Received July. 6, 2015; Revision accepted July. 15, 2015; Crosschecked July 20, 2015
Abstract: Currently, wearable devices have been paid a great attention in lots of practical fields. This paper discusses the design
of two-wheel self-balancing robots based on gesture recognition. The objective is to control the robot's movement by using ges-
tures. Static gesture recognition without wearing data gloves is exploited to control the motion of the robot. The gesture recogni-
tion involves the calculation the distance between the user gesture and template gesture through Hu geometric features. The remote
terminal is the Two-wheel Self-balancing Robots. These are unstable and a class of special wheeled mobile robots which are
m1ulti-variable, nonlinear, strong coupling dynamic system, but it has the characteristics of small, simple, flexible movement. This
paper proposes a controller design of Two-wheel Self-balancing Robots, and the simulation results show the effectiveness of the
proposed method, which is verified also on the DSP platform at the same time.
Key words: Static gesture recognition, Hu geometric feature moment, Two-wheeled self-balancing robot, M1ulti-variable, Non-
linear, DSP
doi: Document code: A CLC number:
1 Introduction of the current situation
In 1993, B. Thomas et al proposed a method
through the data glove or paste special colors on hand
to identify the gestures by using the data glove or
paste special colors on hand. With the development of
computer technology, the research of gesture recog-
nition has largely focused on the recognition of bare
hands by means of a camera.
About the Two-wheel Self-balancing robots, in
1985, professor Kazuo Yamafuji of University of
Electro-Communications purposed an idea about one
kind of standing machines, and did the application for
the patent of "Parallel two-wheeled robot". With the
development of the Two-wheel Self-balancing robots,
in United States, Japan, Switzerland, France, have
been investigating the research in this area. In 2001,
American inventor Dean Kamen invented a new
two-wheel vehicle "Segway". Currently, a lot of
progress has been made for the Two-wheel
Self-balancing robots in China University of Tech-
nology, National Taiwan University, Beijing Institute
of Technology, Henan University of Science and
Technology.
In 2004, the company WowWee in the United
States launched a robot "MIP", which is controlled by
phone. And the company Shanghai New Century
Robot launched a robot "i-ROBOT", which is also
controlled by phone. And in this paper, the static
gesture is used to control the movement of the robot
without using phone, which is more flexible and it
could better integrate the experience of human beings.
About working in outdoor scenario, communi-
cation distance of this system can reach several ki-
Frontiers of Information Technology & Electronic Engineering
www.zju.edu.cn/jzus; engineering.cae.cn; www.springerlink.com
ISSN 2095-9184 (print); ISSN 2095-9230 (online)
E-mail: jzus@zju.edu.cn
‡
Corresponding author: Jiehan LIU and Chaoli WANG, 13564374538
@126.com; clclwang@126.com.
*
This paper is supported partly by The National Natural Science
Foundation (61374040), Scientific Innovation program (13ZZ115),
Hujiang Foundation of China (C14002), Graduate Innovation pro-
gram of Shanghai (54-13-302-102).