Back Propagation Neural Network
Based on Artificial Bee Colony Algorithm
Feihu Jin, Guang Shu
Department of Computing and Science, Harbin University of Science and Technology, Harbin China
fhjin88@163.com
Abstract—The artificial bee colony algorithm is a novel simulated
evolutionary algorithm. The artificial bee colony algorithm has
positive feedback, distributed computation and a constructive
greedy heuristic convergence. Back propagation is a kind of feed
forward neural network widely used in many areas, but it has
some shortcomings, such as low precision solutions, slow search
speed and easy convergence to the local minimum. The
combination of artificial bee colony algorithm and back
propagation neural network is adopted so that a nonlinear model
can be identified and an inverted pendulum can be controlled.
Simulation results show that the extensive mapping ability of
neural network and the rapid global convergence of artificial bee
colony algorithm can be obtained by combining artificial bee
colony algorithm and neural network.
Keywords; artificial bee colony; neural network; system
identification; inverted pendulum system
I. INTRODUCTION
The research on neural network is very active and has been
made considerable progress in recent years. Neural network
has complex nonlinear mapping ability, function
approximation and large-scale parallel distributed computing
ability. The most common application of neural network is
multilayer feed forward neural network model. Among them,
back propagation(BP) algorithm is widely used because of its
rigorous and high universality. Because the BP learning
algorithm is used with gradient descent algorithm, training
usually takes a long time to converge, and will inevitably
encounter the local minimum problem.
Artificial bee colony(ABC) algorithm is a novel simulated
evolutionary algorithm. The algorithm was firstly proposed by
Turkish scholar Karaboga[1]. ABC was successfully applied to
some practical problems, such as unconstrained numerical
optimization[2,3], constrained numerical optimization[4,5],
digital filter design[6], aircraft attitude control[7], and made a
series of good experimental results.
Artificial bee colony algorithm and neural network are
combined in this paper. The algorithm has the extensive
mapping ability of neural network and global convergence and
fast heuristic learning characteristics of artificial bee colony
algorithm, avoiding the slow convergence speed of neural
network and easy to fall into local minimum. This paper uses
artificial bee colony algorithm to learn the weights of neural
network, combining the two aspects to solve the nonlinear
model identification and the control of inverted pendulum.
II. T
HE PRINCIPLE OF ARTIFICIAL BEE COLONY
ALGORITHM
Bee colony can always easily found good nectar source.
German biologist Frisch found that the bees dance to
communicate the information of nectar source[8]. Employee
bee return beehive and dancing; the bees crawl along a straight
line, and then turn left, moving as figure eight and swinging
their belly, which is called the waggle dance. The angle
between the gravity direction and the centre axis of the dance is
exactly equal to the angle between the sun and food source.
The intelligent behavior of the dance consists of 3 basic parts:
employee bees, onlooker bees EF, scout bees UF. Three
behavior patterns are defined: the search for nectar, honey
recruitment and abandoning nectar.
dance area A
dance area B
nectar
source A
nectar
source B
hive
unloading
nectar A
unloading
nectar B
potetial
UF
EF1
S
S
EF1
EF2 UFEF1
EF2
R
R
EF1
EF2
EF2
EF1
UF
UF
EF1
S
S
Figure 1. The behaviour of honey bee searching for nectar
(1)Nectar source. Nectar represents the various possible
solutions: the nectar value depends on a variety of factors, such
as distance between honey and honeycomb, the amount of
concentration energy and the difficult level of getting energy.
Use the digital quantity "benefit" to measure the nectar source
characteristics.
(2)Onlooker Bees EF. Onlooker bees are contacted with
nectar which is they are working. Bees carry the specific source
information. The information includes the distance of nectar
source and honeycomb, the direction, the benefit of nectar.
978-1-4673-1773-3/12/$31.00 ©2013 IEEE