《模式识别第四版》学术专著：Elsevier出版

需积分: 10 31 浏览量更新于2024-07-22 1 收藏 13.23MB PDF 举报

《模式识别第四版》(Pattern Recognition 4th Edition)是由学术出版社Academic Press出版的一本权威教材，隶属于世界知名科学与技术出版机构Elsevier。该书汇集了最新的研究成果和技术进展，旨在向读者提供全面深入的模式识别理论和实践知识。这本书在全球设有多个印刷和发行中心，包括美国的Burlington和San Diego，以及英国的伦敦。它强调版权保护，所有内容未经Elsevier书面许可，不得以任何形式复制、传输，无论是电子方式还是机械手段，如影印、录音或通过任何信息存储和检索系统。版权方面，读者如果需要复制或授权使用书中的内容，可以直接联系Elsevier在英国牛津的科技权利部门，电话：(+44)1865843830，传真：(+44)1865853333，或者通过电子邮件permissions@elsevier.com进行申请。此外，网站上（http://elsevier.com）也提供了在线获取版权许可的便捷途径。《模式识别第四版》的出版符合国际版权法的规定，已在美国国会图书馆进行了馆藏记录，并在大英图书馆有相应的出版物记录。本书的国际标准书号(ISBN)为978-1-59749-272-0，这表明它是经过专业认证和标准化的学术著作。书中涵盖了广泛的主题，包括但不限于特征提取、分类算法、机器学习、图像处理、语音识别、生物识别等多个领域。读者可以借此书深入了解模式识别的基础理论、方法和应用实例，对于科研人员、工程师以及对人工智能、数据挖掘等领域感兴趣的学者来说，这本书是不可或缺的学习资料和参考资料。通过阅读和研究这本书，读者能够提升在模式识别领域的理论素养和实践经验。

“03-Ch01-SA272” 17/9/2008 page 2

2 CHAPTER 1 Introduction

the light-sensitive detector, light-intensity variation is translated into “numbers” and

an image array is formed. In the sequel,a series of image processing techniques are

applied leading to line and character segmentation. The pattern recognition soft-

ware then takes over to recognize the characters—that is, to classify each character

in the correct“letter, number, punctuation”class. Storing the recognized document

has a twofold advantage over storing its scanned image. First, further electronic

processing, if needed, is easy via a word processor, and second, it is much more

efﬁcient to store ASCII characters than a document image. Besides the printed

character recognition systems, there is a great deal of interest invested in systems

that recognize handwriting. A typical commercial application of such a system is

in the machine reading of bank checks. The machine must be able to recognize

the amounts in ﬁgures and digits and match them. Furthermore, it could check

whether the payee corresponds to the account to be credited. Even if only half of

the checks are manipulated cor rectly by such a machine, much labor can be saved

from a tedious job. Another application is in automatic mail-sorting machines for

postal code identiﬁcation in post ofﬁces. Online handwriting recognition systems

are another area of great commercial interest. Such systems will accompany pen

computers, with which the entry of data will be done not via the keyboard but by

writing. This complies with today’s tendency to develop machines and computers

with interfaces acquiring human-like skills.

Computer-aided diagnosis is another important application of pattern recogni-

tion, aiming at assisting doctors in making diagnostic decisions. The ﬁnal diagnosis

is, of course, made by the doctor. Computer-assisted diagnosis has been applied to

and is of interest for a variety of medical data,such as X-rays,computed tomographic

images, ultrasound images, electrocardiograms (ECGs), and electroencephalograms

(EEGs). The need for a computer-aided diagnosis stems from the fact that medi-

cal data are often not easily interpretable, and the interpretation can depend very

much on the skill of the doctor. Let us take for example X-ray mammography

for the detection of breast cancer. Although mammography is currently the best

method for detecting breast cancer, 10 to 30% of women who have the disease and

undergo mammography have negative mammograms. In approximately two thirds

of these cases with false results the radiologist failed to detect the cancer, which

was evident retrospectively. This may be due to poor image quality, eye fatigue

of the radiologist, or the subtle nature of the ﬁndings. The percentage of correct

classiﬁcations improves at a second reading by another radiologist. Thus, one can

aim to develop a pattern recognition system in order to assist radiologists with a

“second” opinion. Increasing conﬁdence in the diagnosis based on mammograms

would, in turn, decrease the number of patients with suspected breast cancer who

have to undergo surgical breast biopsy, with its associated complications.

Speech recognition is another area in which a great deal of research and devel-

opment effort has been invested. Speech is the most natural means by which

humans communicate and exchange information. Thus, the goal of building intelli-

gent machines that recognize spoken information has been a long-standing one for

scientists and engineers as well as science ﬁction writers. Potential applications of

such machines are numerous. They can be used, for example,to improve efﬁciency

“03-Ch01-SA272” 17/9/2008 page 3

1.1 Is Pattern Recognition Important? 3

in a manufacturing environment, to control machines in hazardous environments

remotely, and to help handicapped people to control machines by talking to them.

A major effort, which has already had considerable success, is to enter data into

a computer via a microphone. Software, built around a pattern (spoken sounds

in this case) recognition system, recognizes the spoken text and translates it into

ASCII characters,which are shown on the screen and can be stored in the memory.

Entering information by “talking” to a computer is twice as fast as entry by a skilled

typist. Furthermore, this can enhance our ability to communicate with deaf and

dumb people.

Data mining and knowledge discovery in databases is another key application

area of pattern recognition. Data mining is of intense interest in a wide range of

applications such as medicine and biology, market and ﬁnancial analysis, business

management, science exploration, image and music retrieval. Its popularity stems

from the fact that in the age of information and knowledge society there is an ever

increasing demand for retrieving information and turning it into knowledge. More-

over,this information exists in huge amounts of data in various forms including,text,

images, audio and video, stored in different places distributed all over the world.

The traditional way of searching information in databases was the description-based

model where object retrieval was based on keyword description and subsequent

word matching. However, this type of searching presupposes that a manual anno-

tation of the stored information has previously been performed by a human. This

is a very time-consuming job and, although feasible when the size of the stored

information is limited, it is not possible when the amount of the available informa-

tion becomes large. Moreover, the task of manual annotation becomes problematic

when the stored information is widely distributed and shared by a heterogeneous

“mixture”of sites and users. Content-based retrieval systems are becoming more and

more popular where information is sought based on “similarity”between an object,

which is presented into the system, and objects stored in sites all over the world.

In a content-based image retrieval CBIR (system) an image is presented to an input

device (e.g.,scanner). The system returns“similar”images based on a measured“sig-

nature,” which can encode, for example, information related to color, texture and

shape. In a music content-based retrieval system, an example (i.e., an extract from

a music piece), is presented to a microphone input device and the system returns

“similar” music pieces. In this case, similarity is based on certain (automatically)

measured cues that characterize a music piece, such as the music meter, the music

tempo, and the location of certain repeated patterns.

Mining for biomedical and DNA data analysis has enjoyed an explosive growth

since the mid-1990s. All DNA sequences comprise four basic building elements;

the nucleotides: adenine (A), cytosine (C), guanine (G) and thymine (T). Like the

letters in our alphabets and the seven notes in music, these four nucleotides are

combined to form long sequences in a twisted ladder form. Genes consist of,usually,

hundreds of nucleotides arranged in a particular order. Speciﬁc gene-sequence

patterns are related to particular diseases and play an important role in medicine.

To this end, pattern recognition is a key area that offers a wealth of developed tools

for similarity search and comparison between DNA sequences. Such comparisons

“03-Ch01-SA272” 17/9/2008 page 5

1.2 Features, Feature Vectors, and Classiﬁers 5

␮

␴

⫹

FIGURE 1.2

Plot of the mean value versus the standard deviation for a number of different images originating

from class A (



) and class B (⫹). In this case, a straight line separates the two classes.

with a number of patterns, some of which are known to originate from class A and

some from class B.

The ﬁrst step is to identify the measurable quantities that make these two regions

distinct from each other. Figure 1.2 shows a plot of the mean value of the inten-

sity in each region of interest versus the corresponding standard deviation around

this mean. Each point corresponds to a different image from the available database.

It turns out that class A patterns tend to spread in a different area from class B pat-

terns. The straight line seems to be a good candidate for separating the two classes.

Let us now assume that we are given a new image with a region in it and that we

do not know to which class it belongs. It is reasonable to say that we measure the

mean intensity and standard deviation in the region of interest and we plot the cor-

responding point. This is shown by the asterisk (∗) in Figure 1.2. Then it is sensible

to assume that the unknown pattern is more likely to belong to class A than class B.

The preceding artiﬁcial classiﬁcation task has outlined the rationale behind a

large class of pattern recognition problems. The measurements used for the classiﬁ-

cation,the mean value and the standard deviation in this case,are known as features.

In the more general case l features x

, i ⫽ 1, 2, ..., l, are used, and they form the

feature vector

x ⫽ [x

, x

, ..., x

]

where T denotes transposition. Each of the feature vectors identiﬁes uniquely

a single pattern (object). Throughout this book features and feature vectors will

be treated as random variables and vectors, respectively. This is natural, as the

measurements resulting from dif ferent patterns exhibit a random variation. This

is due partly to the measurement noise of the measuring devices and partly to

“03-Ch01-SA272” 17/9/2008 page 6

6 CHAPTER 1 Introduction

the distinct characteristics of each patter n. For example, in X-ray imaging large

variations are expected because of the differences in physiology among individuals.

This is the reason for the scattering of the points in each class shown in Figure 1.1.

The straight line in Figure 1.2 is known as the decision line, and it constitutes

the classiﬁer whose role is to divide the feature space into regions that correspond

to either class A or class B. If a feature vector x, corresponding to an unknown

pattern, falls in the class A region, it is classiﬁed as class A, otherwise as class B.

This does not necessarily mean that the decision is correct. If it is not correct,

a misclassiﬁcation has occurred. In order to draw the straight line in Figure 1.2

we exploited the fact that we knew the labels (class A or B) for each point of

the ﬁgure. The patterns (feature vectors) whose true class is known and which

are used for the design of the classiﬁer are known as training patterns (training

feature vectors).

Having outlined the deﬁnitions and the rationale, let us point out the basic

questions arising in a classiﬁcation task.

■ How are the features generated? In the preceding example, we used the

mean and the standard deviation,because we knew how the images had been

generated. In practice,this is far from obvious. It is problem dependent,and it

concerns the feature generation stage of the design of a classiﬁcation system

that performs a given pattern recognition task.

■ What is the best number l of features to use? This is also a very important

task and it concerns the feature selection stage of the classiﬁcation system.

In practice,a larger than necessary number of feature candidates is generated,

and then the “best” of them is adopted.

■ Having adopted the appropriate, for the speciﬁc task, features, how does one

design the classiﬁer? In the preceding example the straight line was drawn

empirically, just to please the eye. In practice, this cannot be the case, and

the line should be drawn optimally, with respect to an optimality criterion.

Furthermore,problems for which a linear classiﬁer (straight line or hyperplane

in the l-dimensional space) can result in acceptable performance are not the

rule. In general, the surfaces dividing the space in the various class regions

are nonlinear. What type of nonlinearity must one adopt, and what type of

optimizing criterion must be used in order to locate a surface in the right place

in the l-dimensional feature space? These questions concern the classiﬁer

design stage.

■ Finally, once the classiﬁer has been designed, how can one assess the perfor-

mance of the designed classiﬁer? That is,what is the classiﬁcation error rate?

This is the task of the system evaluation stage.

Figure 1.3 shows the various stages followed for the design of a classiﬁcation

system. As is apparent from the feedback arrows, these stages are not independent.

On the contrary,they are interrelated and,depending on the results,one may go back

剩余966页未读，继续阅读

qq_28571955

粉丝: 0
资源: 1

《模式识别第四版》学术专著：Elsevier出版

Pattern Recognition 4th Edition.pdf

Pattern Recognition

Pattern Recognition (Fourth Edition) by Sergios Theodoridis 高清pdf_part01

Pattern Recognition 4th Edition模式识别第四版 MATLAB demo以及说明

模式识别权威指南：Pattern Recognition 4th Edition

pattern recognition 4th edition matlab

Pattern Recognition (Fourth Edition) by Sergios Theodoridis 高清pdf_part02

Pattern+Recognition+4th+Edition模式识别第四版_patternrecognition_模式识别_源

Pattern Recognition and Machine Learning 课后习题完整答案

模式识别 Pattern Recognition 英文版 第四版 By Sergios Theodoridis

最新资源

模式识别 Pattern Recognition 英文版第四版 By Sergios Theodoridis