2009版经典《模式识别》(Theodoridis & Koutroumbas)教程

5星 · 超过95%的资源需积分: 10 193 浏览量更新于2024-08-01 1 收藏 13.12MB PDF 举报

《模式识别(第4版)》是Theodoridis S. 和Koutroumbas K. 合著的一本经典教材，由学术出版社(Academic Press)作为Elsevier的分支出版。该书于2009年发行，标志着在模式识别领域的最新研究成果与理论探讨。作为第四版，它不仅包含了丰富的理论知识，还涵盖了当时的前沿技术和实践应用，适合对机器学习、计算机视觉、生物信息学等领域有深入研究的学生和专业人士。本书的出版地包括美国的波士顿和加利福尼亚州圣地亚哥，以及英国伦敦的地址，强调了其国际化的视角。作者们确保了印刷材料的质量，使用的是酸性纸张，旨在提供长期保存的耐久性。版权方面，所有权利归Elsevier Inc. 所有，未经书面许可，任何形式的复制或传播，无论是电子还是机械，如影印、录音或任何信息存储和检索系统，均需得到出版商的明确授权。读者如果需要获取权限，可以直接联系位于英国牛津的Elsevier Science & Technology Rights Department，或者通过他们的网站进行在线申请。此书已在图书馆编目，已向美国国会图书馆提交了馆藏记录，并且在英国图书馆也备有索引，方便读者查找。本书的国际标准书号(ISBN)为978-1-59749-272-0，这表明了它的唯一性和出版识别码。《模式识别(第4版)》涵盖了广泛的主题，包括特征选择、分类算法（如SVM、决策树、神经网络）、图像处理技术、统计模型、深度学习等。它不仅提供了理论基础，还通过实例和案例研究展示了如何在实际场景中应用这些理论，帮助读者理解和掌握模式识别的核心概念和实践技巧。对于想要在这个领域深入探索或从事相关工作的读者来说，这是一本不可或缺的参考书籍。

“03-Ch01-SA272” 17/9/2008 page 2

2 CHAPTER 1 Introduction

the light-sensitive detector, light-intensity variation is translated into “numbers” and

an image array is formed. In the sequel,a series of image processing techniques are

applied leading to line and character segmentation. The pattern recognition soft-

ware then takes over to recognize the characters—that is, to classify each character

in the correct“letter, number, punctuation”class. Storing the recognized document

has a twofold advantage over storing its scanned image. First, further electronic

processing, if needed, is easy via a word processor, and second, it is much more

efﬁcient to store ASCII characters than a document image. Besides the printed

character recognition systems, there is a great deal of interest invested in systems

that recognize handwriting. A typical commercial application of such a system is

in the machine reading of bank checks. The machine must be able to recognize

the amounts in ﬁgures and digits and match them. Furthermore, it could check

whether the payee corresponds to the account to be credited. Even if only half of

the checks are manipulated cor rectly by such a machine, much labor can be saved

from a tedious job. Another application is in automatic mail-sorting machines for

postal code identiﬁcation in post ofﬁces. Online handwriting recognition systems

are another area of great commercial interest. Such systems will accompany pen

computers, with which the entry of data will be done not via the keyboard but by

writing. This complies with today’s tendency to develop machines and computers

with interfaces acquiring human-like skills.

Computer-aided diagnosis is another important application of pattern recogni-

tion, aiming at assisting doctors in making diagnostic decisions. The ﬁnal diagnosis

is, of course, made by the doctor. Computer-assisted diagnosis has been applied to

and is of interest for a variety of medical data,such as X-rays,computed tomographic

images, ultrasound images, electrocardiograms (ECGs), and electroencephalograms

(EEGs). The need for a computer-aided diagnosis stems from the fact that medi-

cal data are often not easily interpretable, and the interpretation can depend very

much on the skill of the doctor. Let us take for example X-ray mammography

for the detection of breast cancer. Although mammography is currently the best

method for detecting breast cancer, 10 to 30% of women who have the disease and

undergo mammography have negative mammograms. In approximately two thirds

of these cases with false results the radiologist failed to detect the cancer, which

was evident retrospectively. This may be due to poor image quality, eye fatigue

of the radiologist, or the subtle nature of the ﬁndings. The percentage of correct

classiﬁcations improves at a second reading by another radiologist. Thus, one can

aim to develop a pattern recognition system in order to assist radiologists with a

“second” opinion. Increasing conﬁdence in the diagnosis based on mammograms

would, in turn, decrease the number of patients with suspected breast cancer who

have to undergo surgical breast biopsy, with its associated complications.

Speech recognition is another area in which a great deal of research and devel-

opment effort has been invested. Speech is the most natural means by which

humans communicate and exchange information. Thus, the goal of building intelli-

gent machines that recognize spoken information has been a long-standing one for

scientists and engineers as well as science ﬁction writers. Potential applications of

such machines are numerous. They can be used, for example,to improve efﬁciency

“03-Ch01-SA272” 17/9/2008 page 3

1.1 Is Pattern Recognition Important? 3

in a manufacturing environment, to control machines in hazardous environments

remotely, and to help handicapped people to control machines by talking to them.

A major effort, which has already had considerable success, is to enter data into

a computer via a microphone. Software, built around a pattern (spoken sounds

in this case) recognition system, recognizes the spoken text and translates it into

ASCII characters,which are shown on the screen and can be stored in the memory.

Entering information by “talking” to a computer is twice as fast as entry by a skilled

typist. Furthermore, this can enhance our ability to communicate with deaf and

dumb people.

Data mining and knowledge discovery in databases is another key application

area of pattern recognition. Data mining is of intense interest in a wide range of

applications such as medicine and biology, market and ﬁnancial analysis, business

management, science exploration, image and music retrieval. Its popularity stems

from the fact that in the age of information and knowledge society there is an ever

increasing demand for retrieving information and turning it into knowledge. More-

over,this information exists in huge amounts of data in various forms including,text,

images, audio and video, stored in different places distributed all over the world.

The traditional way of searching information in databases was the description-based

model where object retrieval was based on keyword description and subsequent

word matching. However, this type of searching presupposes that a manual anno-

tation of the stored information has previously been performed by a human. This

is a very time-consuming job and, although feasible when the size of the stored

information is limited, it is not possible when the amount of the available informa-

tion becomes large. Moreover, the task of manual annotation becomes problematic

when the stored information is widely distributed and shared by a heterogeneous

“mixture”of sites and users. Content-based retrieval systems are becoming more and

more popular where information is sought based on “similarity”between an object,

which is presented into the system, and objects stored in sites all over the world.

In a content-based image retrieval CBIR (system) an image is presented to an input

device (e.g.,scanner). The system returns“similar”images based on a measured“sig-

nature,” which can encode, for example, information related to color, texture and

shape. In a music content-based retrieval system, an example (i.e., an extract from

a music piece), is presented to a microphone input device and the system returns

“similar” music pieces. In this case, similarity is based on certain (automatically)

measured cues that characterize a music piece, such as the music meter, the music

tempo, and the location of certain repeated patterns.

Mining for biomedical and DNA data analysis has enjoyed an explosive growth

since the mid-1990s. All DNA sequences comprise four basic building elements;

the nucleotides: adenine (A), cytosine (C), guanine (G) and thymine (T). Like the

letters in our alphabets and the seven notes in music, these four nucleotides are

combined to form long sequences in a twisted ladder form. Genes consist of,usually,

hundreds of nucleotides arranged in a particular order. Speciﬁc gene-sequence

patterns are related to particular diseases and play an important role in medicine.

To this end, pattern recognition is a key area that offers a wealth of developed tools

for similarity search and comparison between DNA sequences. Such comparisons

“03-Ch01-SA272” 17/9/2008 page 5

1.2 Features, Feature Vectors, and Classiﬁers 5

␮

␴

⫹

FIGURE 1.2

Plot of the mean value versus the standard deviation for a number of different images originating

from class A (



) and class B (⫹). In this case, a straight line separates the two classes.

with a number of patterns, some of which are known to originate from class A and

some from class B.

The ﬁrst step is to identify the measurable quantities that make these two regions

distinct from each other. Figure 1.2 shows a plot of the mean value of the inten-

sity in each region of interest versus the corresponding standard deviation around

this mean. Each point corresponds to a different image from the available database.

It turns out that class A patterns tend to spread in a different area from class B pat-

terns. The straight line seems to be a good candidate for separating the two classes.

Let us now assume that we are given a new image with a region in it and that we

do not know to which class it belongs. It is reasonable to say that we measure the

mean intensity and standard deviation in the region of interest and we plot the cor-

responding point. This is shown by the asterisk (∗) in Figure 1.2. Then it is sensible

to assume that the unknown pattern is more likely to belong to class A than class B.

The preceding artiﬁcial classiﬁcation task has outlined the rationale behind a

large class of pattern recognition problems. The measurements used for the classiﬁ-

cation,the mean value and the standard deviation in this case,are known as features.

In the more general case l features x

, i ⫽ 1, 2, ..., l, are used, and they form the

feature vector

x ⫽ [x

, x

, ..., x

]

where T denotes transposition. Each of the feature vectors identiﬁes uniquely

a single pattern (object). Throughout this book features and feature vectors will

be treated as random variables and vectors, respectively. This is natural, as the

measurements resulting from dif ferent patterns exhibit a random variation. This

is due partly to the measurement noise of the measuring devices and partly to

“03-Ch01-SA272” 17/9/2008 page 6

6 CHAPTER 1 Introduction

the distinct characteristics of each patter n. For example, in X-ray imaging large

variations are expected because of the differences in physiology among individuals.

This is the reason for the scattering of the points in each class shown in Figure 1.1.

The straight line in Figure 1.2 is known as the decision line, and it constitutes

the classiﬁer whose role is to divide the feature space into regions that correspond

to either class A or class B. If a feature vector x, corresponding to an unknown

pattern, falls in the class A region, it is classiﬁed as class A, otherwise as class B.

This does not necessarily mean that the decision is correct. If it is not correct,

a misclassiﬁcation has occurred. In order to draw the straight line in Figure 1.2

we exploited the fact that we knew the labels (class A or B) for each point of

the ﬁgure. The patterns (feature vectors) whose true class is known and which

are used for the design of the classiﬁer are known as training patterns (training

feature vectors).

Having outlined the deﬁnitions and the rationale, let us point out the basic

questions arising in a classiﬁcation task.

■ How are the features generated? In the preceding example, we used the

mean and the standard deviation,because we knew how the images had been

generated. In practice,this is far from obvious. It is problem dependent,and it

concerns the feature generation stage of the design of a classiﬁcation system

that performs a given pattern recognition task.

■ What is the best number l of features to use? This is also a very important

task and it concerns the feature selection stage of the classiﬁcation system.

In practice,a larger than necessary number of feature candidates is generated,

and then the “best” of them is adopted.

■ Having adopted the appropriate, for the speciﬁc task, features, how does one

design the classiﬁer? In the preceding example the straight line was drawn

empirically, just to please the eye. In practice, this cannot be the case, and

the line should be drawn optimally, with respect to an optimality criterion.

Furthermore,problems for which a linear classiﬁer (straight line or hyperplane

in the l-dimensional space) can result in acceptable performance are not the

rule. In general, the surfaces dividing the space in the various class regions

are nonlinear. What type of nonlinearity must one adopt, and what type of

optimizing criterion must be used in order to locate a surface in the right place

in the l-dimensional feature space? These questions concern the classiﬁer

design stage.

■ Finally, once the classiﬁer has been designed, how can one assess the perfor-

mance of the designed classiﬁer? That is,what is the classiﬁcation error rate?

This is the task of the system evaluation stage.

Figure 1.3 shows the various stages followed for the design of a classiﬁcation

system. As is apparent from the feedback arrows, these stages are not independent.

On the contrary,they are interrelated and,depending on the results,one may go back

剩余966页未读，继续阅读

w9351052329

粉丝: 0
资源: 5

2009版经典《模式识别》(Theodoridis & Koutroumbas)教程

Pattern Recognition (Fourth Edition) by Sergios Theodoridis 高清pdf_part01

Theodoridis S., Koutroumbas K. Pattern Recognition.3rd.ed.(AP, 2006)(840s).pdf.Part1

Theodoridis S., Koutroumbas K. Pattern Recognition.3rd.ed.(AP, 2006)(840s).pdf.Part2

Pattern Recognition 4th Edition.pdf

Statistical Pattern Recognition (2nd Ed.)

基于统计的模式识别英文原版书 Statistical Pattern Recognition (2nd Ed.)

Fukunaga K. Introduction to statistical pattern recognition 2ed.,

Pattern Recognition and Machine Learning.rar

pattern recognition and machine learning.pdf

Pattern Recognition and Machine Learning.pdf

最新资源