概率论与随机过程在电气和计算机工程中的应用

需积分: 9 17 浏览量更新于2024-07-25 收藏 4.96MB PDF 举报

"probability for electrical engineering" 本书是一本针对电气与计算机工程师的专业概率论与随机过程教材，特别适合分析通信系统中的错误出现概率。该书在高级本科阶段开始讲解，假设读者具备基本的概率知识，并逐步深入到研究生阶段所掌握的更复杂主题。全书分为两大部分，前五章基础篇主要介绍了概率论的基础知识以及离散和连续随机变量的概念。在基础篇中，读者将学习到概率的基本概念，如事件的概率、条件概率、独立事件、概率分布（二项分布、泊松分布、均匀分布、正态分布等）以及大数定律和中心极限定理。对于离散随机变量，书中会涵盖期望值、方差、联合分布、边缘分布和条件分布等内容。而对于连续随机变量，则会讲解概率密度函数、累积分布函数以及它们的性质。进入进阶篇，作者探讨了随机向量、高斯随机向量（即正态分布的随机向量），这些在信号处理和通信中至关重要。随机过程是另一个重点，包括平稳过程、马尔可夫链和收敛性理论。马尔可夫链尤其在状态预测和网络流量分析中有着广泛的应用。此外，书中还涵盖了随机过程的功率谱密度和自相关函数，这些都是理解通信系统噪声和干扰的关键工具。为了确保学习效果，书中提供了超过300个详尽的示例，近800个课后练习题，以及专门的考试准备部分，使得这本书不仅适合学生作为教材使用，也适合作为研究人员的参考书籍。无论是在通信工程、信号处理还是计算机网络流量分析等领域，都能找到实用的工具和结果。 "Probability and Random Processes for Electrical and Computer Engineers" 是一本全面介绍概率论及其在电气和计算机工程应用的权威教材。它将帮助学生和专业工程师建立起对随机现象的深刻理解，并能有效地应用于实际工程问题中。

2 Introduction to probability

−1

0.5

Figure 1.2. Matched ﬁlter input (top) in which the signal is hidden by noise. Matched ﬁlter output (bottom) in

which the signal presence is obvious.

Optical communication systems. Optical communication systems use photodetectors

(see Figure 1.3) to interface between optical and electronic subsystems. When these sys-

detector

photo−

photoelectrons

light

Figure 1.3. Block diagram of a photodetector. The rate at which photoelectrons are produced is proportional to

the intensity of the light.

tems are at the limits of their operating capabilities, the number of photoelectrons produced

by the photodetector is well-modeled by the Poisson

random variable you will study in

Chapter 2 (see also the Poisson process in Chapter 11). In deciding whether a transmitted

bit is a zero or a one, the receiver counts the number of photoelectrons and compares it

to a threshold. System performance is determined by computing the probability that the

threshold is exceeded.

Wireless communication systems. In order to enhance weak signals and maximize the

range of communication systems, it is necessary to use ampliﬁers. Unfortunately, ampliﬁers

always generate thermal noise, which is added to the desired signal. As a consequence of the

underlying physics, the noise is Gaussian. Hence, the Gaussian density function, which you

will meet in Chapter 4, plays a prominent role in the analysis and design of communication

systems. When noncoherent receivers are used, e.g., noncoherent frequency shift keying,

Many important quantities in probability and statistics are named after famous mathematicians and

statisticians. You can use an Internet search engine to ﬁnd pictures and biographies of them on

the web. At the time of this writing, numerous biographies of famous mathematicians and statisti-

cians can be found at http://turnbull.mcs.st-and.ac.uk/history/BiogIndex.html and at

http://www.york.ac.uk/depts/maths/histstat/people/welcome.htm. Pictures on stamps

and currency can be found at http://jeff560.tripod.com/.

Relative frequency 3

this naturally leads to the Rayleigh, chi-squared, noncentral chi-squared, and Rice density

functions that you will meet in the problems in Chapters 4, 5, 7, and 9.

Variability in electronic circuits. Although circuit manufacturing processes attempt to

ensure that all items have nominal parameter values, there is always some variation among

items. How can we estimate the average values in a batch of items without testing all of

them? How good is our estimate? You will learn how to do this in Chapter 6 when you

study parameter estimation and conﬁdence intervals. Incidentally, the same concepts apply

to the prediction of presidential elections by surveying only a few voters.

Computer network trafﬁc. Prior to the 1990s, network analysis and design was carried

out using long-established Markovian models [41, p. 1]. You will study Markov chains

in Chapter 12. As self similarity was observed in the trafﬁc of local-area networks [35],

wide-area networks [43], and in World Wide Web trafﬁc [13], a great research effort began

to examine the impact of self similarity on network analysis and design. This research has

yielded some surprising insights into questions about buffer size vs. bandwidth, multiple-

time-scale congestion control, connection duration prediction, and other issues [41, pp. 9–

11]. In Chapter 15 you will be introduced to self similarity and related concepts.

In spite of the foregoing applications, probability was not originally developed to handle

problems in electrical and computer engineering. The ﬁrst applications of probability were

to questions about gambling posed to Pascal in 1654 by the Chevalier de Mere. Later,

probability theory was applied to the determination of life expectancies and life-insurance

premiums, the theory of measurement errors, and to statistical mechanics. Today, the theory

of probability and statistics is used in many other ﬁelds, such as economics, ﬁnance, medical

treatment and drug studies, manufacturing quality control, public opinion surveys, etc.

Relative frequency

Consider an experiment that can result in M possible outcomes, O

,...,O

.Forex-

ample, in tossing a die, one of the six sides will land facing up. We could let O

denote

the outcome that the ith side faces up, i = 1,...,6. Alternatively, we might have a computer

with six processors, and O

could denote the outcome that a program or thread is assigned to

the ith processor. As another example, there are M = 52 possible outcomes if we draw one

card from a deck of playing cards. Similarly, there are M = 52 outcomes if we ask which

week during the next year the stock market will go up the most. The simplest example we

consider is the ﬂipping of a coin. In this case there are two possible outcomes, “heads” and

“tails.” Similarly, there are two outcomes when we ask whether or not a bit was correctly

received over a digital communication system. No matter what the experiment, suppose

we perform it n times and make a note of how many times each outcome occurred. Each

performance of the experiment is called a trial.

Let N

) denote the number of times O

occurred in n trials. The relative frequency of outcome O

)

is the fraction of times O

occurred.

When there are only two outcomes, the repeated experiments are called Bernoulli trials.

What is probability theory? 5

1000

)+N

1000

)+N

1000

)=76

1000

)+N

1000

)+N

1000

)=21

1000

)+N

1000

)+N

1000

)=9

1000

)+N

1000

)+N

1000

)=1.

This summary is illustrated in the histogram shown in Figure 1.4. (The bars are centered

over values of the form k/100; e.g., the bar of height 230 is centered over 0.49.)

0.3 0.4 0.5 0.6 0.7

100

150

200

250

Figure 1.4. Histogram of Example 1.2 with overlay of a Gaussian density.

Below we give an indication of why most of the time the relative frequency of heads is

close to one half and why the bell-shaped curve ﬁts so well over the histogram. For now

we point out that the foregoing methods allow us to determine the bit-error rate of a digital

communication system, whether it is a wireless phone or a cable modem connection. In

principle, we simply send a large number of bits over the channel and ﬁnd out what fraction

were received incorrectly. This gives an estimate of the bit-error rate. To see how good an

estimate it is, we repeat the procedure many times and make a histogram of our estimates.

What is probability theory?

Axiomatic probability theory, which is the subject of this book, was developed by A.

N. Kolmogorov

in 1933. This theory speciﬁes a set of axioms for a well-deﬁned math-

ematical model of physical experiments whose outcomes exhibit random variability each

time they are performed. The advantage of using a model rather than performing an exper-

iment itself is that it is usually much more efﬁcient in terms of time and money to analyze

a mathematical model. This is a sensible approach only if the model correctly predicts the

behavior of actual experiments. This is indeed the case for Kolmogorov’s theory.

A simple prediction of Kolmogorov’s theory arises in the mathematical model for the

relative frequency of heads in n tosses of a fair coin that we considered in Example 1.1. In

the model of this experiment, the relative frequency converges to 1/2asn tends to inﬁnity;

The website http://kolmogorov.com/ is devoted to Kolmogorov.

6 Introduction to probability

this is a special case of the the strong law of large numbers, which is derived in Chapter 14.

(A related result, known as the weak law of large numbers, is derived in Chapter 3.)

Another prediction of Kolmogorov’s theory arises in modeling the situation in Exam-

ple 1.2. The theory explains why the histogram in Figure 1.4 agrees with the bell-shaped

curve overlaying it. In the model, the strong law tells us that for each k, the relative fre-

quency of having exactly k heads in 100 tosses should be close to

100!

k!(100 −k)!

100

Then, by the central limit theorem, which is derived in Chapter 5, the above expression is

approximately equal to (see Example 5.19)

√

exp



−



k −50





(You should convince yourself that the graph of e

−x

is indeed a bell-shaped curve.)

Because Kolmogorov’s theory makes predictions that agree with physical experiments,

it has enjoyed great success in the analysis and design of real-world systems.

1.1 Sample spaces, outcomes, and events

Sample spaces

To model systems that yield uncertain or random measurements, we let Ω denote the

set of all possible distinct, indecomposable measurements that could be observed. The set

Ω is called the sample space. Here are some examples corresponding to the applications

discussed at the beginning of the chapter.

Signal processing. In a radar system, the voltage of a noise waveform at time t can be

viewed as possibly being any real number. The ﬁrst step in modeling such a noise voltage

is to consider the sample space consisting of all real numbers, i.e., Ω =(−∞, ∞).

Computer memories. Suppose we store an n-bit word consisting of all 0s at a particular

location. When we read it back, we may not get all 0s. In fact, any n-bit word may be read

out if the memory location is faulty. The set of all possible n-bit words can be modeled by

the sample space

Ω = {(b

,...,b

) : b

= 0or1}.

Optical communication systems. Since the output of a photodetector is a random

number of photoelectrons. The logical sample space here is the nonnegative integers,

Ω = {0,1,2,...}.

Notice that we include 0 to account for the possibility that no photoelectrons are observed.

Wireless communication systems. Noncoherent receivers measure the energy of the

incoming waveform. Since energy is a nonnegative quantity, we model it with the sample

space consisting of the nonnegative real numbers, Ω =[0, ∞).

Variability in electronic circuits. Consider the lowpass RC ﬁlter shown in Figure 1.5(a).

Suppose that the exact values of R and C are not perfectly controlled by the manufacturing

process, but are known to satisfy

95 ohms ≤ R ≤ 105 ohms and 300

F ≤ C ≤ 340

剩余641页未读，继续阅读

primedayday

粉丝: 0
资源: 5

概率论与随机过程在电气和计算机工程中的应用

Probability, Statistics, and Random Processes for Electrical Engineering 答案

Probability, Statistics, and Random Processes For Electrical Engineering

Electrical Engineering solutions 0

probability, statistics, and random processes for electrical engineering

Statistics and Data Analysis for Financial Engineering

Probability and Random Processes

textbook ( Probability, Statistics

Probability, Random Variables and Stochastic Processes

solution : Probability, Random Variables, and Stochastic Processes

4th Edition - Probability,_Random_Variables_and_Stochastic_Processes

最新资源