入门音视频数字处理：《多媒体信号与系统》详解

需积分: 9 155 浏览量更新于2024-07-19 收藏 38.28MB PDF 举报

"《多媒体信号与系统》是一本深入浅出的入门教材，专为那些想要了解音视频数字处理领域的学习者而设计。该书作为The Kluwer International Series in Engineering and Computer Science系列的一部分，由Mrinal K. Mandal撰写，他来自加拿大的阿尔伯塔大学。该书旨在帮助读者掌握多媒体信号处理的基础理论和实践技术，涵盖了信号处理中的数字技术在多媒体系统中的关键应用。书中详细探讨了多媒体系统的构造、工作原理以及它们如何通过数字化技术来处理音频、视频等多模态数据。主要内容可能包括数字信号处理基础、图像编码与解码、音频编码标准（如MP3、AAC）、视频压缩算法（H.264、MPEG）以及实时流媒体传输技术。此外，作者还可能介绍了多媒体数据的存储、检索和传输中的关键技术，以及这些技术对多媒体质量、效率和兼容性的影响。对于那些希望在信息技术领域从事多媒体开发、信号处理或通信工程的人来说，这本书不仅提供了理论知识，还提供了实际应用的案例分析和练习，使读者能够理解和掌握多媒体信号处理的核心概念。此外，书后的参考文献和索引为深入研究提供了丰富的资源。版权方面，本书受到Springer Science+Business Media, LLC的保护，首次出版于2003年，并在同年由Kluwer Academic Publishers发行。电子版在2003年也已发布，读者可以通过指定链接获取额外的学习材料。请注意，未经许可，任何形式的复制、存储或传输都是被禁止的，以尊重作者的知识产权。《多媒体信号与系统》是一本既适合初学者入门，又适合专业人员进一步提升技能的重要参考资料，是多媒体技术领域不可或缺的一本书籍。"

Chapter

Introduction

Table

1.1.

Brief

history

multimedia

systems.

Year

Events

Pre-Computer

Newspaper,

radio,

television,

and

cinema

were

the

primary

means

Age

mass

communications.

Late

1890s

Radio

was

introduced.

Early

1900s

Movie

was

introduced.

1940s

Television

was

introduced.

1960s

Concept

of hypertext

systems

was

developed.

Early

1980s

Personal

computer

was

introduced.

1983

Internet

born,

TCPIIP

protocol

was

established.

Audio-CD

was

introduced.

1990

Tim

Bemers-Lee

proposed

the

World

Wide

Web.

HTML

(Hyper

Text

Markup

Language)

developed.

1980-present

Several

digital

audio,

image

and

video

coding

standards

have

been

developed.

Mid

1990s

High

Definition

Television

standard established

North

America.

1993-present

Several

web-browsers,

hypertext

lan~uages

have

been

developed.

As well, publication houses assisted the development

efficient formats

for data representation. Note that the hypertext markup language (HTML)

the World Wide Web was preceded

the development

generalized

markup languages for creating machine independent document structures.

1.2 CLASSIFICATION OF MEDIA

have noted that multimedia represents a variety

media. These media

can be classified according to different criteria.

Perception:

In a typical multimedia environment, the information is

ultimately presented to people (e.g., in a cinema). This information

representation should exploit our five senses: hearing, seeing, smell,

touch and taste (see Fig. 2). However, most current multimedia systems

only employ the audio and visual senses. The technology for involving

the three other (minor) senses has not yet matured. Some work has been

carried out to include smell and taste in multimedia systems [11], but it

needs more research to become convenient and cost effective. Hence, in

the current multimedia framework, text, image, and video can be

considered visual media, whereas music and speech can be considered

auditory media.

Representation:

Here, the media

characterized by internal computer

representation, as various formats represent media information in a

computer. For example, text characters may

represented by ASCII

code; audio signals may be represented by PCM samples; image data

Chapter

Introduction

1.4

PROPERTIES

MULTIMEDIA

SYSTEMS

Literally speaking, any system that supports two or more media should be

called a multimedia system. Using this definition, a newspaper is a

multimedia presentation because it includes text and images for illustration.

However, in practice, a different interpretation often appears. Nevertheless,

a multimedia system should have the following properties:

Combination

Media:

well-known that a multimedia system

should include two or more media. Unfortunately, there

no exclusive way

to specify the media types. On one hand, some authors [1] suggest that there

should be at least one continuous (time-dependent) and one discrete (time

independent) media. With this requirement, a text processing system that

can incorporate images may not be called a multimedia system (since both

media are discrete). On the other hand, some authors

[3]

prefer to relax this

interpretation, and accept a more general definition

multimedia.

Data

Level

Text

Image

Audio

Video

Interactivity

C><J C><J

Non-

Interactive

Non-

Interactive

interactive

Application

Books,

Net-talk,

DVJ!

Movies,

Vi1eo

Conf.,

Examples

Slideshow

Browsing

TV/Audio-

Interactive

Broadcasting

Television

Figure

1.3.

Different types

multimedia and their typical applications.

Independence: Different media in a multimedia system should have a

high degree

independence. This is an important criterion for a

multimedia system,

it enables independent processing

different

media types, and provides the flexibility

combining media in arbitrary

forms. Most conventional information sources that include two or media

will fail this test. For example, the text and images in a newspaper are

tightly coupled; so are the audio and video signals in a VHS cassette.

Therefore, these systems do not satisfy the independence criteria, and are

not multimedia systems.

Multimedia Signals and Systems

Computer Supported Integration:

order to achieve media

independence, computer-based processing is almost a necessity. The

computers provide another important feature

a multimedia system:

integration. The different media in a multimedia system should be

integrated. A high level

integration ensures that changing the content

one media causes corresponding changes in other media.

Communication Systems: In today's highly-networked world, a

multimedia system should be capable

communicating with other

multimedia systems. The multimedia data transmitted through a network

may be discrete

(e.g., a text document, or email) or continuous (e.g.,

streamed audio or video) data.

1.5 MULTIMEDIA COMPUTING

Multimedia computing

the core module

a typical multimedia system.

In order to perform data processing efficiently, high-speed processors and

peripherals are required to handle a variety

media such

text, graphics,

audio and video. Appropriate software tools are also required in order to

process the data.

the early 1990s, the "multimedia PC" was a very popular term used by

personal computer (PC) vendors. To ensure the software and hardware

compatibility

different multimedia applications, the Multimedia PC

Marketing Council

developed specifications for Multimedia PC, or MPC for

short [4]. The first set

specifications (known

MPC

Levell)

was

published in 1990. The second set

specifications (MPC Level 2) was

specified in 1994, and included the CD-ROM drive and sound card. Finally,

the MPC Level 3 (MPC3) specifications were published in 1996, with the

following specifications:

• CPU speed:

MHz (or higher) Pentium

• RAM: 8

or more

• Magnetic Storage: 540

hard drive or larger

• CD-ROM drive: 4x speed or higher

• Video: Super VGA (640x480 pixels,

bits (i.e., 65,536) colors)

• Sound card: 16-bit,

44.1

kHz stereo sound

• Digital video: Should support delivery

digital video with

352 x 240 pixels resolution at 30 frames/sec (or 352 x 288 at

frames/sec).

should also have MPEG 1 support (hardware or

software).

• Modem: 28.8 Kbps or faster to communicate with the external

world.

Note that most PCs available on the market today far exceed the above

specifications. A typical multimedia workstation

shown in Fig. 1.4.

Chapter

Introduction

Today's workstations

contain

rich

system

configurations

for

multimedia

data

processing.

Hence,

most

PCs

can

technically

called

MPCs

However,

from

the

technological

point

view,

there

are

still

many

issues

that

require

the

full

attention of

researchers

and

developers.

Some

the

critical

aspects

of a

multimedia

computing

system

include

[2]:

Processing Speed:

The

central

processor

should

have

high

processing

speed

order

perform

software-based

real-time

multimedia signal

processing.

Note

that

among

the

multimedia

data,

video

processing

requires

the

most

computational

power,

especially

rates

above

frames/sec

. A distributed processing architecture

may

provide

expensive

high-speed

multimedia

workstation

[5].

Architecture:

addition

the

CPU

speed,

efficient architectures

are

required

provide

high-speed

communication

between

the

CPU

and

the

RAM,

and

between

the

CPU

and

the

peripherals.

Note

that

the

CPU

speed

constantly increasing

over

the

years.

Several

novel

architectures,

such

Intelligent

RAM

(IRAM),

and

Computational

RAM

have

been

proposed

address

this

issue

[6].

these

architectures,

the

RAM

has

its

own

processing

elements,

and

hence

the

memory

bandwidth

very

high.

Operating System:

High

performance

real-time

multimedia

operating

systems

are

required

support

real-time

scheduling, efficient interrupt

handling,

and

synchronization

among

different

data

types

[7].

Highspeed

xternal

Netv.ork

LAN/

(LAN,

cabl

satellite)

rnet

--- ---

-----

---

-----

---

-t

--1

r --

---

-------

----

---

--------

---

----

---

Telep

Line

,----1.---,

: :

High-speed

(e.g.,

fire

wire)

interfacing

bus

o 0

L---r----1-

----.~~

: :

--!~.,-,-

Hom

e : : Office/

Home

Environment

................................................................................................

.....................................

......

.....................................................................................

Figure

1.4.

Multimedia Workstations

home

and

office environment.

剩余382页未读，继续阅读

zZoO0

粉丝: 3
资源: 8

入门音视频数字处理：《多媒体信号与系统》详解

signals and systems

Signals and Systems

HNU-ES实验一（步进电机）

scandir-1.10.0-cp38-cp38-win_amd64.whl

【图像配准】基于matlab GUI Powell+蚁群算法图像配准【含Matlab源码 928期】.md

《Machine Learning》课程PPT-吴恩达09

ceODBC-2.0.1-cp35-cp35m-win_amd64.whl

【图像加密】基于matlab超混沌系统和SHA-256算法图像加密【含Matlab源码 3224期】.md

lazy_object_proxy-1.7.1-pp38-pypy38_pp73-win_amd64.whl

【图像去噪】基于matlab稀疏表示KSVD彩色图像去噪（含PSNR）【含Matlab源码 4261期】.md

最新资源