MPEG-4 Part 1: 系统标准与视音频同步复用技术详解

需积分: 10 23 浏览量更新于2024-08-01 收藏 5.42MB PDF 举报

MPEG-4 part1，全称为ISO/IEC 14496-1:2001(E)，是多媒体编码标准MPEG-4的第一个系统标准。该标准定义了音频和视频对象的同步处理以及数据的复用技术，对于多媒体内容的压缩、传输和交互性有重大影响。MPEG-4旨在提供一种高效的方法来存储、处理和传输各种类型的多媒体数据，包括视频、音频、图像和文本等。 ISO/IEC 14496-1的核心关注点在于实现视音频信号的高效编码，以便在不同的设备和网络环境下实现高质量的播放。它采用了灵活的框架结构，允许开发者创建不同的编解码器配置，以适应不同的应用需求，如移动通信、互联网流媒体和数字电视等。标准中的“Referencenumber”标明了该文档的唯一标识符和版权信息，强调了标准的官方性和国际认可度。Adobe的PDF disclaimer强调了文件可能包含嵌入字体，用户只能进行查看和打印，除非获取了相应的字体许可才能进行编辑。此外，标准制定者对ISO成员国在使用过程中可能遇到的问题表示关注，并欢迎报告任何问题。 MPEG-4 part1的技术细节包括对同步机制的描述，确保音频和视频帧之间的正确时间关系，这对于实时交互和流畅播放至关重要。复用技术则涉及到数据包的组织方式，使得多个媒体流可以在一个统一的数据流中被同时传输，提高了带宽利用率。此外，标准还涵盖了封装和流化技术，使得多媒体数据能够适应不同的传输环境，如CD-ROM、网络传输、以及移动设备。对于编码效率，MPEG-4采用了高效的熵编码方法，如H.264视频编码和AAC音频编码，以达到更高的压缩比，同时保持相对低的失真度。 MPEG-4 part1是多媒体领域的基石，它的核心价值在于为现代数字娱乐、教育和通信提供了标准化的多媒体处理手段，推动了整个行业的技术发展和内容创新。对于IT专业人士和内容创作者来说，理解并掌握这一标准对于开发跨平台的多媒体应用和优化网络传输具有重要意义。

ISO/IEC 14496-1:2001(E)

4.19 Decoder configuration

The configuration of a decoder for processing its elementary stream data by using information contained in its

elementary stream descriptor.

4.20 Decoding Time Stamp (DTS)

An indication of the nominal decoding time of an access unit.

4.21 Delivery Layer

A generic abstraction for delivery mechanisms (computer networks, etc.) able to store or transmit a number of

multiplexed elementary streams or FlexMux streams.

4.22 Descriptor

A data structure that is used to describe particular aspects of an elementary stream or a coded audio-visual object.

4.23 DMIF Application Interface (DAI)

An interface specified in ISO/IEC 14496-6. It is used here to model the exchange of SL-packetized stream data and

associated control information between the sync layer and the delivery layer.

4.24 Elementary Stream (ES)

A consecutive flow of mono-media data from a single source entity to a single destination entity on the compression

layer.

4.25 Elementary Stream Descriptor

A structure contained in object descriptors that describes the encoding format, initialization information, sync layer

configuration, and other descriptive information about the content carried in an elementary stream.

4.26 Elementary Stream Interface (ESI)

A conceptual interface modeling the exchange of elementary stream data and associated control information

between the compression layer and the sync layer.

4.27 FlexMux Channel (FMC)

A label to differentiate between data belonging to different constituent streams within one FlexMux Stream. A

sequence of data in one FlexMux channel within a FlexMux stream corresponds to one single SL-packetized

stream.

4.28 FlexMux Packet

The smallest data entity managed by the FlexMux tool. It consists of a header and a payload.

4.29 FlexMux Stream

A sequence of FlexMux Packets with data from one or more SL-packetized streams that are each identified by their

own FlexMux channel.

4.30 FlexMux tool

A tool that allows the interleaving of data from multiple data streams.

4.31 Graphics Profile

A profile that specifies the permissible set of graphical elements of the BIFS tool that may be used in a scene

description stream. Note that BIFS comprises both graphical and scene description elements.

4.32 Hint Track

A special track which contains instructions for packaging one or more tracks into a TransMux. It does not contain

media data (an elementary stream).

4.33 Hinter

A tool that is run on a completed file to add one or more hint tracks to the file to facilitate streaming.

4.34 Inter

A mode for coding parameters that uses previously coded parameters to construct a prediction.

4.35 Intra

A mode for coding parameters that does not make reference to previously coded parameters to perform the

encoding.

ISO/IEC 14496-1:2001(E)

4.36 Initial Object Descriptor

A special object descriptor that allows the receiving terminal to gain initial access to portions of content encoded

according to ISO/IEC 14496. It conveys profile and level information to describe the complexity of the content.

4.37 Intellectual Property Identification (IPI)

A unique identification of one or more elementary streams corresponding to parts of one or more audio-visual

objects.

4.38 Intellectual Property Management and Protection (IPMP) System

A generic term for mechanisms and tools to manage and protect intellectual property. Only the interface to such

systems is normatively defined.

4.39 Movie Atom

A container atom whose sub-atoms define the meta-data for a presentation (‘moov’).

4.40 Movie Data Atom

A container atom which can hold the actual media data for a presentation (‘mdat’).

4.41 MP4 File

The name of the file format described in this specification.

4.42 Object Clock Reference (OCR)

A clock reference that is used by a decoder to recover the time base of the encoder of an elementary stream.

4.43 Object Content Information (OCI)

Additional information about content conveyed through one or more elementary streams. It is either aggregated to

individual elementary stream descriptors or is itself conveyed as an elementary stream.

4.44 Object Descriptor (OD)

A descriptor that aggregates one or more elementary streams by means of their elementary stream descriptors and

defines their logical dependencies.

4.45 Object Descriptor Command

A command that identifies the action to be taken on a list of object descriptors or object descriptor IDs, e.g., update

or remove.

4.46 Object Descriptor Profile

A profile that specifies the configurations of the object descriptor tool and the sync layer tool that are allowed.

4.47 Object Descriptor Stream

An elementary stream that conveys object descriptors encapsulated in object descriptor commands.

4.48 Object Time Base (OTB)

A time base valid for a given elementary stream, and hence for its decoder. The OTB is conveyed to the decoder

via object clock references. All time stamps relating to this object’s decoding process refer to this time base.

4.49 Parametric Audio Decoder

A set of tools for representing and decoding speech signals coded at bit rates between 6 Kbps and 16 Kbps,

according to the specifications in ISO/IEC 14496-3.

4.50 Quality of Service (QoS)

The performance that an elementary stream requests from the delivery channel through which it is transported.

QoS is characterized by a set of parameters (e.g., bit rate, delay jitter, bit error rate, etc.).

4.51 Random Access

The process of beginning to read and decode a coded representation at an arbitrary point within the elementary

stream.

4.52 Reference Point

A location in the data or control flow of a system that has some defined characteristics.

ISO/IEC 14496-1:2001(E)

4.53 Rendering

The action of transforming a scene description and its constituent audio-visual objects from a common

representation space to a specific presentation device (i.e., speakers and a viewing window).

4.54 Rendering Area

The portion of the display device’s screen into which the scene description and its constituent audio-visual objects

are to be rendered.

4.55 Sample

An access unit for an elementary stream. In hint tracks, a sample defines the formation of one or more TransMux

packets.

4.56 Sample Table

A packed directory for the timing and physical layout of the samples in a track.

4.57 Scene Description

Information that describes the spatio-temporal positioning of audio-visual objects as well as their behavior resulting

from object and user interactions. The scene description makes reference to elementary streams with audio-visual

data by means of pointers to object descriptors.

4.58 Scene Description Stream

An elementary stream that conveys scene description information.

4.59 Scene Graph Elements

The elements of the BIFS tool that relate only to the structure of the audio-visual scene (spatio-temporal positioning

of audio-visual objects as well as their behavior resulting from object and user interactions) excluding the audio,

visual and graphics nodes as specified in clause 15.

4.60 Scene Graph Profile

A profile that defines the permissible set of scene graph elements of the BIFS tool that may be used in a scene

description stream. Note that BIFS comprises both graphical and scene description elements.

4.61 SL-Packetized Stream (SPS)

A sequence of sync layer packets that encapsulate one elementary stream.

4.62 Structured Audio

A method of describing synthetic sound effects and music as defined by ISO/IEC 14496-3.

4.63 Sync Layer (SL)

A layer to adapt elementary stream data for communication across the DMIF Application Interface, providing timing

and synchronization information, as well as fragmentation and random access information. The sync layer syntax is

configurable and can be configured to be empty.

4.64 Sync Layer Configuration

A configuration of the sync layer syntax for a particular elementary stream using information contained in its

elementary stream descriptor.

4.65 Sync Layer Packet (SL-Packet)

The smallest data entity managed by the sync layer consisting of a configurable header and a payload. The

payload may consist of one complete access unit or a partial access unit.

4.66 Syntactic Description Language (SDL)

A language defined by ISO/IEC 14496-1 that allows the description of a bitstream’ssyntax.

4.67 Systems Decoder Model (SDM)

A model that provides an abstract view of the behavior of a terminal compliant to ISO/IEC 14496. It consists of the

buffer model and the timing model.

4.68 System Time Base (STB)

The time base of the terminal. Its resolution is implementation-dependent. All operations in the terminal are

performed according to this time base.

ISO/IEC 14496-1:2001(E)

4.69 Terminal

A system that sends, or receives and presents the coded representation of an interactive audio-visual scene as

defined by ISO/IEC 14496-1. It can be a standalone system, or part of an application system complying with

ISO/IEC 14496.

4.70 Time Base

The notion of a clock; it is equivalent to a counter that is periodically incremented.

4.71 Timing Model

A model that specifies the semantic meaning of timing information, how it is incorporated (explicitly or implicitly) in

the coded representation of information, and how it can be recovered at the receiving terminal.

4.72 Time Stamp

An indication of a particular time instant relative to a time base.

4.73 Track

A collection of related samples in an MP4 file. For media data, a track corresponds to an elementary stream. For

hint tracks, a track corresponds to a TransMuxchannel

5 Abbreviations and Symbols

AU Access Unit

AV Audio-visual

BIFS Binary Format for Scene

CM Composition Memory

CTS Composition Time Stamp

CU Composition Unit

DAI DMIF Application Interface (see ISO/IEC 14496-6)

DB Decoding Buffer

DTS Decoding Time Stamp

ES Elementary Stream

ESI Elementary Stream Interface

ESID Elementary Stream Identifier

FAP Facial Animation Parameters

FAPU FAP Units

FDP Facial Definition Parameters

FIG FAP Interpolation Graph

FIT FAP Interpolation Table

FMC FlexMux Channel

FMOD The floating point modulo (remainder) operator which returns the remainder of x/y such that:

Fmod(x/y) = x – k*y, where k is an integer,

sgn( fmod(x/y) ) = sgn(x), and

abs( fmod(x/y) ) < abs(y)

IP Intellectual Property

IPI Intellectual Property Identification

IPMP Intellectual Property Management and Protection

NCT Node Coding Tables

NDT Node Data Type

NINT Nearest INTeger value

OCI Object Content Information

OCR Object Clock Reference

OD Object Descriptor

ODID Object Descriptor Identifier

OTB Object Time Base

PLL Phase Locked Loop

QoS Quality of Service

SAOL Structured Audio Orchestra Language

SASL Structured Audio Score Language

SDL Syntactic Description Language

SDM Systems Decoder Model

SL Synchronization Layer

剩余683页未读，继续阅读

xzy911

粉丝: 0
资源: 1

MPEG-4 Part 1: 系统标准与视音频同步复用技术详解

ISO IEC 14496-14-2020(MP4 file format).pdf

ISO_IEC_14496-14-2003.pdf

MPEG-4 part14

OpenCV: FFMPEG: tag 0x47504a4d/'MJPG' is not supported with codec id 8 and format 'mp4 / MP4 (MPEG-4 Part 14)'警告

mpeg-ps.mp4

OpenCV: FFMPEG: tag 0x5634504d/'MP4V' is not supported with codec id 12 and format 'mp4 / MP4 (MPEG-4 Part 14)' OpenCV: FFMPTraceback (most recent call last):怎么回事

MPEG4-PART2/ASP

mms->wmv,asf rtsp->rmvb,rm rtmp->f4v,flv,swf HLS->mp4,mkv(webm),mov MPEG-DASH->H.264、AAC WebRTC->直播（视频聊天软件和视频会议）

cv2.VideoWriter_fourcc()支持MP4格式的参数

最新资源