HEVC标准草案10：高效视频编码文本规范

h265

需积分: 10 194 浏览量更新于2024-07-18 收藏 5.1MB PDF 举报

身份认证购VIP最低享 7 折!

30元优惠券

"该资源是关于H265（High Efficiency Video Coding）的文本规范草案10版，用于最终国际标准（FDIS）和同意阶段。由ITU-T SG16 WP3和ISO/IEC JTC1/SC29/WG11联合视频编码团队（JCT-VC）在2013年1月14日至23日在日内瓦的会议上发布。文档主要作者包括来自Fraunhofer HHI、Gachon University、RWTH Aachen、Microsoft和Qualcomm的专家。" H265，也称为高效率视频编码（High Efficiency Video Coding），是视频编码领域的一个重要里程碑，旨在显著提高视频压缩效率，以适应不断增长的高清和超高清视频需求。相较于前一代标准H264/AVC，H265在保持相同视频质量的同时，能将文件大小减半，这对于网络传输和存储来说具有巨大的优势。该文档草案10版，作为JCT-VC的输出成果，是HEVC标准的一部分，主要目的是为了最终形成国际标准做准备。文档中包含了一系列的技术修改和优化，例如： 1. 进行了各种清理更改，其中包括添加一个规则，即`general_level_idc`的较低值表示较低的级别。这有助于更好地定义和区分编码器的不同性能级别，确保不同设备之间的兼容性。 2. 修正了`short_term_ref_pic_set_idx`和`lt_idx_sps[i]`的语法和语义。这两个参数与参考图片集的管理和预测有关，对于高效的视频编码至关重要。正确的语法和语义定义可以确保解码过程的正确性和效率。 3. 修复了`DiffPicOrderCnt(currPic, pic)`到`DiffPicOrderCnt(pic, curr)`的拼写错误。差分图片顺序计数（DiffPicOrderCnt）用于计算图片的显示顺序，这个修正确保了时间参考的准确性。 H265的编码技术包括但不限于：更精细的宏块划分结构（如Cu、Tu），引入了新的预测模式（比如双向预测增强）、多参考帧预测、更强大的熵编码以及变换和量化改进等。这些技术的综合应用使得H265在编码效率上取得了重大突破。在实际应用中，H265广泛应用于4K和8K超高清视频流媒体服务、视频会议、在线教育、移动设备视频拍摄等场景。由于其高效编码能力，H265已经成为现代多媒体技术的核心组成部分，推动着整个行业的进步和发展。

资源详情

资源推荐

      Draft ISO/IEC 23008-2 : 201x (E) 
xvi  Draft Rec. ITU-T H.HEVC (201x E) 
 
CONTENTS 
  Page 
Abstract ............................................................................................................................................................................... i 
Introduction ................................................................................................................................................................ 1 
1  Prologue .............................................................................................................................................................. 1 
2  Purpose ............................................................................................................................................................... 1 
3  Applications ........................................................................................................................................................ 1 
4  Publication and versions of this Specification .................................................................................................... 1 
5  Profiles, tiers and levels ...................................................................................................................................... 2 
6  Overview of the design characteristics ............................................................................................................... 2 
7  How to read this Specification ............................................................................................................................ 2 
Scope .......................................................................................................................................................................... 3 
Normative references .................................................................................................................................................. 3 
1  General ................................................................................................................................................................ 3 
2  Identical Recommendations | International Standards ........................................................................................ 3 
3  Paired Recommendations | International Standards equivalent in technical content .......................................... 3 
4  Additional references .......................................................................................................................................... 3 
Definitions .................................................................................................................................................................. 3 
Abbreviations ............................................................................................................................................................ 12 
Conventions .............................................................................................................................................................. 13 
1  General .............................................................................................................................................................. 13 
2  Arithmetic operators ......................................................................................................................................... 13 
3  Logical operators .............................................................................................................................................. 13 
4  Relational operators .......................................................................................................................................... 14 
5  Bit-wise operators ............................................................................................................................................. 14 
6  Assignment operators ....................................................................................................................................... 14 
7  Range notation .................................................................................................................................................. 14 
8  Mathematical functions ..................................................................................................................................... 15 
9  Order of operation precedence .......................................................................................................................... 15 
10  Variables, syntax elements, and tables .............................................................................................................. 16 
11  Text description of logical operations ............................................................................................................... 17 
12  Processes ........................................................................................................................................................... 18 
Source, coded, decoded and output data formats, scanning processes, and neighbouring relationships .................. 18 
1  Bitstream formats .............................................................................................................................................. 18 
2  Source, decoded, and output picture formats .................................................................................................... 18 
3  Spatial subdivision of pictures, slices, slice segments, and tiles ....................................................................... 21 
4  Availability processes ....................................................................................................................................... 23 
4.1  Derivation process for z-scan order block availability .............................................................................. 23 
4.2  Derivation process for prediction block availability ................................................................................. 24 
5  Scanning processes ........................................................................................................................................... 25 
5.1  Coding tree block raster and tile scanning conversion process ................................................................. 25 
5.2  Z-scan order array initialization process ................................................................................................... 26 
5.3  Up-right diagonal scan order array initialization process ......................................................................... 26 
5.4  Horizontal scan order array initialization process ..................................................................................... 27 
5.5  Vertical scan order array initialization process ......................................................................................... 27 
Syntax and semantics ................................................................................................................................................ 27 
1  Method of specifying syntax in tabular form .................................................................................................... 27 
2  Specification of syntax functions and descriptors ............................................................................................. 28 
3  Syntax in tabular form ...................................................................................................................................... 30 
3.1  NAL unit syntax ........................................................................................................................................ 30 
3.1.1  General NAL unit syntax .................................................................................................................... 30 
3.1.2  NAL unit header syntax ...................................................................................................................... 30 
3.2  Raw byte sequence payloads, trailing bits, and byte alignment syntax ..................................................... 31 
3.2.1  Video parameter set RBSP syntax ...................................................................................................... 31 

Draft ISO/IEC 23008-2 : 201x (E) 
    Draft Rec. ITU-T H.HEVC (201x E)  xvii 
3.2.2  Sequence parameter set RBSP syntax ................................................................................................. 32 
3.2.3  Picture parameter set RBSP syntax ..................................................................................................... 33 
3.2.4  Supplemental enhancement information RBSP syntax ....................................................................... 35 
3.2.5  Access unit delimiter RBSP syntax .................................................................................................... 35 
3.2.6  End of sequence RBSP syntax ............................................................................................................ 35 
3.2.7  End of bitstream RBSP syntax ............................................................................................................ 35 
3.2.8  Filler data RBSP syntax ...................................................................................................................... 35 
3.2.9  Slice segment layer RBSP syntax ....................................................................................................... 35 
3.2.10  RBSP slice segment trailing bits syntax ............................................................................................. 36 
3.2.11  RBSP trailing bits syntax .................................................................................................................... 36 
3.2.12  Byte alignment syntax ........................................................................................................................ 36 
3.3  Profile, tier and level syntax ..................................................................................................................... 37 
3.4  Operation point set syntax......................................................................................................................... 37 
3.5  Scaling list data syntax .............................................................................................................................. 38 
3.6  Supplemental enhancement information message syntax ......................................................................... 38 
3.7  Slice segment header syntax ..................................................................................................................... 39 
3.7.1  General slice segment header syntax .................................................................................................. 39 
3.7.2  Short-term reference picture set syntax .............................................................................................. 42 
3.7.3  Reference picture list modification syntax.......................................................................................... 42 
3.7.4  Weighted prediction parameters syntax .............................................................................................. 43 
3.8  Slice segment data syntax ......................................................................................................................... 44 
3.8.1  General slice segment data syntax ...................................................................................................... 44 
3.8.2  Coding tree unit syntax ....................................................................................................................... 44 
3.8.3  Sample adaptive offset syntax ............................................................................................................ 45 
3.8.4  Coding quadtree syntax ...................................................................................................................... 46 
3.8.5  Coding unit syntax .............................................................................................................................. 47 
3.8.6  Prediction unit syntax ......................................................................................................................... 49 
3.8.7  PCM sample syntax ............................................................................................................................ 49 
3.8.8  Transform tree syntax ......................................................................................................................... 50 
3.8.9  Motion vector difference syntax ......................................................................................................... 50 
3.8.10  Transform unit syntax ......................................................................................................................... 51 
3.8.11  Residual coding syntax ....................................................................................................................... 52 
4  Semantics .......................................................................................................................................................... 54 
4.1  NAL unit semantics .................................................................................................................................. 54 
4.1.1  General NAL unit semantics ............................................................................................................... 54 
4.1.2  NAL unit header semantics ................................................................................................................. 55 
4.1.3  Encapsulation of an SODB within an RBSP (informative) ................................................................ 58 
4.1.4  Order of NAL units and association to coded pictures, access units, and video sequences ................ 59 
4.2  Raw byte sequence payloads, trailing bits, and byte alignment semantics ............................................... 62 
4.2.1  Video parameter set RBSP semantics ................................................................................................. 62 
4.2.2  Sequence parameter set RBSP semantics ........................................................................................... 65 
4.2.3  Picture parameter set RBSP semantics ............................................................................................... 69 
4.2.4  Supplemental enhancement information RBSP semantics ................................................................. 72 
4.2.5  Access unit delimiter RBSP semantics ............................................................................................... 72 
4.2.6  End of sequence RBSP semantics....................................................................................................... 73 
4.2.7  End of bitstream RBSP semantics ...................................................................................................... 73 
4.2.8  Filler data RBSP semantics ................................................................................................................. 73 
4.2.9  Slice segment layer RBSP semantics .................................................................................................. 73 
4.2.10  RBSP slice segment trailing bits semantics ........................................................................................ 73 
4.2.11  RBSP trailing bits semantics ............................................................................................................... 73 
4.2.12  Byte alignment semantics ................................................................................................................... 73 
4.3  Profile, tier and level semantics ................................................................................................................ 74 
4.4  Operation point set semantics ................................................................................................................... 75 
4.5  Scaling list data semantics ........................................................................................................................ 75 
4.6  Supplemental enhancement information message semantics .................................................................... 78 
4.7  Slice segment header semantics ................................................................................................................ 78 
4.7.1  General slice segment header semantics ............................................................................................. 78 
4.7.2  Short-term reference picture set semantics ......................................................................................... 82 
4.7.3  Reference picture list modification semantics .................................................................................... 84 
4.7.4  Weighted prediction parameters semantics......................................................................................... 85 
4.8  Slice segment data semantics .................................................................................................................... 86 
4.8.1  General slice segment data semantics ................................................................................................. 86 
4.8.2  Coding tree unit semantics .................................................................................................................. 86 

      Draft ISO/IEC 23008-2 : 201x (E) 
xviii  Draft Rec. ITU-T H.HEVC (201x E) 
4.8.3  Sample adaptive offset semantics ....................................................................................................... 86 
4.8.4  Coding quadtree semantics ................................................................................................................. 88 
4.8.5  Coding unit semantics ......................................................................................................................... 88 
4.8.6  Prediction unit semantics .................................................................................................................... 90 
4.8.7  PCM sample semantics ....................................................................................................................... 91 
4.8.8  Transform tree semantics .................................................................................................................... 91 
4.8.9  Motion vector difference semantics .................................................................................................... 92 
4.8.10  Transform unit semantics.................................................................................................................... 92 
4.8.11  Residual coding semantics .................................................................................................................. 93 
Decoding process ...................................................................................................................................................... 95 
1  General decoding process ................................................................................................................................. 95 
2  NAL unit decoding process .............................................................................................................................. 97 
3  Slice decoding process ...................................................................................................................................... 97 
3.1  Decoding process for picture order count ................................................................................................. 97 
3.2  Decoding process for reference picture set ............................................................................................... 98 
3.3  Decoding process for generating unavailable reference pictures ............................................................ 102 
3.3.1  General decoding process for generating unavailable reference pictures ......................................... 102 
3.3.2  Generation of one unavailable picture .............................................................................................. 103 
3.4  Decoding process for reference picture lists construction ....................................................................... 103 
4  Decoding process for coding units coded in intra prediction mode ................................................................ 104 
4.1  General decoding process for coding units coded in intra prediction mode ........................................... 104 
4.2  Derivation process for luma intra prediction mode ................................................................................. 105 
4.3  Derivation process for chroma intra prediction mode ............................................................................. 107 
4.4  Decoding process for intra blocks ........................................................................................................... 107 
4.4.1  General decoding process for intra blocks ........................................................................................ 107 
4.4.2  Intra sample prediction ..................................................................................................................... 108 
5  Decoding process for coding units coded in inter prediction mode ................................................................ 114 
5.1  General decoding process for coding units coded in inter prediction mode ........................................... 114 
5.2  Inter prediction process ........................................................................................................................... 115 
5.3  Decoding process for prediction units in inter prediction mode ............................................................. 117 
5.3.1  Derivation process for motion vector components and reference indices ......................................... 118 
5.3.2  Decoding process for inter prediction samples ................................................................................. 132 
5.4  Decoding process for the residual signal of coding units coded in inter prediction mode ...................... 141 
5.4.1  Decoding process for luma residual blocks ...................................................................................... 142 
5.4.2  Decoding process for chroma residual blocks .................................................................................. 142 
6  Scaling, transformation and array construction process prior to deblocking filter process............................. 143 
6.1  Derivation process for quantization parameters ...................................................................................... 143 
6.2  Scaling and transformation process ........................................................................................................ 145 
6.3  Scaling process for transform coefficients .............................................................................................. 146 
6.4  Transformation process for scaled transform coefficients ...................................................................... 146 
6.4.1  Transformation process..................................................................................................................... 147 
6.5  Picture construction process prior to in-loop filter process ..................................................................... 149 
7  In-loop filter process ....................................................................................................................................... 149 
7.1  General .................................................................................................................................................... 149 
7.2  Deblocking filter process ........................................................................................................................ 149 
7.2.1  Derivation process of transform block boundary .............................................................................. 151 
7.2.2  Derivation process of prediction block boundary ............................................................................. 152 
7.2.3  Derivation process of boundary filtering strength ............................................................................ 152 
7.2.4  Edge filtering process ....................................................................................................................... 154 
7.3  Sample adaptive offset process ............................................................................................................... 162 
7.3.1  General.............................................................................................................................................. 162 
7.3.2  Coding tree block modification process............................................................................................ 163 
Parsing process ....................................................................................................................................................... 164 
1  Parsing process for 0-th order Exp-Golomb codes ......................................................................................... 164 
1.1  Mapping process for signed Exp-Golomb codes .................................................................................... 166 
2  CABAC parsing process for slice segment data ............................................................................................. 167 
2.1  Initialization process ............................................................................................................................... 168 
2.1.1  Initialization process for context variables ....................................................................................... 170 
2.1.2  Memorization process for context variables ..................................................................................... 177 
2.1.3  Synchronization process for context variables .................................................................................. 178 
2.1.4  Initialization process for the arithmetic decoding engine ................................................................. 178 

Draft ISO/IEC 23008-2 : 201x (E) 
    Draft Rec. ITU-T H.HEVC (201x E)  xix 
9.2.2  Binarization process ................................................................................................................................ 178 
9.2.2.1  Unary (U) binarization process ......................................................................................................... 183 
9.2.2.2  Truncated unary (TU) binarization process ...................................................................................... 183 
9.2.2.3  Truncated Rice (TR) binarization process ........................................................................................ 183 
9.2.2.4  k-th order Exp-Golomb (EGk) binarization process ......................................................................... 184 
9.2.2.5  Fixed-length (FL) binarization process ............................................................................................. 184 
9.2.2.6  Binarization process for cu_qp_delta_abs ........................................................................................ 184 
9.2.2.7  Binarization process for part_mode .................................................................................................. 184 
9.2.2.8  Binarization process for coeff_abs_level_remaining ........................................................................ 185 
9.2.2.9  Binarization process for intra_chroma_pred_mode .......................................................................... 185 
9.2.2.10  Binarization process for inter_pred_idc ............................................................................................ 186 
9.2.3  Decoding process flow ............................................................................................................................ 186 
9.2.3.1  Derivation process for ctxIdx ........................................................................................................... 187 
9.2.3.2  Arithmetic decoding process ............................................................................................................ 192 
9.2.4  Arithmetic encoding process (informative) ............................................................................................ 199 
9.2.4.1  Initialization process for the arithmetic encoding engine (informative) ........................................... 199 
9.2.4.2  Encoding process for a binary decision (informative) ...................................................................... 200 
9.2.4.3  Renormalization process in the arithmetic encoding engine (informative) ...................................... 201 
9.2.4.4  Bypass encoding process for binary decisions (informative) ............................................................ 203 
9.2.4.5  Encoding process for a binary decision before termination (informative) ........................................ 204 
9.2.4.6  Byte stuffing process (informative) .................................................................................................. 206 
10  Specification of bitstream subsets ........................................................................................................................... 206 
10.1  Sub-bitstream extraction process .................................................................................................................... 206 
 Annex A  Profiles, tiers and levels ................................................................................................................................ 208 
A.1  Overview of profiles, tiers and levels ............................................................................................................. 208 
A.2  Requirements on video decoder capability ..................................................................................................... 208 
A.3  Profiles ............................................................................................................................................................ 208 
A.3.1  General .................................................................................................................................................... 208 
A.3.2  Main profile ............................................................................................................................................ 208 
A.3.3  Main 10 profile ....................................................................................................................................... 209 
A.3.4  Main Still Picture profile ........................................................................................................................ 209 
A.4  Tiers and levels ............................................................................................................................................... 210 
A.4.1  General tier and level limits .................................................................................................................... 210 
A.4.2  Profile-specific level limits for the Main and Main 10 profiles .............................................................. 212 
A.4.3  Effect of level limits on picture rate for the Main and Main 10 profiles (informative) .......................... 214 
 Annex B  Byte stream format ........................................................................................................................................ 217 
B.1  Byte stream NAL unit syntax and semantics .................................................................................................. 217 
B.1.1  Byte stream NAL unit syntax .................................................................................................................. 217 
B.1.2  Byte stream NAL unit semantics ............................................................................................................ 217 
B.2  Byte stream NAL unit decoding process ........................................................................................................ 218 
B.3  Decoder byte-alignment recovery (informative) ............................................................................................. 218 
 Annex C  Hypothetical reference decoder ..................................................................................................................... 219 
C.1  General ............................................................................................................................................................ 219 
C.2  Operation of coded picture buffer (CPB) ........................................................................................................ 223 
C.2.1  General .................................................................................................................................................... 223 
C.2.2  Timing of decoding unit arrival .............................................................................................................. 223 
C.2.3  Timing of decoding unit removal and decoding of decoding unit .......................................................... 225 
C.3  Operation of the decoded picture buffer (DPB) .............................................................................................. 227 
C.3.1  General .................................................................................................................................................... 227 
C.3.2  Removal of pictures from the DPB ......................................................................................................... 227 
C.3.3  Picture output .......................................................................................................................................... 228 
C.3.4  Current decoded picture marking and storage......................................................................................... 229 
C.4  Bitstream conformance ................................................................................................................................... 229 
C.5  Decoder conformance ..................................................................................................................................... 230 
C.5.1  General .................................................................................................................................................... 230 
C.5.2  Operation of the output order DPB ......................................................................................................... 231 
C.5.3  Output and removal of pictures from the DPB ....................................................................................... 231 
C.5.4  Picture decoding, marking, additional bumping, and storage ................................................................. 232 
C.5.5  "Bumping" process ................................................................................................................................. 232 

      Draft ISO/IEC 23008-2 : 201x (E) 
xx  Draft Rec. ITU-T H.HEVC (201x E) 
 Annex D  Supplemental enhancement information ....................................................................................................... 233 
D.1  SEI payload syntax ......................................................................................................................................... 234 
D.1.1  General SEI message syntax ................................................................................................................... 234 
D.1.2  Buffering period SEI message syntax ..................................................................................................... 235 
D.1.3  Picture timing SEI message syntax ......................................................................................................... 237 
D.1.4  Pan-scan rectangle SEI message syntax .................................................................................................. 237 
D.1.5  Filler payload SEI message syntax ......................................................................................................... 238 
D.1.6  User data registered by Rec. ITU-T T.35 SEI message syntax ............................................................... 238 
D.1.7  User data unregistered SEI message syntax ............................................................................................ 238 
D.1.8  Recovery point SEI message syntax ....................................................................................................... 238 
D.1.9  Scene information SEI message syntax .................................................................................................. 239 
D.1.10  Full-frame snapshot SEI message syntax ................................................................................................ 239 
D.1.11  Progressive refinement segment start SEI message syntax ..................................................................... 239 
D.1.12  Progressive refinement segment end SEI message syntax ...................................................................... 239 
D.1.13  Film grain characteristics SEI message syntax ....................................................................................... 240 
D.1.14  Post-filter hint SEI message syntax......................................................................................................... 240 
D.1.15  Tone mapping information SEI message syntax ..................................................................................... 241 
D.1.16  Frame packing arrangement SEI message syntax ................................................................................... 242 
D.1.17  Display orientation SEI message syntax ................................................................................................. 242 
D.1.18  SOP description SEI message syntax ...................................................................................................... 243 
D.1.19  Decoded picture hash SEI message syntax ............................................................................................. 243 
D.1.20  Active parameter sets SEI message syntax ............................................................................................. 243 
D.1.21  Decoding unit information SEI message syntax ..................................................................................... 244 
D.1.22  Temporal level zero index SEI message syntax ...................................................................................... 244 
D.1.23  Scalable nesting SEI message syntax ...................................................................................................... 244 
D.1.24  Region refresh information SEI message syntax .................................................................................... 245 
D.1.25  Reserved SEI message syntax ................................................................................................................. 245 
D.2  SEI payload semantics .................................................................................................................................... 245 
D.2.1  General SEI payload semantics ............................................................................................................... 245 
D.2.2  Buffering period SEI message semantics ................................................................................................ 248 
D.2.3  Picture timing SEI message semantics .................................................................................................... 249 
D.2.4  Pan-scan rectangle SEI message semantics ............................................................................................ 255 
D.2.5  Filler payload SEI message semantics .................................................................................................... 256 
D.2.6  User data registered by ITU-T Rec. T.35 SEI message semantics .......................................................... 256 
D.2.7  User data unregistered SEI message semantics ....................................................................................... 256 
D.2.8  Recovery point SEI message semantics .................................................................................................. 256 
D.2.9  Scene information SEI message semantics ............................................................................................. 257 
D.2.10  Full-frame snapshot SEI message semantics .......................................................................................... 259 
D.2.11  Progressive refinement segment start SEI message semantics ................................................................ 260 
D.2.12  Progressive refinement segment end SEI message semantics ................................................................. 260 
D.2.13  Film grain characteristics SEI message semantics .................................................................................. 261 
D.2.14  Post-filter hint SEI message semantics ................................................................................................... 266 
D.2.15  Tone mapping information SEI message semantics................................................................................ 267 
D.2.16  Frame packing arrangement SEI message semantics .............................................................................. 270 
D.2.17  Display orientation SEI message semantics ............................................................................................ 276 
D.2.18  SOP description SEI message semantics ................................................................................................ 277 
D.2.19  Decoded picture hash SEI message semantics ........................................................................................ 278 
D.2.20  Active parameter sets SEI message semantics ........................................................................................ 279 
D.2.21  Decoding unit information SEI message semantics ................................................................................ 280 
D.2.22  Temporal level zero index SEI message semantics ................................................................................ 281 
D.2.23  Scalable nesting SEI message semantics ................................................................................................ 282 
D.2.24  Region refresh information SEI message semantics ............................................................................... 283 
D.2.25  Reserved SEI message semantics ........................................................................................................... 284 
 Annex E  Video usability information ........................................................................................................................... 285 
E.1  VUI syntax ...................................................................................................................................................... 286 
E.1.1  VUI parameters syntax ........................................................................................................................... 286 
E.1.2  HRD parameters syntax .......................................................................................................................... 288 
E.1.3  Sub-layer HRD parameters syntax .......................................................................................................... 289 
E.2  VUI semantics ................................................................................................................................................ 289 
E.2.1  VUI parameters semantics ...................................................................................................................... 289 
E.2.2  HRD parameters semantics ..................................................................................................................... 301 
E.2.3  Sub-layer HRD parameters semantics .................................................................................................... 304 