LOW-DELAY WINDOW-BASED RATE CONTROL SCHEME FOR VIDEO QUALITY
OPTIMIZATION IN VIDEO ENCODER
Yuan Li, Huizhu Jia
*
, Chuang Zhu, Meng Li, Xiaodong Xie and Wen Gao, Fellow, IEEE
National Engineering Laboratory for Video Technology
Peking University, Beijing, China
ABSTRACT
The consistent video quality and encoding latency due to
buffering are two important aspects in designing rate control
scheme for the application of real-time video coding system.
To well balance these two contrary objectives, we firstly
analyze the constraint of buffer latency and the definition of
a “consistent” video quality. Then a window-based rate
control scheme is proposed with one window for controlling
the rate and latency, while the other window for optimizing
video quality. By applying low complexity frame level rate-
distortion model in the testing sequences, our proposed
method shows excellent performance in balancing the
encoder buffer latency and optimized video quality. Besides,
this one-pass rate control scheme is highly practical for the
real-time video coding application.
,QGH[ 7HUPV ² Rate control, buffer latency, video
quality, window-based, video encoder
1. INTRODUCTION
Modern video coding standards such as MPEG-2 [1],
H.264/AVC [2] and AVS [3] are widely used for their
excellent performance in video compression. However, in
certain real-time encoding applications, such as video
stream transmission and video communication etc., there
exits strict constraints of bit rate and system latency.
Meanwhile, the consistency of video quality is also required
to be considered. Under these situations, rate control aims at
achieving both shortened system latency and consistent
video quality for the required bit rate budget.
Typical rate control can be classified as two categories:
constant bit rate (CBR) and variable bit rate (VBR). In CBR
applications, a short-term average bit rate must be reached
regardless of the frame’s characteristic. Since the video
contents vary from frame to frame, CBR will cause the
unavoidable fluctuation of video quality. On the other hand,
VBR usually uses the global information of video content to
allocate bits among different frames, which can guarantee
the uniform video quality. However, this mechanism needs a
two-pass or multi-pass encoding process, which is not
suitable for real-time encoding application.
Many CBR rate control schemes are proposed and
developed in literature. The TM5 in MPEG-2 [4] uses group
of pictures (GOP)-based bit allocation, which allocates
equal bit budget to all GOPs. Within a GOP, the frame bit
allocation uses a fixed weighting factor according to the
frame type. The assumption of this mechanism is that the
video content is stationary, which is not always true and will
cause fluctuation of video quality. Xie et al. [5] proposed a
sequence-based bit allocation scheme by tracking the non-
stationary characteristics in a video sequence. The consistent
video quality can be achieved. However, the system latency
is not discussed. In [6], Xu et al. proposed a window model
about the picture quality and the buffer occupancy. To
reduce the buffer latency, Ribas-Corbera et al. [7] applied a
near-constant bit budget for each frame and introduced
frame skipping mechanism. In [8], He et al. used the similar
near-constant frame bit allocation and smoothed the rate
shape by varying the distortion in a small range.
In summary, the balancing of encoder buffer latency
and consistent video quality is not discussed sufficiently in
these above-mentioned methods. In this paper, we firstly
analyze the constraint of buffer latency and the definition of
consistent video quality. Then a window-based rate control
scheme is proposed with one window for controlling the rate
and latency, while the other window for optimizing video
quality. By applying low complexity frame level rate-
distortion model in the testing sequences, our proposed
method shows excellent performance in balancing the
encoder buffer latency and consistent video quality.
The rest of this paper is organized as follows. In Section
2, the constraint of encoder buffer latency and consistent
video quality are analyzed. Then the proposed window-
based rate control scheme is presented in Section 3. Section
4 provides the experimental results and discussions. At last,
we give a conclusion in Section 5.
2. PROBLEM ANALYSIS
2.1. Bit rate and buffer delay constraint
In real-time CBR applications, the coded bit stream is
transmitted to the end users (decoder) through a bandwidth-
fixed channel, with a bit rate constraint 5
&
. Let ) and 5
7
be
the frame rate and frame bit budget, respectively. Adopting
a constant frame bit allocation by (1), similar to [7] [8],
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP)
978-1-4799-2893-4/14/$31.00 ©2014 IEEE 7333