Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Long-term prediction for hierarchical-B-picture-based coding of video with repeated shots

Abstract: The latest video coding standard High Efficiency Video Coding (HEVC) can achieve much higher coding efficiency than previous video coding standards. Particularly, by exploiting the hierarchical B-picture prediction structure, temporal redundancy among neighbor frames is eliminated remarkably well. In practice, videos available to consumers usually contain many repeated shots, such as TV series, movies, and talk shows. According to our observations, when these videos are encoded by HEVC with the hierarchical B-picture structure, the temporal correlation in each shot is well exploited. However, the long-term correlation between repeated shots has not been used. We propose a long-term prediction (LTP) scheme to use the long-term temporal correlation between correlated shots in a video. The long-term reference (LTR) frames of a source video are chosen by clustering similar shots and extracting the representative frames, and a modified hierarchical B-picture coding structure based on an LTR frame is introduced to support long-term temporal prediction. An adaptive quantization method is further designed for LTR frames to improve the overall video coding efficiency. Experimental results show that up to 22.86% coding gain can be achieved using the new coding scheme.

Key words: High Efficiency Video Coding (HEVC), Long-term temporal correlation, Long-term prediction, Hierarchical B-picture structure

Chinese Summary  <23> 重复镜头视频基于分级B帧结构的长期预测编码方案

概要:最新视频编码标准--高效视频编码(HEVC)—获得了远高于之前视频编码标准的编码效率。特别是,在使用分级B帧预测结构时,HEVC可显著去除临近图像间的时间冗余。实际中,消费者使用的视频--例如电视剧、电影和脱口秀等 —通常包含了很多重复镜头。据我们观察,这些视频在分级B帧结构下使用HEVC编码时,每个镜头的时域相关性可以得到很好利用。然而,重复镜头之间的长期相关性并未被使用。我们提出一种长期预测方案,以利用视频中重复镜头之间的长期时域相关性。首先,聚类源视频中的相似镜头并从中抽取代表性图像作为长期参考帧。然后,使用长期参考帧对分级B帧的编码结构进行调整,以实现长期时域预测。最后,为长期参考帧设计一种自适应量化方法,以提高整体的视频编码效率。实验表明,提出的新编码方案可获得高达22.86%的编码性能增益。

关键词组:高效视频编码(HEVC);长期时域相关性;长期预测;分级B帧结构


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1601552

CLC number:

TN919.8

Download Full Text:

Click Here

Downloaded:

3169

Download summary:

<Click Here> 

Downloaded:

1462

Clicked:

6385

Cited:

0

On-line Access:

2018-05-07

Received:

2016-09-13

Revision Accepted:

2016-12-02

Crosschecked:

2018-03-15

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE