JZUS - Journal of Zhejiang University SCIENCE

Journal of Zhejiang University SCIENCE A 2006 Vol.7 No.100 P.41-47

http://doi.org/10.1631/jzus.2006.AS0041

Content-adaptive robust error concealment for packet-lossy H.264 video streaming

Author(s): Liao Ning, Yan Dan, Quan Zi-Yi, Men Ai-Dong
Affiliation(s): Multimedia Center, School of Telecommunication Engineering, Beijing University of Posts & Telecom, Beijing 100876, China
Corresponding email(s): ning-777@tom.com
Key Words: Error concealment, Error control, H.264/AVC, Video streaming, Lossy transmission

Share this article to： More <<< Previous Article \|Next Article >>>

Abstract: In this paper, we present a spatio-temporal post-processing error concealment (EC) algorithm designed initially for a H.264 video-streaming scheme over packet-lossy networks. It aims at optimizing the subjective quality of the restored video under the constraints of low delay and computational complexity, which are critical to real-time applications and portable devices having limited resources. Specifically, it takes into consideration the physical property of motion field in order to achieve more meaningful perceptual video quality, in addition to the improved objective PSNR. Further, a simple bilinear spatial interpolation approach is combined with the improved boundary-match (B-M) based temporal EC approach according to texture and motion activity analysis. Finally, we propose a low complexity temporal EC method based on motion vector interpolation as a replacement of the B-M based approach in the scheme under low-computation requirement, or as a complement to further improve the scheme’s performance in applications having enough computation resources. Extensive experiments demonstrated that the proposal features not only better reconstruction, objectively and subjectively, than JM benchmark, but also robustness to different video sequences.

Reference

[1] Alkachouch, Z., Bellanger, M.G., 2000. DCT-based spatial domain interpolation of blocks in images. IEEE Trans. on Image Processing, 9(4):729-732.

[2] Chen, M.J., Chen, L.G., Weng, R.M., 1997. Error concealment of lost motion vectors with overlapped motion compensation. IEEE Trans. Circuits and Systems for Video Technology, 7(3):560-563.

[3] Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, 2003. Draft ITU-T Recomm. and Final Draft Int’l. Standard of Joint Video Specification (ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC), Doc.G050r1.

[4] Kwok, W., Sun, H., 1993. Multidirectional interpolation for spatial error concealment. IEEE Trans. on Consumer Electronics, 39(3):455-460.

[5] Mualla, M.A., Canagarajah, C.N., Bull, D.R., 2000. Motion field interpolation for temporal error concealment. IEEE Proc. Visual Image Signal Processing, 147(5):445-453.

[6] Salama, P., Shroff, N.B., Coyle, E.J., Delp, E.J., 1995. Error Concealment Techniques for Encoded Video Streams. Pro. Int. Conf. Image Processing, p.9-12.

[7] Salama, P., Schroff, N.B., Delp, E.J., 2000. Error concealment in MPEG video streams over ATM networks. IEEE J. on Select. Areas in Communication, 18(6):1129-1144.

[8] Shirani, S., Kossentini, F., Ward, R., 2000. A concealment method for video communication in an error-prone environment. IEEE J. Select. Areas Commun., 18(6): 1122-1128.

[9] Sun, H., Kwok, W., 1995. Concealment of damaged block transform coded images using projections onto convex sets. IEEE Trans. on Image Processing, 4(4):470-479.

[10] Tsekeridou, S., Pitas, I., 2000. MPEG-2 error concealment based on block-matching principles. IEEE Trans. Circuits and Systems for Video Tech., 10(4):646-658.

[11] VCEG, 1999. Internet Error Patterns VCEG-O38r1.doc. ftp://ftp.imtc-files.org/jvt-experts/9910_Red/Q15-I16r1.zip.

[12] Wang, Y., Ostermann, J., Zhang, Y.Q., 2002a. Two-dimensional Motion Models. Video Processing and Communications, Section 5.5. Prentice Hall.

[13] Wang, Y.K., Hannuksela, M.M., Varsa, V., Hourunranta, A., Gabbouj, M., 2002b. The error concealment feature in the H.26L test model. Proc. Int. Conf. Image Processing, 2:729-732.

[14] Wang, Z., Sheikh, H.R., Bovik, A.C., 2003. Objective Video Quality Assessment. In: Furht, B., Marqure, O. (Eds.), Handbook of Video Databases: Design and Applications. CRC Press, p.1041-1078.

[15] Wenger, S., 2003. H.264/AVC over IP. IEEE Trans. on Circuits and Systems for Video Tech., 13(7):645-656.

[16] Zheng, J.H., Chau, L.P., 2003. A motion vector recovery algorithm for digital video using Lagrangian interpolation. IEEE Trans. Broadcasting, 49(4):383-389.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Similar articles

- Go to

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference