Full Text:   <3518>

CLC number: TN919.8

On-line Access: 2024-08-27

Received: 2023-10-17

Revision Accepted: 2024-05-08

Crosschecked: 2008-11-10

Cited: 0

Clicked: 6474

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
1. Reference List
Open peer comments

Journal of Zhejiang University SCIENCE A 2008 Vol.9 No.12 P.1621-1630

http://doi.org/10.1631/jzus.A0820200


Frame rate up-conversion using multiresolution critical point filters with occlusion refinement


Author(s):  Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO

Affiliation(s):  Department of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China

Corresponding email(s):   zjuzyx@isee.zju.edu.cn, wdwang2001@yahoo.com.cn

Key Words:  Frame rate up-conversion, Multiresolution critical-point filters, Occlusion refinement


Share this article to: More |Next Article >>>

Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO. Frame rate up-conversion using multiresolution critical point filters with occlusion refinement[J]. Journal of Zhejiang University Science A, 2008, 9(12): 1621-1630.

@article{title="Frame rate up-conversion using multiresolution critical point filters with occlusion refinement",
author="Yi-xiong ZHANG, Wei-dong WANG, Peng LIU, Qing-dong YAO",
journal="Journal of Zhejiang University Science A",
volume="9",
number="12",
pages="1621-1630",
year="2008",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.A0820200"
}

%0 Journal Article
%T Frame rate up-conversion using multiresolution critical point filters with occlusion refinement
%A Yi-xiong ZHANG
%A Wei-dong WANG
%A Peng LIU
%A Qing-dong YAO
%J Journal of Zhejiang University SCIENCE A
%V 9
%N 12
%P 1621-1630
%@ 1673-565X
%D 2008
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.A0820200

TY - JOUR
T1 - Frame rate up-conversion using multiresolution critical point filters with occlusion refinement
A1 - Yi-xiong ZHANG
A1 - Wei-dong WANG
A1 - Peng LIU
A1 - Qing-dong YAO
J0 - Journal of Zhejiang University Science A
VL - 9
IS - 12
SP - 1621
EP - 1630
%@ 1673-565X
Y1 - 2008
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.A0820200


Abstract: 
In this paper, multiresolution critical-point filters (CPFs) are employed to image matching for frame rate up-conversion (FRUC). By CPF matching, the dense motion field can be obtained for representing object motions accurately. However, the elastic motion model does not hold in the areas of occlusion, thus resulting in blur artifacts in the interpolated frame. To tackle this problem, we propose a new FRUC scheme using an occlusion refined CPF matching interpolation (ORCMI). In the proposed approach, the occlusion refinement is based on a bidirectional CPF mapping. And the intermediate frames are generated by the bidirectional interpolation for non-occlusion pixels combined with unidirectional projection for the occlusion pixels. Experimental results show that ORCMI improves the visual quality of the interpolated frames, especially at the occlusion regions. Compared to the block matching based FRUC algorithm, ORCMI can achieve 1~2 dB PSNR gain for standard video sequences.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1] Altnubasak, Y., Tekalp, A.M., 1997. Occlusion-adaptive, content-based mesh design and forward tracking. IEEE Trans. on Image Processing, 6(9):1270-1280.

[2] Beller, E.B., van Gurp, J.W., Janssen, J.G.W.M., Braspenning, R., Wittebrood, R., 2007. Solving Occlusion in Frame-rate Up-conversion. IEEE Int. Conf. Consumer Electronics, p.1-2.

[3] Castagno, R., Haavisto, P., Ramponi, G., 1996. A method for motion adaptive frame rate up-conversion. IEEE Trans. on Circuits Syst. Video Technol., 6(5):436-446.

[4] Chambers, B., Durand, J., Gans, N., Hutchinson, S., 2003. Dynamic Feature Point Detection for Visual Servoing Using Multiresolution Critical-point Filters. Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, p.504-509.

[5] Choi, B.D., Han, J.W., Kim, C.S., Ko, S.J., 2006. Frame rate up-conversion using perspective transform. IEEE Trans. on Consum. Electron., 52(3):975-982.

[6] Choi, B.D., Han, J.W., Kim, C.S., Ko, S.J., 2007. Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation. IEEE Trans. on Circuits Syst. Video Technol., 17(4):407-416.

[7] Durand, J., Hutchinson, S., 2003. Real-time Object Tracking Using Multiresolution Critical Point Filters. Proc. IEEE Int. Conf. Robots and Automation, 2:1682-1687.

[8] Ha, T., Lee, S., Kim, J., 2004. Motion compensated frame interpolation by new block-based motion estimation algorithm. IEEE Trans. on Consum. Electron., 50(2):752-759.

[9] Haavisto, P., Juhola, J., Neuvo, Y., 1989. Fractional frame rate up-conversion using weighted median filters. IEEE Trans. on Consum. Electron., 35(3):272-278.

[10] Habuka, K., Shinagawa, Y., 2004. Image interpolation using enhanced multiresolution critical-point filters. Int. J. Comput. Vision, 58(1):19-35.

[11] Lee, S.H., Shin, Y.C., Yang, S.J., Moon, H.H., Park, R.H., 2002. Adaptive MC interpolation for frame rate up-conversion. IEEE Trans. on Consum. Electron., 48(3):444-450.

[12] Sanchez, O., 2003. Tracking of an Occluded Object in a Video Sequence. 7th Int. Symp. Signal Processing and Its Application, 2:231-234.

[13] Shinagawa, Y., Kunii, K.L., 1998. Unconstrained automatic image matching using multiresolutional critical-point filters. IEEE Trans. on Pattern Anal. Machine Intell., 20(9):994-1010.

[14] Wittebrood, R.B., de Haan, G., Lodder, R., 2003. Tackling Occlusion in Scan Rate Conversion Systems. IEEE Int. Conf. Consumer Electronics, p.344-345.

[15] Yang, Y.T., Tung, Y.S., Wu, J.L., 2007. Quality enhancement of frame rate up-converted video by adaptive frame skip and reliable motion extraction. IEEE Trans. on Circuits Syst. Video Technol., 17(12):1700-1713.

[16] Zhai, J., Yu, K., Li, J., Li, S., 2005. A Low Complexity Motion Compensated Frame Interpolation Method. Proc. IEEE Int. Symp. on Circuits and Systems, 5:4927-4930.

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2024 Journal of Zhejiang University-SCIENCE