Similar articles

Abstract: Inpainting is the process of reconstructing damaged regions of images and video frames. This study deals with weaknesses of the current video inpainting techniques, when an object is totally damaged, and a framework for video inpainting is proposed. Using this framework, the moving object is separated from the background. A large mosaic image is constructed using the moving object and then a patch-based method with large patches is used to fill holes. In each frame, the inpainted foreground is obtained by placing the object in its location. Missing areas of the stationary background are also filled separately and the final video is produced by composing the inpainted background and object frames. Results for three video sequences with an occluded object show that this approach represents the object in the missing region better than other approaches.

[1]Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C., 2000. Image Inpainting. Proc. ACM SIGGRAPH Conf. on Computer Graphics, p.417-424.

[2]Bertalmio, M., Bertozzi, A.L., Sapiro, G., 2001. Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1:355-362.

[3]Bertalmio, M., Vese, L., Sapiro, G., Osher, S., 2003. Simultaneous structure and texture image inpainting. IEEE Trans. Image Process., 12(8):882-889.

[4]Cheung, S., Zhao, J., Venkatesh, M.V., 2006. Efficient Object-Based Video Inpainting. Proc. IEEE Int. Conf. on Image Processing, p.705-708.

[5]Criminisi, A., Perez, P., Toyama, K., 2004. Region filling and object removal by exemplar-based inpainting. IEEE Trans. Image Process., 13(9):1200-1212.

[6]Ho, H.T., Goecke, R., 2007. Automatic Parametrisation for an Image Completion Method Based on Markov Random Fields. Proc. IEEE Int. Conf. on Image Processing, 3:541-544.

[7]Liu, D., Sun, X., Wu, F., Li, S., Zhang, Y.Q., 2007. Image compression with edge-based inpainting. IEEE Trans. Circ. Syst. Video Technol., 17(10):1273-1287.

[8]Matsushita, Y., Ofek, E., Ge, W., Tang, X., Shum, H.Y., 2006. Full-frame video stabilization with motion inpainting. IEEE Trans. Pattern Anal. Mach. Intell., 28(7):1150-1163.

[9]Oliveira, M.M., Bowen, B., McKenna, R., Chang, Y.S., 2001. Fast Digital Image Inpainting. Proc. Int. Conf. on Visualization, Imaging and Image Processing, p.261-266.

[10]Patwardhan, K.A., Sapiro, G., Bertalmio, M., 2007. Video inpainting under constrained camera motion. IEEE Trans. Image Process., 16(2):545-553.

[11]Sheikh, Y., Shah, M., 2005. Bayesian Object Detection in Dynamic Scenes. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 1:74-79.

[12]Shen, Y., Lu, F., Cao, X., Foroosh, H., 2006. Video Completion for Perspective Camera under Constrained Motion. Proc. 18th Int. Conf. on Pattern Recognition, 3:63-66.

[13]Stauffer, C., Grimson, W.E.L., 1999. Adaptive Background Mixture Models for Real-Time Tracking. Proc. Computer Vision and Pattern Recognition, p.246-252.

[14]Sun, J., Yuan, L., Jia, J., Shum, H.Y., 2005. Image completion with structure propagation. ACM Trans. Graph., 24(3):861-868.

[15]Venkatesh, M.V., Cheung, S.S., Zhao, J., 2009. Efficient object-based video inpainting. Pattern Recogn. Lett., 30(2):168-179.

[16]Wang, H., Li, H., Li, B., 2007. Video Inpainting for Largely Occluded Moving Human. Proc. IEEE Int. Conf. on Multimedia and Expo, p.1719-1722.

[17]Wexler, Y., Shechtman, E., Irani, M., 2004. Space-Time Video Completion. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 1:120-127.

[18]Wexler, Y., Shechtman, E., Irani, M., 2007. Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell., 29(3):463-476.

[19]Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P., 1997. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell., 19(7):780-785.

[20]Zhang, Y., Xiao, J., Shah, M., 2005. Motion Layer Based Object Removal in Videos. Proc. IEEE Workshop on Applications of Computer Vision, p.516-521.

[21]Zivkovic, Z., 2004. Improved Adaptive Gaussian Mixture Model for Background Subtraction. Proc. 17th Int. Conf. on Pattern Recognition, 2:28-31.