Journal of Zhejiang University SCIENCE C 2010 Vol.11 No.9 P.690-698

http://doi.org/10.1631/jzus.C1000067


Harmonic coordinates for real-time image cloning


Author(s):  Rui Wang, Wei-feng Chen, Ming-hao Pan, Hu-jun Bao

Affiliation(s):  1. State Key Laboratory of CAD &CG, Zhejiang University, Hangzhou 310027, China

Corresponding email(s):   chenweifeng@cad.zju.edu.cn

Key Words:  Seamless cloning, Poisson’s equation, Harmonic coordinates (HCs), Mean-value coordinates (MVCs), GPU acceleration


Rui Wang, Wei-feng Chen, Ming-hao Pan, Hu-jun Bao. Harmonic coordinates for real-time image cloning[J]. Journal of Zhejiang University Science C, 2010, 11(9): 690-698.

@article{title="Harmonic coordinates for real-time image cloning",
author="Rui Wang, Wei-feng Chen, Ming-hao Pan, Hu-jun Bao",
journal="Journal of Zhejiang University Science C",
volume="11",
number="9",
pages="690-698",
year="2010",
publisher="Zhejiang University Press & Springer",
doi="10.1631/jzus.C1000067"
}

%0 Journal Article
%T Harmonic coordinates for real-time image cloning
%A Rui Wang
%A Wei-feng Chen
%A Ming-hao Pan
%A Hu-jun Bao
%J Journal of Zhejiang University SCIENCE C
%V 11
%N 9
%P 690-698
%@ 1869-1951
%D 2010
%I Zhejiang University Press & Springer
%DOI 10.1631/jzus.C1000067

TY - JOUR
T1 - Harmonic coordinates for real-time image cloning
A1 - Rui Wang
A1 - Wei-feng Chen
A1 - Ming-hao Pan
A1 - Hu-jun Bao
J0 - Journal of Zhejiang University Science C
VL - 11
IS - 9
SP - 690
EP - 698
%@ 1869-1951
Y1 - 2010
PB - Zhejiang University Press & Springer
ER -
DOI - 10.1631/jzus.C1000067


Abstract: 
Traditional gradient domain seamless image cloning is a time consuming task, requiring the solving of Poisson’s equations whenever the shape or position of the cloned region changes. Recently, a more efficient alternative, the mean-value coordinates (MVCs) based approach, was proposed to interpolate interior pixels by a weighted combination of values along the boundary. However, this approach cannot faithfully preserve the gradient in the cloning region. In this paper, we introduce harmonic cloning, which uses harmonic coordinates (HCs) instead of MVCs in image cloning. Benefiting from the non-negativity and interior locality of HCs, our interpolation generates a more accurate harmonic field across the cloned region, to preserve the results with as high a quality as with Poisson cloning. Furthermore, with optimizations and implementation on a graphic processing unit (GPU), we demonstrate that, compared with the method using MVCs, our harmonic cloning gains better quality while retaining real-time performance.

Darkslateblue:Affiliate; Royal Blue:Author; Turquoise:Article

Reference

[1]Agarwala, A., 2007. Efficient gradient-domain compositing using quadtrees. ACM Trans. Graph., 26(3), Article No. 94, p.1-5.

[2]DeRose, T., Meyer, M., 2006. Harmonic Coordinates. Pixar Technical Memo 06–02. Pixar Animation Studios. Available from http://graphics.pixar.com/HarmonicCoordinates/

[3]Farbman, Z., Hoffer, G., Lipman, Y., Cohen-Or, D., Lischinski, D., 2009. Coordinates for instant image cloning. ACM Trans. Graph., 28(3), Article No. 67, p.1-9.

[4]Floater, M.S., 2003. Mean value coordinates. Comput. Aided Geom. Des., 20(1):19-27.

[5]Georgiev, T., 2004. Photoshop Healing Brush: a Tool for Seamless Cloning. Workshop on Applications of Computer Vision, p.1-8.

[6]Iserles, A., 1996. A First Course in Numerical Analysis of Differential Equations. Cambridge University Press, New York, USA.

[7]Jeschke, S., Cline, D., Wonka, P., 2009. A GPU Laplacian solver for diffusion curves and Poisson image editing. ACM Trans. Graph., 28(5), Article No. 116, p.1-8.

[8]Jia, J., Sun, J., Tang, C.K., Shum, H.Y., 2006. Drag-and-drop pasting. ACM Trans. Graph., 25(3):631-637.

[9]Joshi, P., Meyer, M., DeRose, T., Green, B., Sanocki, T., 2007. Harmonic coordinates for character articulation. ACM Trans. Graph., 26(3), Article No. 71, p.1-9.

[10]Kazhdan, M., Hoppe, H., 2008. Streaming multigrid for gradient-domain operations on large images. ACM Trans. Graph., 27(3), Article No. 21, p.1-10.

[11]Levin, A., Zomet, A., Peleg, S., Weiss, Y., 2004. Seamless Image Stitching in the Gradient Domain. 8th European Conf. on Computer Vision, p.377-389.

[12]McCann, J., Pollard, N.S., 2008. Real-time gradient-domain painting. ACM Trans. Graph., 27(3), Article No. 93, p.1-7.

[13]Orzan, A., Bousseau, A., Winnemöller, H., Barla, P., Thollot, J., Salesin, D., 2008. Diffusion curves: a vector representation for smooth-shaded images. ACM Trans. Graph., 27(3), Article No. 92, p.1-8.

[14]Pérez, P., Gangnet, M., Blake, A., 2003. Poisson image editing. ACM Trans. Graph., 22(3):313-318.

[15]Shewchuk, J.R., 2005. A Two-Dimensional Quality Mesh Generator and Delaunay Triangulator. Available from http://www.cs.cmu.edu/~quake/triangle.html [Accessed on Mar. 22, 2010].

[16]Szeliski, R., 2006. Locally adapted hierarchical basis preconditioning. ACM Trans. Graph., 25:1135-1143.

Full Text:   <7629>

CLC number: TP391.41

On-line Access: 2024-08-27

Received: 2023-10-17

Revision Accepted: 2024-05-08

Crosschecked: 2010-08-02

Cited: 3

Clicked: 12955

Citations:  Bibtex RefMan EndNote GB/T7714

-   Go to

Article info.
Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952783; E-mail: cjzhang@zju.edu.cn
Copyright © 2000 - 2026 Journal of Zhejiang University-SCIENCE