Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

On 3D face reconstruction via cascaded regression in shape space

Abstract: Cascaded regression has been recently applied to reconstruct 3D faces from single 2D images directly in shape space, and has achieved state-of-the-art performance. We investigate thoroughly such cascaded regression based 3D face reconstruction approaches from four perspectives that are not well been studied: (1) the impact of the number of 2D landmarks; (2) the impact of the number of 3D vertices; (3) the way of using standalone automated landmark detection methods; (4) the convergence property. To answer these questions, a simplified cascaded regression based 3D face reconstruction method is devised. This can be integrated with standalone automated landmark detection methods and reconstruct 3D face shapes that have the same pose and expression as the input face images, rather than normalized pose and expression. An effective training method is also proposed by disturbing the automatically detected landmarks. Comprehensive evaluation experiments have been carried out to compare to other 3D face reconstruction methods. The results not only deepen the understanding of cascaded regression based 3D face reconstruction approaches, but also prove the effectiveness of the proposed method.

Key words: 3D face reconstruction, Cascaded regressor, Shape space, Real-time

Chinese Summary  <20> 形状空间下基于级联回归的三维人脸重建

概要:最近,级联回归方法在基于二维图像的三维人脸重建中取得了良好的效果。本文主要探究了基于级联回归三维人脸重建中四个未解决的重要问题:(1)二维特征点数量的影响;(2)三维点云数量的影响;(3)自动二维特征点的检测方法;(4)算法的收敛。本文专门设计了一个简单有效的基于形状空间的级联回归三维重建算法。该算法有效利用各类独立的自动二维特征点检测算法,且重建的三维人脸具有和输入图像相同的姿态和表情。同时在训练中,本文设计了一种随机扰动检二维特征点位置信息的策略,使得算法更有效且更鲁棒。最后,通过大量的对比实验证明了该算法不仅有着良好的精度和计算效率,而且对加深级联回归三维重建方法的理解有着启发意义。

关键词组:三维人脸重建;级联回归;形状空间;实时


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1700253

CLC number:

TP319

Download Full Text:

Click Here

Downloaded:

2197

Download summary:

<Click Here> 

Downloaded:

1497

Clicked:

5485

Cited:

0

On-line Access:

2018-02-06

Received:

2017-04-16

Revision Accepted:

2017-08-09

Crosschecked:

2017-12-20

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE