Publishing Service

Polishing & Checking

Frontiers of Information Technology & Electronic Engineering

ISSN 2095-9184 (print), ISSN 2095-9230 (online)

Image-based 3D model retrieval using manifold learning

Abstract: We propose a new framework for image-based three-dimensional (3D) model retrieval. We first model the query image as a Euclidean point. Then we model all projected views of a 3D model as a symmetric positive definite (SPD) matrix, which is a point on a Riemannian manifold. Thus, the image-based 3D model retrieval is reduced to a problem of Euclid-to-Riemann metric learning. To solve this heterogeneous matching problem, we map the Euclidean space and SPD Riemannian manifold to the same high-dimensional Hilbert space, thus shrinking the great gap between them. Finally, we design an optimization algorithm to learn a metric in this Hilbert space using a kernel trick. Any new image descriptors, such as the features from deep learning, can be easily embedded in our framework. Experimental results show the advantages of our approach over the state-of-the-art methods for image-based 3D model retrieval.

Key words: Model retrieval, Euclidean space, Riemannian manifold;, Hilbert space, Metric learning

Chinese Summary  <19> 利用流形学习进行基于图像的三维模型检索

摘要:提出一种基于图像的三维模型检索新框架。把查询的图像建模为欧氏空间的一个点,把三维模型所有投影视图建模为一个对称正定矩阵,并视该对称正定矩阵为黎曼流形上的一个点。于是,基于图像的三维模型检索简化为欧氏空间到黎曼流形上的度量学习。为解决异质匹配问题,把欧式空间和对称正定矩阵黎曼空间映射到同一个高维希尔伯特空间,极大缩小彼此之间语义鸿沟。最后,使用核方法设计一个优化算法学习映射。任何新图像描述符,比如深度学习特征描述符,可以很容易嵌入该框架。实验结果表明,该方法相较目前最新基于图像的三维模型检索方法有一定优势。

关键词组:模型检索;欧式空间;黎曼流形;希尔伯特空间;度量学习


Share this article to: More

Go to Contents

References:

<Show All>

Open peer comments: Debate/Discuss/Question/Opinion

<1>

Please provide your name, email address and a comment





DOI:

10.1631/FITEE.1601764

CLC number:

TP391

Download Full Text:

Click Here

Downloaded:

2909

Clicked:

6333

Cited:

0

On-line Access:

2018-12-14

Received:

2016-12-01

Revision Accepted:

2017-05-22

Crosschecked:

2018-11-27

Journal of Zhejiang University-SCIENCE, 38 Zheda Road, Hangzhou 310027, China
Tel: +86-571-87952276; Fax: +86-571-87952331; E-mail: jzus@zju.edu.cn
Copyright © 2000~ Journal of Zhejiang University-SCIENCE