|
|
Frontiers of Information Technology & Electronic Engineering
ISSN 2095-9184 (print), ISSN 2095-9230 (online)
2022 Vol.23 No.4 P.653-660
A three-dimensional measurement method for binocular endoscopes based on deep learning
Abstract: Abstract:In the practice of clinical endoscopy, the precise estimation of the lesion size is quite significant for diagnosis. In this paper, we propose a three-dimensional (3D) measurement method for binocular endoscopes based on deep learning, which can overcome the poor robustness of the traditional binocular matching algorithm in texture-less areas. A simulated binocular image dataset is created from the target 3D data obtained by a 3D scanner and the binocular camera is simulated by 3D rendering software to train a disparity estimation model for 3D measurement. The experimental results demonstrate that, compared with the traditional binocular matching algorithm, the proposed method improves the accuracy and disparity map generation speed by 48.9% and 90.5%, respectively. This can provide more accurate and reliable lesion size and improve the efficiency of endoscopic diagnosis.
Key words: Key words: Binocular endoscope; Three-dimensional measurement; Deep learning; Disparity estimation
1浙江大学光电科学与工程学院现代光学仪器国家重点实验室，中国杭州市，310027
2之江实验室超级感知中心，中国杭州市，311100
摘要：在内窥镜临床检查中，病灶尺寸精确估计对诊断具有非常重要的意义。本文提出一种基于深度学习的双目内窥镜三维测量方法，可以克服传统双目匹配算法在弱纹理区域鲁棒性较差的缺点。利用三维扫描仪获得的目标三维数据和三维渲染软件仿真的双目相机创建虚拟双目图像数据集，用于训练视差预测模型进行三维测量。实验结果表明，所提方法相比传统双目匹配算法在视差准确度和视差图生成速度上分别提高48.9%和90.5%，能够提供更加准确、可靠的病灶尺寸信息，提高内窥镜诊断效率。
关键词组：
References:
Open peer comments: Debate/Discuss/Question/Opinion
<1>
DOI:
10.1631/FITEE.2000679
CLC number:
TN29;TP391.4
Download Full Text:
Downloaded:
4350
Download summary:
<Click Here>Downloaded:
367Clicked:
6551
Cited:
0
On-line Access:
2022-04-20
Received:
2020-12-07
Revision Accepted:
2022-05-04
Crosschecked:
2021-03-22